2026-02-17T20:51:24.117 INFO:root:teuthology version: 1.2.4.dev9+gfa17720d0 2026-02-17T20:51:24.134 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T20:51:24.216 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:27:21-fs-wip-jcollin-testing-20260217.024944-squid-distro-default-trial/52913 branch: wip-jcollin-testing-20260217.024944-squid description: fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench conf/{client mds mgr mon osd} distro/single-container-host overrides/{ignorelist_health pg_health}} email: jcollin@redhat.com first_in_suite: false flavor: default job_id: '52913' kernel: branch: distro kdb: 1 sha1: distro last_in_suite: false machine_type: trial name: jcollin-2026-02-17_12:27:21-fs-wip-jcollin-testing-20260217.024944-squid-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-jcollin-testing-20260217.024944-squid ceph: cluster-conf: mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: debug ms: 1 debug osd: 20 osd op complaint time: 180 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - MGR_MODULE_ERROR - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded - pg .* is stuck peering sha1: 76b494d6529326129dc43abf3fffd48fbf35c395 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 76b494d6529326129dc43abf3fffd48fbf35c395 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 workunit: branch: wip-jcollin-testing-20260217.024944-squid sha1: 76b494d6529326129dc43abf3fffd48fbf35c395 owner: scheduled_jcollin@soko04.front.sepia.ceph.com priority: 200 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - host.b - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 3101 sha1: 76b494d6529326129dc43abf3fffd48fbf35c395 sleep_before_teardown: 0 subset: 301/2048 suite: fs suite_branch: wip-jcollin-testing-20260217.024944-squid suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_76b494d6529326129dc43abf3fffd48fbf35c395/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 76b494d6529326129dc43abf3fffd48fbf35c395 targets: trial104.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNPemlRI3KQapnUNH3grozfErMGIdYOgcaqyv2dJgm6VBKQ/mVful2epxhhL7GcQIgkk4FVsyxyLhCzv0FnfvPU= trial153.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGnKCAxuHEgAAnRXo29lpP0KH9aTtWCzQtdnAallq7PtgCvQh39eKJ+6+s3fsMvGoQMNdfHJPaa8iRAnJVu3ps8= tasks: - install: null - cephadm: roleless: true - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create foo - ceph fs volume create bar - fs.ready: timeout: 300 - ceph-fuse: client.0: cephfs_name: foo - ceph-fuse: client.1: cephfs_name: bar - workunit: clients: all: - suites/dbench.sh - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: fa17720d0088c3ac28e473468bfc79eeaff5cd38 timestamp: 2026-02-17_12:27:21 tube: trial user: jcollin verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3682 2026-02-17T20:51:24.216 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_76b494d6529326129dc43abf3fffd48fbf35c395/qa; will attempt to use it 2026-02-17T20:51:24.217 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_76b494d6529326129dc43abf3fffd48fbf35c395/qa/tasks 2026-02-17T20:51:24.217 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-17T20:51:24.219 INFO:teuthology.task.internal:Checking packages... 2026-02-17T20:51:24.219 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '76b494d6529326129dc43abf3fffd48fbf35c395' 2026-02-17T20:51:24.219 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-17T20:51:24.219 INFO:teuthology.packaging:ref: None 2026-02-17T20:51:24.219 INFO:teuthology.packaging:tag: None 2026-02-17T20:51:24.219 INFO:teuthology.packaging:branch: wip-jcollin-testing-20260217.024944-squid 2026-02-17T20:51:24.219 INFO:teuthology.packaging:sha1: 76b494d6529326129dc43abf3fffd48fbf35c395 2026-02-17T20:51:24.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-jcollin-testing-20260217.024944-squid 2026-02-17T20:51:24.344 INFO:teuthology.task.internal:Found packages for ceph version 19.2.3-683.g76b494d6 2026-02-17T20:51:24.346 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-17T20:51:24.357 INFO:teuthology.task.internal:no buildpackages task found 2026-02-17T20:51:24.357 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-17T20:51:24.371 INFO:teuthology.task.internal:Saving configuration 2026-02-17T20:51:24.382 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-17T20:51:24.397 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-17T20:51:24.478 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial104.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:27:21-fs-wip-jcollin-testing-20260217.024944-squid-distro-default-trial/52913', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 20:41:18.683753', 'locked_by': 'scheduled_jcollin@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNPemlRI3KQapnUNH3grozfErMGIdYOgcaqyv2dJgm6VBKQ/mVful2epxhhL7GcQIgkk4FVsyxyLhCzv0FnfvPU='} 2026-02-17T20:51:24.537 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial153.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:27:21-fs-wip-jcollin-testing-20260217.024944-squid-distro-default-trial/52913', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-17 20:41:18.683128', 'locked_by': 'scheduled_jcollin@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGnKCAxuHEgAAnRXo29lpP0KH9aTtWCzQtdnAallq7PtgCvQh39eKJ+6+s3fsMvGoQMNdfHJPaa8iRAnJVu3ps8='} 2026-02-17T20:51:24.537 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-17T20:51:24.548 INFO:teuthology.task.internal:roles: ubuntu@trial104.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2026-02-17T20:51:24.549 INFO:teuthology.task.internal:roles: ubuntu@trial153.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2026-02-17T20:51:24.549 INFO:teuthology.run_tasks:Running task console_log... 2026-02-17T20:51:24.687 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x761d7cde6700>, signals=[15]) 2026-02-17T20:51:24.687 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-17T20:51:24.699 INFO:teuthology.task.internal:Opening connections... 2026-02-17T20:51:24.699 DEBUG:teuthology.task.internal:connecting to ubuntu@trial104.front.sepia.ceph.com 2026-02-17T20:51:24.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:51:24.764 DEBUG:teuthology.task.internal:connecting to ubuntu@trial153.front.sepia.ceph.com 2026-02-17T20:51:24.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:51:24.829 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-17T20:51:24.839 DEBUG:teuthology.orchestra.run.trial104:> uname -m 2026-02-17T20:51:24.857 INFO:teuthology.orchestra.run.trial104.stdout:x86_64 2026-02-17T20:51:24.857 DEBUG:teuthology.orchestra.run.trial104:> cat /etc/os-release 2026-02-17T20:51:24.912 INFO:teuthology.orchestra.run.trial104.stdout:NAME="CentOS Stream" 2026-02-17T20:51:24.912 INFO:teuthology.orchestra.run.trial104.stdout:VERSION="9" 2026-02-17T20:51:24.912 INFO:teuthology.orchestra.run.trial104.stdout:ID="centos" 2026-02-17T20:51:24.912 INFO:teuthology.orchestra.run.trial104.stdout:ID_LIKE="rhel fedora" 2026-02-17T20:51:24.912 INFO:teuthology.orchestra.run.trial104.stdout:VERSION_ID="9" 2026-02-17T20:51:24.912 INFO:teuthology.orchestra.run.trial104.stdout:PLATFORM_ID="platform:el9" 2026-02-17T20:51:24.912 INFO:teuthology.orchestra.run.trial104.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T20:51:24.912 INFO:teuthology.orchestra.run.trial104.stdout:ANSI_COLOR="0;31" 2026-02-17T20:51:24.912 INFO:teuthology.orchestra.run.trial104.stdout:LOGO="fedora-logo-icon" 2026-02-17T20:51:24.912 INFO:teuthology.orchestra.run.trial104.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T20:51:24.912 INFO:teuthology.orchestra.run.trial104.stdout:HOME_URL="https://centos.org/" 2026-02-17T20:51:24.912 INFO:teuthology.orchestra.run.trial104.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T20:51:24.912 INFO:teuthology.orchestra.run.trial104.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T20:51:24.912 INFO:teuthology.orchestra.run.trial104.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T20:51:24.913 INFO:teuthology.lock.ops:Updating trial104.front.sepia.ceph.com on lock server 2026-02-17T20:51:24.984 DEBUG:teuthology.orchestra.run.trial153:> uname -m 2026-02-17T20:51:25.000 INFO:teuthology.orchestra.run.trial153.stdout:x86_64 2026-02-17T20:51:25.000 DEBUG:teuthology.orchestra.run.trial153:> cat /etc/os-release 2026-02-17T20:51:25.055 INFO:teuthology.orchestra.run.trial153.stdout:NAME="CentOS Stream" 2026-02-17T20:51:25.055 INFO:teuthology.orchestra.run.trial153.stdout:VERSION="9" 2026-02-17T20:51:25.055 INFO:teuthology.orchestra.run.trial153.stdout:ID="centos" 2026-02-17T20:51:25.055 INFO:teuthology.orchestra.run.trial153.stdout:ID_LIKE="rhel fedora" 2026-02-17T20:51:25.056 INFO:teuthology.orchestra.run.trial153.stdout:VERSION_ID="9" 2026-02-17T20:51:25.056 INFO:teuthology.orchestra.run.trial153.stdout:PLATFORM_ID="platform:el9" 2026-02-17T20:51:25.056 INFO:teuthology.orchestra.run.trial153.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-17T20:51:25.056 INFO:teuthology.orchestra.run.trial153.stdout:ANSI_COLOR="0;31" 2026-02-17T20:51:25.056 INFO:teuthology.orchestra.run.trial153.stdout:LOGO="fedora-logo-icon" 2026-02-17T20:51:25.056 INFO:teuthology.orchestra.run.trial153.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-17T20:51:25.056 INFO:teuthology.orchestra.run.trial153.stdout:HOME_URL="https://centos.org/" 2026-02-17T20:51:25.056 INFO:teuthology.orchestra.run.trial153.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-17T20:51:25.056 INFO:teuthology.orchestra.run.trial153.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-17T20:51:25.056 INFO:teuthology.orchestra.run.trial153.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-17T20:51:25.056 INFO:teuthology.lock.ops:Updating trial153.front.sepia.ceph.com on lock server 2026-02-17T20:51:25.137 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-17T20:51:25.149 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-17T20:51:25.162 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-17T20:51:25.162 DEBUG:teuthology.orchestra.run.trial104:> test '!' -e /home/ubuntu/cephtest 2026-02-17T20:51:25.164 DEBUG:teuthology.orchestra.run.trial153:> test '!' -e /home/ubuntu/cephtest 2026-02-17T20:51:25.181 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-17T20:51:25.192 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-17T20:51:25.192 DEBUG:teuthology.orchestra.run.trial104:> test -z $(ls -A /var/lib/ceph) 2026-02-17T20:51:25.224 DEBUG:teuthology.orchestra.run.trial153:> test -z $(ls -A /var/lib/ceph) 2026-02-17T20:51:25.240 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-17T20:51:25.404 INFO:teuthology.run_tasks:Running task kernel... 2026-02-17T20:51:25.424 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'} 2026-02-17T20:51:25.424 INFO:teuthology.task.kernel:config {'host.a': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}, 'host.b': {'branch': 'distro', 'kdb': 1, 'sha1': 'distro'}}, timeout 300 2026-02-17T20:51:25.424 DEBUG:teuthology.orchestra.run.trial104:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T20:51:25.425 DEBUG:teuthology.orchestra.run.trial153:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-17T20:51:25.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:51:25.441 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-17T20:51:25.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:51:25.441 DEBUG:teuthology.orchestra.run.trial153:> uname -r 2026-02-17T20:51:25.498 INFO:teuthology.orchestra.run.trial104.stdout:5.14.0-645.el9.x86_64 2026-02-17T20:51:25.498 INFO:teuthology.task.kernel:Running kernel on trial104: 5.14.0-645.el9.x86_64 2026-02-17T20:51:25.498 DEBUG:teuthology.orchestra.run.trial104:> sudo yum install -y kernel 2026-02-17T20:51:25.498 INFO:teuthology.orchestra.run.trial153.stdout:5.14.0-645.el9.x86_64 2026-02-17T20:51:25.498 INFO:teuthology.task.kernel:Running kernel on trial153: 5.14.0-645.el9.x86_64 2026-02-17T20:51:25.498 DEBUG:teuthology.orchestra.run.trial153:> sudo yum install -y kernel 2026-02-17T20:51:26.934 INFO:teuthology.orchestra.run.trial153.stdout:CentOS Stream 9 - BaseOS 8.4 MB/s | 8.9 MB 00:01 2026-02-17T20:51:30.800 INFO:teuthology.orchestra.run.trial153.stdout:CentOS Stream 9 - AppStream 8.0 MB/s | 27 MB 00:03 2026-02-17T20:51:34.278 INFO:teuthology.orchestra.run.trial104.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.9 MB 00:08 2026-02-17T20:51:37.455 INFO:teuthology.orchestra.run.trial104.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-17T20:51:41.347 INFO:teuthology.orchestra.run.trial104.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 7.8 MB 00:01 2026-02-17T20:51:42.670 INFO:teuthology.orchestra.run.trial153.stdout:CentOS Stream 9 - CRB 836 kB/s | 7.8 MB 00:09 2026-02-17T20:51:42.954 INFO:teuthology.orchestra.run.trial104.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-17T20:51:43.873 INFO:teuthology.orchestra.run.trial153.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 20 kB 00:00 2026-02-17T20:51:44.293 INFO:teuthology.orchestra.run.trial104.stdout:Extra Packages for Enterprise Linux 16 MB/s | 20 MB 00:01 2026-02-17T20:51:44.821 INFO:teuthology.orchestra.run.trial153.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2026-02-17T20:51:47.504 INFO:teuthology.orchestra.run.trial104.stdout:lab-extras 1.3 MB/s | 50 kB 00:00 2026-02-17T20:51:48.015 INFO:teuthology.orchestra.run.trial153.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-17T20:51:48.532 INFO:teuthology.orchestra.run.trial104.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T20:51:48.554 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:51:48.555 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:51:48.555 INFO:teuthology.orchestra.run.trial104.stdout: Package Architecture Version Repository Size 2026-02-17T20:51:48.555 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:51:48.555 INFO:teuthology.orchestra.run.trial104.stdout:Installing: 2026-02-17T20:51:48.555 INFO:teuthology.orchestra.run.trial104.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T20:51:48.555 INFO:teuthology.orchestra.run.trial104.stdout:Installing dependencies: 2026-02-17T20:51:48.555 INFO:teuthology.orchestra.run.trial104.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T20:51:48.555 INFO:teuthology.orchestra.run.trial104.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T20:51:48.555 INFO:teuthology.orchestra.run.trial104.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T20:51:48.555 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:51:48.555 INFO:teuthology.orchestra.run.trial104.stdout:Transaction Summary 2026-02-17T20:51:48.555 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:51:48.556 INFO:teuthology.orchestra.run.trial104.stdout:Install 4 Packages 2026-02-17T20:51:48.556 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:51:48.556 INFO:teuthology.orchestra.run.trial104.stdout:Total download size: 88 M 2026-02-17T20:51:48.556 INFO:teuthology.orchestra.run.trial104.stdout:Installed size: 135 M 2026-02-17T20:51:48.556 INFO:teuthology.orchestra.run.trial104.stdout:Downloading Packages: 2026-02-17T20:51:48.836 INFO:teuthology.orchestra.run.trial104.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 3.5 MB/s | 803 kB 00:00 2026-02-17T20:51:49.027 INFO:teuthology.orchestra.run.trial153.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-17T20:51:49.049 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:51:49.050 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:51:49.050 INFO:teuthology.orchestra.run.trial153.stdout: Package Architecture Version Repository Size 2026-02-17T20:51:49.050 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:51:49.050 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T20:51:49.051 INFO:teuthology.orchestra.run.trial153.stdout: kernel x86_64 5.14.0-681.el9 baseos 803 k 2026-02-17T20:51:49.051 INFO:teuthology.orchestra.run.trial153.stdout:Installing dependencies: 2026-02-17T20:51:49.051 INFO:teuthology.orchestra.run.trial153.stdout: kernel-core x86_64 5.14.0-681.el9 baseos 17 M 2026-02-17T20:51:49.051 INFO:teuthology.orchestra.run.trial153.stdout: kernel-modules x86_64 5.14.0-681.el9 baseos 40 M 2026-02-17T20:51:49.051 INFO:teuthology.orchestra.run.trial153.stdout: kernel-modules-core x86_64 5.14.0-681.el9 baseos 31 M 2026-02-17T20:51:49.051 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:51:49.051 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T20:51:49.051 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:51:49.051 INFO:teuthology.orchestra.run.trial153.stdout:Install 4 Packages 2026-02-17T20:51:49.051 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:51:49.051 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 88 M 2026-02-17T20:51:49.051 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 135 M 2026-02-17T20:51:49.052 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T20:51:49.184 INFO:teuthology.orchestra.run.trial104.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 30 MB/s | 17 MB 00:00 2026-02-17T20:51:49.248 INFO:teuthology.orchestra.run.trial153.stdout:(1/4): kernel-5.14.0-681.el9.x86_64.rpm 5.9 MB/s | 803 kB 00:00 2026-02-17T20:51:49.397 INFO:teuthology.orchestra.run.trial153.stdout:(2/4): kernel-core-5.14.0-681.el9.x86_64.rpm 61 MB/s | 17 MB 00:00 2026-02-17T20:51:49.468 INFO:teuthology.orchestra.run.trial104.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 49 MB/s | 31 MB 00:00 2026-02-17T20:51:49.598 INFO:teuthology.orchestra.run.trial104.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 40 MB/s | 40 MB 00:00 2026-02-17T20:51:49.598 INFO:teuthology.orchestra.run.trial104.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:51:49.598 INFO:teuthology.orchestra.run.trial104.stdout:Total 85 MB/s | 88 MB 00:01 2026-02-17T20:51:49.785 INFO:teuthology.orchestra.run.trial153.stdout:(3/4): kernel-modules-core-5.14.0-681.el9.x86_6 58 MB/s | 31 MB 00:00 2026-02-17T20:51:49.791 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction check 2026-02-17T20:51:49.879 INFO:teuthology.orchestra.run.trial153.stdout:(4/4): kernel-modules-5.14.0-681.el9.x86_64.rpm 52 MB/s | 40 MB 00:00 2026-02-17T20:51:49.880 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:51:49.880 INFO:teuthology.orchestra.run.trial153.stdout:Total 107 MB/s | 88 MB 00:00 2026-02-17T20:51:50.004 INFO:teuthology.orchestra.run.trial104.stdout:Transaction check succeeded. 2026-02-17T20:51:50.005 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction test 2026-02-17T20:51:50.070 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T20:51:50.277 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T20:51:50.278 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T20:51:50.351 INFO:teuthology.orchestra.run.trial104.stdout:Transaction test succeeded. 2026-02-17T20:51:50.352 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction 2026-02-17T20:51:50.629 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T20:51:50.629 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T20:51:51.446 INFO:teuthology.orchestra.run.trial104.stdout: Preparing : 1/1 2026-02-17T20:51:51.721 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T20:51:51.727 INFO:teuthology.orchestra.run.trial104.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T20:51:51.746 INFO:teuthology.orchestra.run.trial104.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:51:52.001 INFO:teuthology.orchestra.run.trial153.stdout: Installing : kernel-modules-core-5.14.0-681.el9.x86_64 1/4 2026-02-17T20:51:52.020 INFO:teuthology.orchestra.run.trial153.stdout: Installing : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:51:53.525 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:51:53.552 INFO:teuthology.orchestra.run.trial104.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:51:53.803 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:51:53.832 INFO:teuthology.orchestra.run.trial153.stdout: Installing : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:51:56.588 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:51:56.593 INFO:teuthology.orchestra.run.trial104.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:51:56.854 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:51:56.860 INFO:teuthology.orchestra.run.trial153.stdout: Installing : kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:51:59.638 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:51:59.895 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:52:29.999 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:52:30.020 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:52:30.085 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:52:30.085 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T20:52:30.085 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:52:30.085 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:52:30.138 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:52:30.138 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:52:30.138 INFO:teuthology.orchestra.run.trial104.stdout:Installed: 2026-02-17T20:52:30.138 INFO:teuthology.orchestra.run.trial104.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T20:52:30.138 INFO:teuthology.orchestra.run.trial104.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T20:52:30.139 INFO:teuthology.orchestra.run.trial104.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T20:52:30.139 INFO:teuthology.orchestra.run.trial104.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T20:52:30.139 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:52:30.139 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:52:30.198 DEBUG:teuthology.orchestra.run.trial104:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T20:52:30.222 INFO:teuthology.orchestra.run.trial104.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T20:52:30.224 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T20:52:30.224 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T20:52:30.224 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T20:52:30.224 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T20:52:30.224 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2026-02-17T20:52:30.224 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial104.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T20:52:30.225 DEBUG:teuthology.orchestra.run.trial104:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T20:52:30.287 INFO:teuthology.orchestra.run.trial104.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T20:52:30.288 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T20:52:30.288 DEBUG:teuthology.orchestra.run.trial104:> sudo rpm -qi grub2-tools 2026-02-17T20:52:30.357 INFO:teuthology.orchestra.run.trial104.stdout:Name : grub2-tools 2026-02-17T20:52:30.357 INFO:teuthology.orchestra.run.trial104.stdout:Epoch : 1 2026-02-17T20:52:30.357 INFO:teuthology.orchestra.run.trial104.stdout:Version : 2.06 2026-02-17T20:52:30.357 INFO:teuthology.orchestra.run.trial104.stdout:Release : 118.el9 2026-02-17T20:52:30.357 INFO:teuthology.orchestra.run.trial104.stdout:Architecture: x86_64 2026-02-17T20:52:30.357 INFO:teuthology.orchestra.run.trial104.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T20:52:30.358 INFO:teuthology.orchestra.run.trial104.stdout:Group : Unspecified 2026-02-17T20:52:30.358 INFO:teuthology.orchestra.run.trial104.stdout:Size : 8393909 2026-02-17T20:52:30.358 INFO:teuthology.orchestra.run.trial104.stdout:License : GPLv3+ 2026-02-17T20:52:30.358 INFO:teuthology.orchestra.run.trial104.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T20:52:30.358 INFO:teuthology.orchestra.run.trial104.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T20:52:30.358 INFO:teuthology.orchestra.run.trial104.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T20:52:30.358 INFO:teuthology.orchestra.run.trial104.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T20:52:30.358 INFO:teuthology.orchestra.run.trial104.stdout:Packager : builder@centos.org 2026-02-17T20:52:30.358 INFO:teuthology.orchestra.run.trial104.stdout:Vendor : CentOS 2026-02-17T20:52:30.358 INFO:teuthology.orchestra.run.trial104.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T20:52:30.358 INFO:teuthology.orchestra.run.trial104.stdout:Summary : Support tools for GRUB. 2026-02-17T20:52:30.358 INFO:teuthology.orchestra.run.trial104.stdout:Description : 2026-02-17T20:52:30.358 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:52:30.359 INFO:teuthology.orchestra.run.trial104.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T20:52:30.359 INFO:teuthology.orchestra.run.trial104.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T20:52:30.359 INFO:teuthology.orchestra.run.trial104.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T20:52:30.359 INFO:teuthology.orchestra.run.trial104.stdout:hardware devices. 2026-02-17T20:52:30.359 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:52:30.359 INFO:teuthology.orchestra.run.trial104.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T20:52:30.360 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T20:52:30.361 INFO:teuthology.task.kernel:Updating grub on trial104 to boot 5.14.0-681.el9.x86_64 2026-02-17T20:52:30.361 DEBUG:teuthology.orchestra.run.trial104:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T20:52:30.425 INFO:teuthology.orchestra.run.trial104.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T20:52:30.427 DEBUG:teuthology.orchestra.run.trial104:> sudo command -v grubby && echo yes || echo no 2026-02-17T20:52:30.471 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: kernel-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:52:30.491 INFO:teuthology.orchestra.run.trial104.stdout:/sbin/grubby 2026-02-17T20:52:30.493 INFO:teuthology.orchestra.run.trial104.stdout:yes 2026-02-17T20:52:30.493 DEBUG:teuthology.orchestra.run.trial104:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T20:52:30.494 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: kernel-modules-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:52:30.556 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: kernel-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:52:30.556 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : kernel-5.14.0-681.el9.x86_64 1/4 2026-02-17T20:52:30.556 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : kernel-core-5.14.0-681.el9.x86_64 2/4 2026-02-17T20:52:30.556 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : kernel-modules-5.14.0-681.el9.x86_64 3/4 2026-02-17T20:52:30.557 INFO:teuthology.orchestra.run.trial104.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T20:52:30.557 DEBUG:teuthology.orchestra.run.trial104:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T20:52:30.608 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : kernel-modules-core-5.14.0-681.el9.x86_64 4/4 2026-02-17T20:52:30.608 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:52:30.608 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T20:52:30.608 INFO:teuthology.orchestra.run.trial153.stdout: kernel-5.14.0-681.el9.x86_64 2026-02-17T20:52:30.608 INFO:teuthology.orchestra.run.trial153.stdout: kernel-core-5.14.0-681.el9.x86_64 2026-02-17T20:52:30.608 INFO:teuthology.orchestra.run.trial153.stdout: kernel-modules-5.14.0-681.el9.x86_64 2026-02-17T20:52:30.608 INFO:teuthology.orchestra.run.trial153.stdout: kernel-modules-core-5.14.0-681.el9.x86_64 2026-02-17T20:52:30.608 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:52:30.609 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:52:30.631 DEBUG:teuthology.orchestra.run.trial104:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T20:52:30.664 DEBUG:teuthology.orchestra.run.trial153:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T20:52:30.690 INFO:teuthology.orchestra.run.trial153.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T20:52:30.691 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T20:52:30.692 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-681.el9.x86_64 2026-02-17T20:52:30.692 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-17T20:52:30.692 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-17T20:52:30.692 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2026-02-17T20:52:30.692 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial153.front.sepia.ceph.com, path=None, version=distro) 2026-02-17T20:52:30.692 DEBUG:teuthology.orchestra.run.trial153:> rpm -q kernel | sort -rV | head -n 1 2026-02-17T20:52:30.755 INFO:teuthology.orchestra.run.trial153.stdout:kernel-5.14.0-681.el9.x86_64 2026-02-17T20:52:30.756 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-681.el9.x86_64 2026-02-17T20:52:30.756 DEBUG:teuthology.orchestra.run.trial153:> sudo rpm -qi grub2-tools 2026-02-17T20:52:30.826 INFO:teuthology.orchestra.run.trial153.stdout:Name : grub2-tools 2026-02-17T20:52:30.827 INFO:teuthology.orchestra.run.trial153.stdout:Epoch : 1 2026-02-17T20:52:30.827 INFO:teuthology.orchestra.run.trial153.stdout:Version : 2.06 2026-02-17T20:52:30.827 INFO:teuthology.orchestra.run.trial153.stdout:Release : 118.el9 2026-02-17T20:52:30.827 INFO:teuthology.orchestra.run.trial153.stdout:Architecture: x86_64 2026-02-17T20:52:30.827 INFO:teuthology.orchestra.run.trial153.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-17T20:52:30.827 INFO:teuthology.orchestra.run.trial153.stdout:Group : Unspecified 2026-02-17T20:52:30.827 INFO:teuthology.orchestra.run.trial153.stdout:Size : 8393909 2026-02-17T20:52:30.827 INFO:teuthology.orchestra.run.trial153.stdout:License : GPLv3+ 2026-02-17T20:52:30.827 INFO:teuthology.orchestra.run.trial153.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-17T20:52:30.827 INFO:teuthology.orchestra.run.trial153.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-17T20:52:30.827 INFO:teuthology.orchestra.run.trial153.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-17T20:52:30.828 INFO:teuthology.orchestra.run.trial153.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-17T20:52:30.828 INFO:teuthology.orchestra.run.trial153.stdout:Packager : builder@centos.org 2026-02-17T20:52:30.828 INFO:teuthology.orchestra.run.trial153.stdout:Vendor : CentOS 2026-02-17T20:52:30.828 INFO:teuthology.orchestra.run.trial153.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-17T20:52:30.828 INFO:teuthology.orchestra.run.trial153.stdout:Summary : Support tools for GRUB. 2026-02-17T20:52:30.828 INFO:teuthology.orchestra.run.trial153.stdout:Description : 2026-02-17T20:52:30.828 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:52:30.828 INFO:teuthology.orchestra.run.trial153.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-17T20:52:30.828 INFO:teuthology.orchestra.run.trial153.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-17T20:52:30.828 INFO:teuthology.orchestra.run.trial153.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-17T20:52:30.828 INFO:teuthology.orchestra.run.trial153.stdout:hardware devices. 2026-02-17T20:52:30.828 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:52:30.829 INFO:teuthology.orchestra.run.trial153.stdout:This subpackage provides tools for support of all platforms. 2026-02-17T20:52:30.830 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-17T20:52:30.830 INFO:teuthology.task.kernel:Updating grub on trial153 to boot 5.14.0-681.el9.x86_64 2026-02-17T20:52:30.830 DEBUG:teuthology.orchestra.run.trial153:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-17T20:52:30.840 INFO:teuthology.orchestra.run.trial104.stderr:Generating grub configuration file ... 2026-02-17T20:52:30.895 INFO:teuthology.orchestra.run.trial153.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T20:52:30.896 DEBUG:teuthology.orchestra.run.trial153:> sudo command -v grubby && echo yes || echo no 2026-02-17T20:52:30.903 INFO:teuthology.orchestra.run.trial104.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T20:52:30.910 INFO:teuthology.orchestra.run.trial104.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T20:52:30.960 INFO:teuthology.orchestra.run.trial153.stdout:/sbin/grubby 2026-02-17T20:52:30.961 INFO:teuthology.orchestra.run.trial153.stdout:yes 2026-02-17T20:52:30.961 DEBUG:teuthology.orchestra.run.trial153:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-681.el9.x86_64" | head -n 1 2026-02-17T20:52:31.024 INFO:teuthology.orchestra.run.trial153.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64.conf 2026-02-17T20:52:31.025 DEBUG:teuthology.orchestra.run.trial153:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-681.el9.x86_64 2026-02-17T20:52:31.098 DEBUG:teuthology.orchestra.run.trial153:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-17T20:52:31.159 INFO:teuthology.orchestra.run.trial104.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T20:52:31.165 INFO:teuthology.orchestra.run.trial104.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T20:52:31.197 INFO:teuthology.orchestra.run.trial104.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T20:52:31.204 INFO:teuthology.orchestra.run.trial104.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T20:52:31.227 INFO:teuthology.orchestra.run.trial104.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T20:52:31.233 INFO:teuthology.orchestra.run.trial104.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T20:52:31.306 INFO:teuthology.orchestra.run.trial153.stderr:Generating grub configuration file ... 2026-02-17T20:52:31.315 INFO:teuthology.orchestra.run.trial104.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T20:52:31.323 INFO:teuthology.orchestra.run.trial104.stderr:done 2026-02-17T20:52:31.325 DEBUG:teuthology.orchestra.run.trial104:> test -d /sys/firmware/efi 2026-02-17T20:52:31.341 DEBUG:teuthology.orchestra.run.trial104:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T20:52:31.370 INFO:teuthology.orchestra.run.trial153.stderr:Found linux image: /boot/vmlinuz-5.14.0-681.el9.x86_64 2026-02-17T20:52:31.376 INFO:teuthology.orchestra.run.trial153.stderr:Found initrd image: /boot/initramfs-5.14.0-681.el9.x86_64.img 2026-02-17T20:52:31.406 INFO:teuthology.orchestra.run.trial104.stdout:/boot/efi/EFI/BOOT 2026-02-17T20:52:31.406 INFO:teuthology.orchestra.run.trial104.stdout:/boot/efi/EFI/centos 2026-02-17T20:52:31.407 DEBUG:teuthology.orchestra.run.trial104:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T20:52:31.473 INFO:teuthology.orchestra.run.trial104.stdout:no 2026-02-17T20:52:31.474 DEBUG:teuthology.orchestra.run.trial104:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T20:52:31.538 INFO:teuthology.orchestra.run.trial104.stdout:yes 2026-02-17T20:52:31.539 DEBUG:teuthology.orchestra.run.trial104:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T20:52:31.603 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial104 2026-02-17T20:52:31.603 DEBUG:teuthology.orchestra.run.trial104:> sudo bash -c ' 2026-02-17T20:52:31.603 DEBUG:teuthology.orchestra.run.trial104:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T20:52:31.603 DEBUG:teuthology.orchestra.run.trial104:> ' 2026-02-17T20:52:31.628 INFO:teuthology.orchestra.run.trial153.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-17T20:52:31.634 INFO:teuthology.orchestra.run.trial153.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-17T20:52:31.666 INFO:teuthology.orchestra.run.trial153.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-17T20:52:31.672 INFO:teuthology.orchestra.run.trial153.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-17T20:52:31.695 INFO:teuthology.orchestra.run.trial153.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-17T20:52:31.702 INFO:teuthology.orchestra.run.trial153.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-17T20:52:31.784 INFO:teuthology.orchestra.run.trial153.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-17T20:52:31.793 INFO:teuthology.orchestra.run.trial153.stderr:done 2026-02-17T20:52:31.795 DEBUG:teuthology.orchestra.run.trial153:> test -d /sys/firmware/efi 2026-02-17T20:52:31.811 DEBUG:teuthology.orchestra.run.trial153:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-17T20:52:31.877 INFO:teuthology.orchestra.run.trial153.stdout:/boot/efi/EFI/BOOT 2026-02-17T20:52:31.877 INFO:teuthology.orchestra.run.trial153.stdout:/boot/efi/EFI/centos 2026-02-17T20:52:31.879 DEBUG:teuthology.orchestra.run.trial153:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-17T20:52:31.944 INFO:teuthology.orchestra.run.trial153.stdout:no 2026-02-17T20:52:31.944 DEBUG:teuthology.orchestra.run.trial153:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-17T20:52:32.007 INFO:teuthology.orchestra.run.trial153.stdout:yes 2026-02-17T20:52:32.008 DEBUG:teuthology.orchestra.run.trial153:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-17T20:52:32.071 INFO:teuthology.orchestra.remote:Triggering safe hard reboot via SysRq on trial153 2026-02-17T20:52:32.071 DEBUG:teuthology.orchestra.run.trial153:> sudo bash -c ' 2026-02-17T20:52:32.071 DEBUG:teuthology.orchestra.run.trial153:> echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger 2026-02-17T20:52:32.071 DEBUG:teuthology.orchestra.run.trial153:> ' 2026-02-17T20:53:01.646 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2026-02-17T20:53:01.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-17T20:53:01.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:53:02.113 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2026-02-17T20:53:02.114 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial153.front.sepia.ceph.com' 2026-02-17T20:53:02.115 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:53:12.384 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.153 2026-02-17T20:53:15.904 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 10.20.193.104 2026-02-17T20:53:21.390 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial153.front.sepia.ceph.com' 2026-02-17T20:53:21.391 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:53:24.907 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-17T20:53:24.908 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:53:57.395 DEBUG:teuthology.orchestra.run.trial153:> true 2026-02-17T20:53:57.659 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial153.front.sepia.ceph.com' 2026-02-17T20:53:57.659 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-681.el9.x86_64"... 2026-02-17T20:53:57.659 DEBUG:teuthology.orchestra.run.trial153:> uname -r 2026-02-17T20:53:57.715 INFO:teuthology.orchestra.run.trial153.stdout:5.14.0-681.el9.x86_64 2026-02-17T20:53:57.715 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T20:53:57.715 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T20:53:57.715 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T20:53:58.716 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2026-02-17T20:53:58.717 DEBUG:teuthology.orchestra.run.trial153:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T20:53:58.749 INFO:teuthology.orchestra.run.trial153.stdout:ttyS1 2026-02-17T20:53:58.769 DEBUG:teuthology.parallel:result is None 2026-02-17T20:54:00.966 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-17T20:54:01.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-17T20:54:01.140 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-681.el9.x86_64"... 2026-02-17T20:54:01.141 DEBUG:teuthology.orchestra.run.trial104:> uname -r 2026-02-17T20:54:01.196 INFO:teuthology.orchestra.run.trial104.stdout:5.14.0-681.el9.x86_64 2026-02-17T20:54:01.196 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-681.el9.x86_64 vs 5.14.0-681.el9.x86_64 2026-02-17T20:54:01.196 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-17T20:54:01.196 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-17T20:54:02.198 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2026-02-17T20:54:02.198 DEBUG:teuthology.orchestra.run.trial104:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-17T20:54:02.229 INFO:teuthology.orchestra.run.trial104.stdout:ttyS1 2026-02-17T20:54:02.254 DEBUG:teuthology.parallel:result is None 2026-02-17T20:54:02.254 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-17T20:54:02.266 INFO:teuthology.task.internal:Creating test directory... 2026-02-17T20:54:02.266 DEBUG:teuthology.orchestra.run.trial104:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T20:54:02.296 DEBUG:teuthology.orchestra.run.trial153:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-17T20:54:02.315 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-17T20:54:02.326 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-17T20:54:02.339 INFO:teuthology.task.internal:Creating archive directory... 2026-02-17T20:54:02.340 DEBUG:teuthology.orchestra.run.trial104:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T20:54:02.353 DEBUG:teuthology.orchestra.run.trial153:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-17T20:54:02.379 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-17T20:54:02.398 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-17T20:54:02.399 DEBUG:teuthology.orchestra.run.trial104:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T20:54:02.412 DEBUG:teuthology.orchestra.run.trial153:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-17T20:54:02.433 INFO:teuthology.orchestra.run.trial104.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T20:54:02.440 INFO:teuthology.orchestra.run.trial153.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T20:54:02.442 INFO:teuthology.orchestra.run.trial104.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T20:54:02.449 INFO:teuthology.orchestra.run.trial153.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-17T20:54:02.450 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-17T20:54:02.467 INFO:teuthology.task.internal:Configuring sudo... 2026-02-17T20:54:02.467 DEBUG:teuthology.orchestra.run.trial104:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T20:54:02.485 DEBUG:teuthology.orchestra.run.trial153:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-17T20:54:02.514 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-17T20:54:02.526 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-17T20:54:02.526 DEBUG:teuthology.orchestra.run.trial104:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T20:54:02.547 DEBUG:teuthology.orchestra.run.trial153:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-17T20:54:02.570 DEBUG:teuthology.orchestra.run.trial104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T20:54:02.673 DEBUG:teuthology.orchestra.run.trial104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T20:54:02.698 DEBUG:teuthology.orchestra.run.trial104:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T20:54:02.818 DEBUG:teuthology.orchestra.run.trial104:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T20:54:02.841 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:54:02.841 DEBUG:teuthology.orchestra.run.trial104:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T20:54:02.904 DEBUG:teuthology.orchestra.run.trial153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T20:54:03.012 DEBUG:teuthology.orchestra.run.trial153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T20:54:03.037 DEBUG:teuthology.orchestra.run.trial153:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T20:54:03.183 DEBUG:teuthology.orchestra.run.trial153:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T20:54:03.207 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T20:54:03.207 DEBUG:teuthology.orchestra.run.trial153:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-17T20:54:03.271 DEBUG:teuthology.orchestra.run.trial104:> sudo service rsyslog restart 2026-02-17T20:54:03.273 DEBUG:teuthology.orchestra.run.trial153:> sudo service rsyslog restart 2026-02-17T20:54:03.300 INFO:teuthology.orchestra.run.trial104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T20:54:03.338 INFO:teuthology.orchestra.run.trial153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T20:54:03.801 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-17T20:54:03.814 INFO:teuthology.task.internal:Starting timer... 2026-02-17T20:54:03.814 INFO:teuthology.run_tasks:Running task pcp... 2026-02-17T20:54:03.835 INFO:teuthology.run_tasks:Running task selinux... 2026-02-17T20:54:03.853 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-17T20:54:03.854 DEBUG:teuthology.orchestra.run.trial104:> sudo service auditd rotate 2026-02-17T20:54:03.884 INFO:teuthology.orchestra.run.trial104.stdout:Rotating logs: 2026-02-17T20:54:03.886 DEBUG:teuthology.orchestra.run.trial153:> sudo service auditd rotate 2026-02-17T20:54:03.915 INFO:teuthology.orchestra.run.trial153.stdout:Rotating logs: 2026-02-17T20:54:03.916 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-17T20:54:03.917 DEBUG:teuthology.orchestra.run.trial104:> /usr/sbin/getenforce 2026-02-17T20:54:03.942 INFO:teuthology.orchestra.run.trial104.stdout:Permissive 2026-02-17T20:54:03.942 DEBUG:teuthology.orchestra.run.trial153:> /usr/sbin/getenforce 2026-02-17T20:54:03.972 INFO:teuthology.orchestra.run.trial153.stdout:Permissive 2026-02-17T20:54:03.973 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial104.front.sepia.ceph.com': 'permissive', 'ubuntu@trial153.front.sepia.ceph.com': 'permissive'} 2026-02-17T20:54:03.973 DEBUG:teuthology.orchestra.run.trial104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T20:54:04.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:54:04.007 DEBUG:teuthology.orchestra.run.trial153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T20:54:04.036 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:54:04.037 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-17T20:54:04.037 DEBUG:teuthology.orchestra.run.trial104:> sudo /usr/sbin/setenforce permissive 2026-02-17T20:54:04.071 DEBUG:teuthology.orchestra.run.trial153:> sudo /usr/sbin/setenforce permissive 2026-02-17T20:54:04.100 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-17T20:54:04.116 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-17T20:54:04.119 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-17T20:54:04.242 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-17T20:54:04.253 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-17T20:54:04.254 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial104.front.sepia.ceph.com,trial153.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-17T20:55:17.189 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial104.front.sepia.ceph.com'), Remote(name='ubuntu@trial153.front.sepia.ceph.com')] 2026-02-17T20:55:17.191 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-17T20:55:17.192 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial104.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:55:17.301 DEBUG:teuthology.orchestra.run.trial104:> true 2026-02-17T20:55:17.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial104.front.sepia.ceph.com' 2026-02-17T20:55:17.376 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial153.front.sepia.ceph.com' 2026-02-17T20:55:17.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial153.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-17T20:55:17.469 DEBUG:teuthology.orchestra.run.trial153:> true 2026-02-17T20:55:17.544 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial153.front.sepia.ceph.com' 2026-02-17T20:55:17.544 INFO:teuthology.run_tasks:Running task clock... 2026-02-17T20:55:17.553 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-17T20:55:17.553 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T20:55:17.554 DEBUG:teuthology.orchestra.run.trial104:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T20:55:17.556 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-17T20:55:17.556 DEBUG:teuthology.orchestra.run.trial153:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T20:55:17.582 INFO:teuthology.orchestra.run.trial104.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T20:55:17.594 INFO:teuthology.orchestra.run.trial104.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T20:55:17.611 INFO:teuthology.orchestra.run.trial153.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-17T20:55:17.614 INFO:teuthology.orchestra.run.trial104.stderr:sudo: ntpd: command not found 2026-02-17T20:55:17.622 INFO:teuthology.orchestra.run.trial153.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-17T20:55:17.624 INFO:teuthology.orchestra.run.trial104.stdout:506 Cannot talk to daemon 2026-02-17T20:55:17.635 INFO:teuthology.orchestra.run.trial104.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T20:55:17.643 INFO:teuthology.orchestra.run.trial153.stderr:sudo: ntpd: command not found 2026-02-17T20:55:17.646 INFO:teuthology.orchestra.run.trial104.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T20:55:17.653 INFO:teuthology.orchestra.run.trial153.stdout:506 Cannot talk to daemon 2026-02-17T20:55:17.665 INFO:teuthology.orchestra.run.trial153.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-17T20:55:17.676 INFO:teuthology.orchestra.run.trial153.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-17T20:55:17.691 INFO:teuthology.orchestra.run.trial104.stderr:bash: line 1: ntpq: command not found 2026-02-17T20:55:17.693 INFO:teuthology.orchestra.run.trial104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T20:55:17.693 INFO:teuthology.orchestra.run.trial104.stdout:=============================================================================== 2026-02-17T20:55:17.724 INFO:teuthology.orchestra.run.trial153.stderr:bash: line 1: ntpq: command not found 2026-02-17T20:55:17.747 INFO:teuthology.orchestra.run.trial153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T20:55:17.747 INFO:teuthology.orchestra.run.trial153.stdout:=============================================================================== 2026-02-17T20:55:17.747 INFO:teuthology.orchestra.run.trial153.stdout:^? mailhost.netads.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:55:17.747 INFO:teuthology.orchestra.run.trial153.stdout:^? jane.qotw.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:55:17.747 INFO:teuthology.orchestra.run.trial153.stdout:^? 172-234-37-140.ip.linode> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:55:17.747 INFO:teuthology.orchestra.run.trial153.stdout:^? blotch.image1tech.net 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-17T20:55:17.748 INFO:teuthology.run_tasks:Running task install... 2026-02-17T20:55:17.762 DEBUG:teuthology.task.install:project ceph 2026-02-17T20:55:17.762 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '76b494d6529326129dc43abf3fffd48fbf35c395'}} 2026-02-17T20:55:17.763 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '76b494d6529326129dc43abf3fffd48fbf35c395'} 2026-02-17T20:55:17.763 INFO:teuthology.task.install:Using flavor: default 2026-02-17T20:55:17.771 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-17T20:55:17.771 INFO:teuthology.task.install:extra packages: [] 2026-02-17T20:55:17.772 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '76b494d6529326129dc43abf3fffd48fbf35c395', 'tag': None, 'wait_for_package': False} 2026-02-17T20:55:17.772 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=76b494d6529326129dc43abf3fffd48fbf35c395 2026-02-17T20:55:17.775 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '76b494d6529326129dc43abf3fffd48fbf35c395', 'tag': None, 'wait_for_package': False} 2026-02-17T20:55:17.775 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=76b494d6529326129dc43abf3fffd48fbf35c395 2026-02-17T20:55:17.978 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260217.024944-squid/76b494d6529326129dc43abf3fffd48fbf35c395/centos/9/flavors/default/ 2026-02-17T20:55:17.978 INFO:teuthology.task.install.rpm:Package version is 19.2.3-683.g76b494d6 2026-02-17T20:55:17.988 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260217.024944-squid/76b494d6529326129dc43abf3fffd48fbf35c395/centos/9/flavors/default/ 2026-02-17T20:55:17.988 INFO:teuthology.task.install.rpm:Package version is 19.2.3-683.g76b494d6 2026-02-17T20:55:18.179 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260217.024944-squid/76b494d6529326129dc43abf3fffd48fbf35c395/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260217.024944-squid/76b494d6529326129dc43abf3fffd48fbf35c395/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260217.024944-squid/76b494d6529326129dc43abf3fffd48fbf35c395/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T20:55:18.179 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:55:18.179 DEBUG:teuthology.orchestra.run.trial104:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T20:55:18.205 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260217.024944-squid/76b494d6529326129dc43abf3fffd48fbf35c395/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260217.024944-squid/76b494d6529326129dc43abf3fffd48fbf35c395/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260217.024944-squid/76b494d6529326129dc43abf3fffd48fbf35c395/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-17T20:55:18.205 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T20:55:18.205 DEBUG:teuthology.orchestra.run.trial153:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-17T20:55:18.206 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T20:55:18.206 DEBUG:teuthology.orchestra.run.trial104:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/76b494d6529326129dc43abf3fffd48fbf35c395/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T20:55:18.232 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-17T20:55:18.232 DEBUG:teuthology.orchestra.run.trial153:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/76b494d6529326129dc43abf3fffd48fbf35c395/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-17T20:55:18.271 DEBUG:teuthology.orchestra.run.trial104:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T20:55:18.299 DEBUG:teuthology.orchestra.run.trial153:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-17T20:55:18.346 DEBUG:teuthology.orchestra.run.trial104:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T20:55:18.373 DEBUG:teuthology.orchestra.run.trial153:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-17T20:55:18.410 INFO:teuthology.orchestra.run.trial104.stdout:check_obsoletes = 1 2026-02-17T20:55:18.412 DEBUG:teuthology.orchestra.run.trial104:> sudo yum clean all 2026-02-17T20:55:18.436 INFO:teuthology.orchestra.run.trial153.stdout:check_obsoletes = 1 2026-02-17T20:55:18.438 DEBUG:teuthology.orchestra.run.trial153:> sudo yum clean all 2026-02-17T20:55:18.558 INFO:teuthology.orchestra.run.trial104.stdout:41 files removed 2026-02-17T20:55:18.572 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install ceph-radosgw 2026-02-17T20:55:18.587 INFO:teuthology.orchestra.run.trial153.stdout:41 files removed 2026-02-17T20:55:18.601 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-radosgw 2026-02-17T20:55:19.042 INFO:teuthology.orchestra.run.trial104.stdout:ceph packages for x86_64 264 kB/s | 86 kB 00:00 2026-02-17T20:55:19.084 INFO:teuthology.orchestra.run.trial153.stdout:ceph packages for x86_64 252 kB/s | 86 kB 00:00 2026-02-17T20:55:19.401 INFO:teuthology.orchestra.run.trial104.stdout:ceph noarch packages 36 kB/s | 12 kB 00:00 2026-02-17T20:55:19.451 INFO:teuthology.orchestra.run.trial153.stdout:ceph noarch packages 35 kB/s | 12 kB 00:00 2026-02-17T20:55:19.774 INFO:teuthology.orchestra.run.trial104.stdout:ceph source packages 5.4 kB/s | 1.9 kB 00:00 2026-02-17T20:55:19.836 INFO:teuthology.orchestra.run.trial153.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2026-02-17T20:55:20.502 INFO:teuthology.orchestra.run.trial104.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-17T20:55:20.752 INFO:teuthology.orchestra.run.trial153.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.9 MB 00:00 2026-02-17T20:55:23.825 INFO:teuthology.orchestra.run.trial153.stdout:CentOS Stream 9 - AppStream 11 MB/s | 27 MB 00:02 2026-02-17T20:55:23.861 INFO:teuthology.orchestra.run.trial104.stdout:CentOS Stream 9 - AppStream 9.5 MB/s | 27 MB 00:02 2026-02-17T20:55:27.074 INFO:teuthology.orchestra.run.trial153.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 7.8 MB 00:00 2026-02-17T20:55:27.347 INFO:teuthology.orchestra.run.trial104.stdout:CentOS Stream 9 - CRB 6.9 MB/s | 7.8 MB 00:01 2026-02-17T20:55:28.161 INFO:teuthology.orchestra.run.trial153.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 20 kB 00:00 2026-02-17T20:55:28.512 INFO:teuthology.orchestra.run.trial104.stdout:CentOS Stream 9 - Extras packages 46 kB/s | 20 kB 00:00 2026-02-17T20:55:29.097 INFO:teuthology.orchestra.run.trial104.stdout:Extra Packages for Enterprise Linux 39 MB/s | 20 MB 00:00 2026-02-17T20:55:29.209 INFO:teuthology.orchestra.run.trial153.stdout:Extra Packages for Enterprise Linux 21 MB/s | 20 MB 00:00 2026-02-17T20:55:32.326 INFO:teuthology.orchestra.run.trial104.stdout:lab-extras 1.3 MB/s | 50 kB 00:00 2026-02-17T20:55:32.415 INFO:teuthology.orchestra.run.trial153.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-17T20:55:33.533 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:55:33.534 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:55:33.534 INFO:teuthology.orchestra.run.trial104.stdout: Package Arch Version Repository Size 2026-02-17T20:55:33.534 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:55:33.534 INFO:teuthology.orchestra.run.trial104.stdout:Installing: 2026-02-17T20:55:33.535 INFO:teuthology.orchestra.run.trial104.stdout: ceph-radosgw x86_64 2:19.2.3-683.g76b494d6.el9 ceph 11 M 2026-02-17T20:55:33.535 INFO:teuthology.orchestra.run.trial104.stdout:Upgrading: 2026-02-17T20:55:33.535 INFO:teuthology.orchestra.run.trial104.stdout: librados2 x86_64 2:19.2.3-683.g76b494d6.el9 ceph 3.4 M 2026-02-17T20:55:33.535 INFO:teuthology.orchestra.run.trial104.stdout: librbd1 x86_64 2:19.2.3-683.g76b494d6.el9 ceph 3.2 M 2026-02-17T20:55:33.535 INFO:teuthology.orchestra.run.trial104.stdout:Installing dependencies: 2026-02-17T20:55:33.535 INFO:teuthology.orchestra.run.trial104.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T20:55:33.535 INFO:teuthology.orchestra.run.trial104.stdout: ceph-base x86_64 2:19.2.3-683.g76b494d6.el9 ceph 5.5 M 2026-02-17T20:55:33.535 INFO:teuthology.orchestra.run.trial104.stdout: ceph-common x86_64 2:19.2.3-683.g76b494d6.el9 ceph 22 M 2026-02-17T20:55:33.535 INFO:teuthology.orchestra.run.trial104.stdout: ceph-selinux x86_64 2:19.2.3-683.g76b494d6.el9 ceph 25 k 2026-02-17T20:55:33.535 INFO:teuthology.orchestra.run.trial104.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T20:55:33.535 INFO:teuthology.orchestra.run.trial104.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T20:55:33.535 INFO:teuthology.orchestra.run.trial104.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T20:55:33.536 INFO:teuthology.orchestra.run.trial104.stdout: libcephfs2 x86_64 2:19.2.3-683.g76b494d6.el9 ceph 999 k 2026-02-17T20:55:33.536 INFO:teuthology.orchestra.run.trial104.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T20:55:33.536 INFO:teuthology.orchestra.run.trial104.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T20:55:33.536 INFO:teuthology.orchestra.run.trial104.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T20:55:33.536 INFO:teuthology.orchestra.run.trial104.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T20:55:33.536 INFO:teuthology.orchestra.run.trial104.stdout: libradosstriper1 x86_64 2:19.2.3-683.g76b494d6.el9 ceph 504 k 2026-02-17T20:55:33.536 INFO:teuthology.orchestra.run.trial104.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T20:55:33.536 INFO:teuthology.orchestra.run.trial104.stdout: librgw2 x86_64 2:19.2.3-683.g76b494d6.el9 ceph 5.4 M 2026-02-17T20:55:33.536 INFO:teuthology.orchestra.run.trial104.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T20:55:33.536 INFO:teuthology.orchestra.run.trial104.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T20:55:33.536 INFO:teuthology.orchestra.run.trial104.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T20:55:33.536 INFO:teuthology.orchestra.run.trial104.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T20:55:33.537 INFO:teuthology.orchestra.run.trial104.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T20:55:33.537 INFO:teuthology.orchestra.run.trial104.stdout: python3-ceph-argparse x86_64 2:19.2.3-683.g76b494d6.el9 ceph 45 k 2026-02-17T20:55:33.537 INFO:teuthology.orchestra.run.trial104.stdout: python3-ceph-common x86_64 2:19.2.3-683.g76b494d6.el9 ceph 142 k 2026-02-17T20:55:33.537 INFO:teuthology.orchestra.run.trial104.stdout: python3-cephfs x86_64 2:19.2.3-683.g76b494d6.el9 ceph 168 k 2026-02-17T20:55:33.537 INFO:teuthology.orchestra.run.trial104.stdout: python3-rados x86_64 2:19.2.3-683.g76b494d6.el9 ceph 323 k 2026-02-17T20:55:33.537 INFO:teuthology.orchestra.run.trial104.stdout: python3-rbd x86_64 2:19.2.3-683.g76b494d6.el9 ceph 301 k 2026-02-17T20:55:33.537 INFO:teuthology.orchestra.run.trial104.stdout: python3-rgw x86_64 2:19.2.3-683.g76b494d6.el9 ceph 99 k 2026-02-17T20:55:33.537 INFO:teuthology.orchestra.run.trial104.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T20:55:33.537 INFO:teuthology.orchestra.run.trial104.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T20:55:33.537 INFO:teuthology.orchestra.run.trial104.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T20:55:33.537 INFO:teuthology.orchestra.run.trial104.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T20:55:33.537 INFO:teuthology.orchestra.run.trial104.stdout:Installing weak dependencies: 2026-02-17T20:55:33.538 INFO:teuthology.orchestra.run.trial104.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T20:55:33.538 INFO:teuthology.orchestra.run.trial104.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T20:55:33.538 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:33.538 INFO:teuthology.orchestra.run.trial104.stdout:Transaction Summary 2026-02-17T20:55:33.538 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:55:33.538 INFO:teuthology.orchestra.run.trial104.stdout:Install 33 Packages 2026-02-17T20:55:33.538 INFO:teuthology.orchestra.run.trial104.stdout:Upgrade 2 Packages 2026-02-17T20:55:33.538 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:33.539 INFO:teuthology.orchestra.run.trial104.stdout:Total download size: 63 M 2026-02-17T20:55:33.539 INFO:teuthology.orchestra.run.trial104.stdout:Downloading Packages: 2026-02-17T20:55:33.636 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:55:33.637 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:55:33.637 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repository Size 2026-02-17T20:55:33.638 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:55:33.638 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T20:55:33.638 INFO:teuthology.orchestra.run.trial153.stdout: ceph-radosgw x86_64 2:19.2.3-683.g76b494d6.el9 ceph 11 M 2026-02-17T20:55:33.638 INFO:teuthology.orchestra.run.trial153.stdout:Upgrading: 2026-02-17T20:55:33.638 INFO:teuthology.orchestra.run.trial153.stdout: librados2 x86_64 2:19.2.3-683.g76b494d6.el9 ceph 3.4 M 2026-02-17T20:55:33.638 INFO:teuthology.orchestra.run.trial153.stdout: librbd1 x86_64 2:19.2.3-683.g76b494d6.el9 ceph 3.2 M 2026-02-17T20:55:33.638 INFO:teuthology.orchestra.run.trial153.stdout:Installing dependencies: 2026-02-17T20:55:33.638 INFO:teuthology.orchestra.run.trial153.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-17T20:55:33.638 INFO:teuthology.orchestra.run.trial153.stdout: ceph-base x86_64 2:19.2.3-683.g76b494d6.el9 ceph 5.5 M 2026-02-17T20:55:33.638 INFO:teuthology.orchestra.run.trial153.stdout: ceph-common x86_64 2:19.2.3-683.g76b494d6.el9 ceph 22 M 2026-02-17T20:55:33.639 INFO:teuthology.orchestra.run.trial153.stdout: ceph-selinux x86_64 2:19.2.3-683.g76b494d6.el9 ceph 25 k 2026-02-17T20:55:33.639 INFO:teuthology.orchestra.run.trial153.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-17T20:55:33.639 INFO:teuthology.orchestra.run.trial153.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-17T20:55:33.639 INFO:teuthology.orchestra.run.trial153.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-17T20:55:33.639 INFO:teuthology.orchestra.run.trial153.stdout: libcephfs2 x86_64 2:19.2.3-683.g76b494d6.el9 ceph 999 k 2026-02-17T20:55:33.639 INFO:teuthology.orchestra.run.trial153.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-17T20:55:33.639 INFO:teuthology.orchestra.run.trial153.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-17T20:55:33.639 INFO:teuthology.orchestra.run.trial153.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-17T20:55:33.639 INFO:teuthology.orchestra.run.trial153.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-17T20:55:33.639 INFO:teuthology.orchestra.run.trial153.stdout: libradosstriper1 x86_64 2:19.2.3-683.g76b494d6.el9 ceph 504 k 2026-02-17T20:55:33.639 INFO:teuthology.orchestra.run.trial153.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-17T20:55:33.639 INFO:teuthology.orchestra.run.trial153.stdout: librgw2 x86_64 2:19.2.3-683.g76b494d6.el9 ceph 5.4 M 2026-02-17T20:55:33.639 INFO:teuthology.orchestra.run.trial153.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-17T20:55:33.640 INFO:teuthology.orchestra.run.trial153.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-17T20:55:33.640 INFO:teuthology.orchestra.run.trial153.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-17T20:55:33.640 INFO:teuthology.orchestra.run.trial153.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-17T20:55:33.640 INFO:teuthology.orchestra.run.trial153.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-17T20:55:33.640 INFO:teuthology.orchestra.run.trial153.stdout: python3-ceph-argparse x86_64 2:19.2.3-683.g76b494d6.el9 ceph 45 k 2026-02-17T20:55:33.640 INFO:teuthology.orchestra.run.trial153.stdout: python3-ceph-common x86_64 2:19.2.3-683.g76b494d6.el9 ceph 142 k 2026-02-17T20:55:33.640 INFO:teuthology.orchestra.run.trial153.stdout: python3-cephfs x86_64 2:19.2.3-683.g76b494d6.el9 ceph 168 k 2026-02-17T20:55:33.640 INFO:teuthology.orchestra.run.trial153.stdout: python3-rados x86_64 2:19.2.3-683.g76b494d6.el9 ceph 323 k 2026-02-17T20:55:33.640 INFO:teuthology.orchestra.run.trial153.stdout: python3-rbd x86_64 2:19.2.3-683.g76b494d6.el9 ceph 301 k 2026-02-17T20:55:33.640 INFO:teuthology.orchestra.run.trial153.stdout: python3-rgw x86_64 2:19.2.3-683.g76b494d6.el9 ceph 99 k 2026-02-17T20:55:33.640 INFO:teuthology.orchestra.run.trial153.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-17T20:55:33.640 INFO:teuthology.orchestra.run.trial153.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-17T20:55:33.641 INFO:teuthology.orchestra.run.trial153.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-17T20:55:33.641 INFO:teuthology.orchestra.run.trial153.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-17T20:55:33.641 INFO:teuthology.orchestra.run.trial153.stdout:Installing weak dependencies: 2026-02-17T20:55:33.641 INFO:teuthology.orchestra.run.trial153.stdout: nvme-cli x86_64 2.13-1.el9 baseos 1.1 M 2026-02-17T20:55:33.641 INFO:teuthology.orchestra.run.trial153.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-17T20:55:33.641 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:33.641 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T20:55:33.641 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:55:33.641 INFO:teuthology.orchestra.run.trial153.stdout:Install 33 Packages 2026-02-17T20:55:33.641 INFO:teuthology.orchestra.run.trial153.stdout:Upgrade 2 Packages 2026-02-17T20:55:33.641 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:33.642 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 63 M 2026-02-17T20:55:33.642 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T20:55:34.358 INFO:teuthology.orchestra.run.trial153.stdout:(1/35): ceph-base-19.2.3-683.g76b494d6.el9.x86_ 12 MB/s | 5.5 MB 00:00 2026-02-17T20:55:34.411 INFO:teuthology.orchestra.run.trial153.stdout:(2/35): ceph-selinux-19.2.3-683.g76b494d6.el9.x 472 kB/s | 25 kB 00:00 2026-02-17T20:55:34.567 INFO:teuthology.orchestra.run.trial153.stdout:(3/35): ceph-radosgw-19.2.3-683.g76b494d6.el9.x 16 MB/s | 11 MB 00:00 2026-02-17T20:55:34.603 INFO:teuthology.orchestra.run.trial153.stdout:(4/35): libradosstriper1-19.2.3-683.g76b494d6.e 14 MB/s | 504 kB 00:00 2026-02-17T20:55:34.620 INFO:teuthology.orchestra.run.trial153.stdout:(5/35): libcephfs2-19.2.3-683.g76b494d6.el9.x86 4.7 MB/s | 999 kB 00:00 2026-02-17T20:55:34.664 INFO:teuthology.orchestra.run.trial153.stdout:(6/35): python3-ceph-argparse-19.2.3-683.g76b49 1.0 MB/s | 45 kB 00:00 2026-02-17T20:55:34.711 INFO:teuthology.orchestra.run.trial153.stdout:(7/35): python3-ceph-common-19.2.3-683.g76b494d 3.0 MB/s | 142 kB 00:00 2026-02-17T20:55:34.758 INFO:teuthology.orchestra.run.trial153.stdout:(8/35): python3-cephfs-19.2.3-683.g76b494d6.el9 3.5 MB/s | 168 kB 00:00 2026-02-17T20:55:34.815 INFO:teuthology.orchestra.run.trial153.stdout:(9/35): ceph-common-19.2.3-683.g76b494d6.el9.x8 24 MB/s | 22 MB 00:00 2026-02-17T20:55:34.816 INFO:teuthology.orchestra.run.trial153.stdout:(10/35): python3-rados-19.2.3-683.g76b494d6.el9 5.4 MB/s | 323 kB 00:00 2026-02-17T20:55:34.841 INFO:teuthology.orchestra.run.trial153.stdout:(11/35): librgw2-19.2.3-683.g76b494d6.el9.x86_6 23 MB/s | 5.4 MB 00:00 2026-02-17T20:55:34.841 INFO:teuthology.orchestra.run.trial153.stdout:(12/35): python3-rgw-19.2.3-683.g76b494d6.el9.x 3.9 MB/s | 99 kB 00:00 2026-02-17T20:55:34.842 INFO:teuthology.orchestra.run.trial153.stdout:(13/35): python3-rbd-19.2.3-683.g76b494d6.el9.x 11 MB/s | 301 kB 00:00 2026-02-17T20:55:34.874 INFO:teuthology.orchestra.run.trial153.stdout:(14/35): mailcap-2.1.49-5.el9.noarch.rpm 994 kB/s | 33 kB 00:00 2026-02-17T20:55:34.890 INFO:teuthology.orchestra.run.trial153.stdout:(15/35): pciutils-3.7.0-7.el9.x86_64.rpm 1.9 MB/s | 93 kB 00:00 2026-02-17T20:55:34.920 INFO:teuthology.orchestra.run.trial153.stdout:(16/35): nvme-cli-2.13-1.el9.x86_64.rpm 14 MB/s | 1.1 MB 00:00 2026-02-17T20:55:34.927 INFO:teuthology.orchestra.run.trial153.stdout:(17/35): boost-program-options-1.75.0-13.el9.x8 1.9 MB/s | 104 kB 00:00 2026-02-17T20:55:34.931 INFO:teuthology.orchestra.run.trial153.stdout:(18/35): libnbd-1.20.3-4.el9.x86_64.rpm 4.0 MB/s | 164 kB 00:00 2026-02-17T20:55:34.950 INFO:teuthology.orchestra.run.trial153.stdout:(19/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 5.3 MB/s | 160 kB 00:00 2026-02-17T20:55:34.952 INFO:teuthology.orchestra.run.trial153.stdout:(20/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.8 MB/s | 45 kB 00:00 2026-02-17T20:55:34.968 INFO:teuthology.orchestra.run.trial153.stdout:(21/35): librdkafka-1.6.1-102.el9.x86_64.rpm 17 MB/s | 662 kB 00:00 2026-02-17T20:55:34.978 INFO:teuthology.orchestra.run.trial153.stdout:(22/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 10 MB/s | 292 kB 00:00 2026-02-17T20:55:34.979 INFO:teuthology.orchestra.run.trial153.stdout:(23/35): qatlib-25.08.0-2.el9.x86_64.rpm 8.9 MB/s | 240 kB 00:00 2026-02-17T20:55:34.995 INFO:teuthology.orchestra.run.trial153.stdout:(24/35): qatlib-service-25.08.0-2.el9.x86_64.rp 1.4 MB/s | 37 kB 00:00 2026-02-17T20:55:35.001 INFO:teuthology.orchestra.run.trial153.stdout:(25/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 2.7 MB/s | 66 kB 00:00 2026-02-17T20:55:35.022 INFO:teuthology.orchestra.run.trial153.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 1.2 MB/s | 25 kB 00:00 2026-02-17T20:55:35.039 INFO:teuthology.orchestra.run.trial153.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 2.9 MB/s | 49 kB 00:00 2026-02-17T20:55:35.042 INFO:teuthology.orchestra.run.trial153.stdout:(28/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 4.7 MB/s | 308 kB 00:00 2026-02-17T20:55:35.054 INFO:teuthology.orchestra.run.trial153.stdout:(29/35): libunwind-1.6.2-1.el9.x86_64.rpm 4.6 MB/s | 67 kB 00:00 2026-02-17T20:55:35.082 INFO:teuthology.orchestra.run.trial153.stdout:(30/35): re2-20211101-20.el9.x86_64.rpm 6.8 MB/s | 191 kB 00:00 2026-02-17T20:55:35.100 INFO:teuthology.orchestra.run.trial104.stdout:(1/35): ceph-base-19.2.3-683.g76b494d6.el9.x86_ 4.8 MB/s | 5.5 MB 00:01 2026-02-17T20:55:35.104 INFO:teuthology.orchestra.run.trial153.stdout:(31/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 13 MB/s | 838 kB 00:00 2026-02-17T20:55:35.112 INFO:teuthology.orchestra.run.trial104.stdout:(2/35): ceph-selinux-19.2.3-683.g76b494d6.el9.x 2.1 MB/s | 25 kB 00:00 2026-02-17T20:55:35.206 INFO:teuthology.orchestra.run.trial153.stdout:(32/35): thrift-0.15.0-4.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2026-02-17T20:55:35.206 INFO:teuthology.orchestra.run.trial104.stdout:(3/35): libcephfs2-19.2.3-683.g76b494d6.el9.x86 10 MB/s | 999 kB 00:00 2026-02-17T20:55:35.269 INFO:teuthology.orchestra.run.trial104.stdout:(4/35): ceph-radosgw-19.2.3-683.g76b494d6.el9.x 8.2 MB/s | 11 MB 00:01 2026-02-17T20:55:35.274 INFO:teuthology.orchestra.run.trial153.stdout:(33/35): libarrow-9.0.0-15.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2026-02-17T20:55:35.290 INFO:teuthology.orchestra.run.trial104.stdout:(5/35): libradosstriper1-19.2.3-683.g76b494d6.e 5.9 MB/s | 504 kB 00:00 2026-02-17T20:55:35.305 INFO:teuthology.orchestra.run.trial153.stdout:(34/35): librados2-19.2.3-683.g76b494d6.el9.x86 17 MB/s | 3.4 MB 00:00 2026-02-17T20:55:35.332 INFO:teuthology.orchestra.run.trial104.stdout:(6/35): python3-ceph-argparse-19.2.3-683.g76b49 1.1 MB/s | 45 kB 00:00 2026-02-17T20:55:35.362 INFO:teuthology.orchestra.run.trial104.stdout:(7/35): python3-ceph-common-19.2.3-683.g76b494d 4.5 MB/s | 142 kB 00:00 2026-02-17T20:55:35.363 INFO:teuthology.orchestra.run.trial153.stdout:(35/35): librbd1-19.2.3-683.g76b494d6.el9.x86_6 20 MB/s | 3.2 MB 00:00 2026-02-17T20:55:35.365 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:55:35.366 INFO:teuthology.orchestra.run.trial153.stdout:Total 36 MB/s | 63 MB 00:01 2026-02-17T20:55:35.386 INFO:teuthology.orchestra.run.trial104.stdout:(8/35): python3-cephfs-19.2.3-683.g76b494d6.el9 7.1 MB/s | 168 kB 00:00 2026-02-17T20:55:35.413 INFO:teuthology.orchestra.run.trial104.stdout:(9/35): python3-rados-19.2.3-683.g76b494d6.el9. 12 MB/s | 323 kB 00:00 2026-02-17T20:55:35.440 INFO:teuthology.orchestra.run.trial104.stdout:(10/35): python3-rbd-19.2.3-683.g76b494d6.el9.x 11 MB/s | 301 kB 00:00 2026-02-17T20:55:35.465 INFO:teuthology.orchestra.run.trial104.stdout:(11/35): python3-rgw-19.2.3-683.g76b494d6.el9.x 4.0 MB/s | 99 kB 00:00 2026-02-17T20:55:35.467 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T20:55:35.485 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T20:55:35.485 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T20:55:35.491 INFO:teuthology.orchestra.run.trial104.stdout:(12/35): mailcap-2.1.49-5.el9.noarch.rpm 1.2 MB/s | 33 kB 00:00 2026-02-17T20:55:35.501 INFO:teuthology.orchestra.run.trial104.stdout:(13/35): librgw2-19.2.3-683.g76b494d6.el9.x86_6 23 MB/s | 5.4 MB 00:00 2026-02-17T20:55:35.534 INFO:teuthology.orchestra.run.trial104.stdout:(14/35): nvme-cli-2.13-1.el9.x86_64.rpm 26 MB/s | 1.1 MB 00:00 2026-02-17T20:55:35.536 INFO:teuthology.orchestra.run.trial104.stdout:(15/35): pciutils-3.7.0-7.el9.x86_64.rpm 2.6 MB/s | 93 kB 00:00 2026-02-17T20:55:35.714 INFO:teuthology.orchestra.run.trial104.stdout:(16/35): ceph-common-19.2.3-683.g76b494d6.el9.x 12 MB/s | 22 MB 00:01 2026-02-17T20:55:35.736 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T20:55:35.737 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T20:55:36.026 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T20:55:36.035 INFO:teuthology.orchestra.run.trial153.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T20:55:36.037 INFO:teuthology.orchestra.run.trial153.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T20:55:36.049 INFO:teuthology.orchestra.run.trial153.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T20:55:36.199 INFO:teuthology.orchestra.run.trial153.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T20:55:36.204 INFO:teuthology.orchestra.run.trial153.stdout: Upgrading : librados2-2:19.2.3-683.g76b494d6.el9.x86_64 5/37 2026-02-17T20:55:36.235 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: librados2-2:19.2.3-683.g76b494d6.el9.x86_64 5/37 2026-02-17T20:55:36.277 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-rados-2:19.2.3-683.g76b494d6.el9.x86_64 6/37 2026-02-17T20:55:36.278 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libcephfs2-2:19.2.3-683.g76b494d6.el9.x86_64 7/37 2026-02-17T20:55:36.291 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: libcephfs2-2:19.2.3-683.g76b494d6.el9.x86_64 7/37 2026-02-17T20:55:36.295 INFO:teuthology.orchestra.run.trial153.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T20:55:36.305 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-ceph-argparse-2:19.2.3-683.g76b494d6.el9.x 9/37 2026-02-17T20:55:36.328 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-cephfs-2:19.2.3-683.g76b494d6.el9.x86_64 10/37 2026-02-17T20:55:36.329 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libradosstriper1-2:19.2.3-683.g76b494d6.el9.x86_64 11/37 2026-02-17T20:55:36.342 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: libradosstriper1-2:19.2.3-683.g76b494d6.el9.x86_64 11/37 2026-02-17T20:55:36.356 INFO:teuthology.orchestra.run.trial104.stdout:(17/35): boost-program-options-1.75.0-13.el9.x8 127 kB/s | 104 kB 00:00 2026-02-17T20:55:36.370 INFO:teuthology.orchestra.run.trial104.stdout:(18/35): libpmemobj-1.12.1-1.el9.x86_64.rpm 244 kB/s | 160 kB 00:00 2026-02-17T20:55:36.373 INFO:teuthology.orchestra.run.trial153.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T20:55:36.379 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T20:55:36.385 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T20:55:36.387 INFO:teuthology.orchestra.run.trial153.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T20:55:36.390 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T20:55:36.395 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T20:55:36.439 INFO:teuthology.orchestra.run.trial104.stdout:(19/35): libnbd-1.20.3-4.el9.x86_64.rpm 181 kB/s | 164 kB 00:00 2026-02-17T20:55:36.536 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T20:55:36.537 INFO:teuthology.orchestra.run.trial153.stdout: Upgrading : librbd1-2:19.2.3-683.g76b494d6.el9.x86_64 19/37 2026-02-17T20:55:36.564 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: librbd1-2:19.2.3-683.g76b494d6.el9.x86_64 19/37 2026-02-17T20:55:36.566 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-rbd-2:19.2.3-683.g76b494d6.el9.x86_64 20/37 2026-02-17T20:55:36.573 INFO:teuthology.orchestra.run.trial153.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T20:55:36.611 INFO:teuthology.orchestra.run.trial104.stdout:(20/35): librabbitmq-0.11.0-7.el9.x86_64.rpm 178 kB/s | 45 kB 00:00 2026-02-17T20:55:36.797 INFO:teuthology.orchestra.run.trial153.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T20:55:36.798 INFO:teuthology.orchestra.run.trial153.stdout: Installing : librgw2-2:19.2.3-683.g76b494d6.el9.x86_64 23/37 2026-02-17T20:55:36.816 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: librgw2-2:19.2.3-683.g76b494d6.el9.x86_64 23/37 2026-02-17T20:55:36.820 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-rgw-2:19.2.3-683.g76b494d6.el9.x86_64 24/37 2026-02-17T20:55:36.825 INFO:teuthology.orchestra.run.trial153.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T20:55:36.828 INFO:teuthology.orchestra.run.trial153.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T20:55:36.828 INFO:teuthology.orchestra.run.trial153.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T20:55:36.848 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T20:55:36.961 INFO:teuthology.orchestra.run.trial153.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T20:55:36.964 INFO:teuthology.orchestra.run.trial153.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T20:55:37.177 INFO:teuthology.orchestra.run.trial104.stdout:(21/35): librdkafka-1.6.1-102.el9.x86_64.rpm 821 kB/s | 662 kB 00:00 2026-02-17T20:55:37.238 INFO:teuthology.orchestra.run.trial104.stdout:(22/35): lttng-ust-2.12.0-6.el9.x86_64.rpm 366 kB/s | 292 kB 00:00 2026-02-17T20:55:37.246 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T20:55:37.246 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T20:55:37.246 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:37.277 INFO:teuthology.orchestra.run.trial104.stdout:(23/35): qatlib-service-25.08.0-2.el9.x86_64.rp 373 kB/s | 37 kB 00:00 2026-02-17T20:55:37.282 INFO:teuthology.orchestra.run.trial153.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T20:55:37.284 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-ceph-common-2:19.2.3-683.g76b494d6.el9.x86 31/37 2026-02-17T20:55:37.409 INFO:teuthology.orchestra.run.trial104.stdout:(24/35): qatlib-25.08.0-2.el9.x86_64.rpm 300 kB/s | 240 kB 00:00 2026-02-17T20:55:37.414 INFO:teuthology.orchestra.run.trial104.stdout:(25/35): qatzip-libs-1.3.1-1.el9.x86_64.rpm 376 kB/s | 66 kB 00:00 2026-02-17T20:55:37.699 INFO:teuthology.orchestra.run.trial104.stdout:(26/35): libarrow-doc-9.0.0-15.el9.noarch.rpm 87 kB/s | 25 kB 00:00 2026-02-17T20:55:37.835 INFO:teuthology.orchestra.run.trial104.stdout:(27/35): liboath-2.6.12-1.el9.x86_64.rpm 362 kB/s | 49 kB 00:00 2026-02-17T20:55:37.935 INFO:teuthology.orchestra.run.trial104.stdout:(28/35): libunwind-1.6.2-1.el9.x86_64.rpm 675 kB/s | 67 kB 00:00 2026-02-17T20:55:38.066 INFO:teuthology.orchestra.run.trial104.stdout:(29/35): gperftools-libs-2.9.1-3.el9.x86_64.rpm 390 kB/s | 308 kB 00:00 2026-02-17T20:55:38.176 INFO:teuthology.orchestra.run.trial104.stdout:(30/35): libarrow-9.0.0-15.el9.x86_64.rpm 5.7 MB/s | 4.4 MB 00:00 2026-02-17T20:55:38.232 INFO:teuthology.orchestra.run.trial104.stdout:(31/35): parquet-libs-9.0.0-15.el9.x86_64.rpm 2.8 MB/s | 838 kB 00:00 2026-02-17T20:55:38.242 INFO:teuthology.orchestra.run.trial104.stdout:(32/35): re2-20211101-20.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2026-02-17T20:55:38.262 INFO:teuthology.orchestra.run.trial104.stdout:(33/35): thrift-0.15.0-4.el9.x86_64.rpm 18 MB/s | 1.6 MB 00:00 2026-02-17T20:55:38.266 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-common-2:19.2.3-683.g76b494d6.el9.x86_64 32/37 2026-02-17T20:55:38.268 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-common-2:19.2.3-683.g76b494d6.el9.x86_64 32/37 2026-02-17T20:55:38.552 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-common-2:19.2.3-683.g76b494d6.el9.x86_64 32/37 2026-02-17T20:55:38.555 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-base-2:19.2.3-683.g76b494d6.el9.x86_64 33/37 2026-02-17T20:55:38.597 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-base-2:19.2.3-683.g76b494d6.el9.x86_64 33/37 2026-02-17T20:55:38.597 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T20:55:38.597 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T20:55:38.597 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:38.601 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-selinux-2:19.2.3-683.g76b494d6.el9.x86_64 34/37 2026-02-17T20:55:38.624 INFO:teuthology.orchestra.run.trial104.stdout:(34/35): librados2-19.2.3-683.g76b494d6.el9.x86 8.8 MB/s | 3.4 MB 00:00 2026-02-17T20:55:38.701 INFO:teuthology.orchestra.run.trial104.stdout:(35/35): librbd1-19.2.3-683.g76b494d6.el9.x86_6 6.9 MB/s | 3.2 MB 00:00 2026-02-17T20:55:38.706 INFO:teuthology.orchestra.run.trial104.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:55:38.706 INFO:teuthology.orchestra.run.trial104.stdout:Total 12 MB/s | 63 MB 00:05 2026-02-17T20:55:38.811 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction check 2026-02-17T20:55:38.829 INFO:teuthology.orchestra.run.trial104.stdout:Transaction check succeeded. 2026-02-17T20:55:38.829 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction test 2026-02-17T20:55:39.081 INFO:teuthology.orchestra.run.trial104.stdout:Transaction test succeeded. 2026-02-17T20:55:39.081 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction 2026-02-17T20:55:39.379 INFO:teuthology.orchestra.run.trial104.stdout: Preparing : 1/1 2026-02-17T20:55:39.388 INFO:teuthology.orchestra.run.trial104.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/37 2026-02-17T20:55:39.390 INFO:teuthology.orchestra.run.trial104.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/37 2026-02-17T20:55:39.402 INFO:teuthology.orchestra.run.trial104.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/37 2026-02-17T20:55:39.554 INFO:teuthology.orchestra.run.trial104.stdout: Installing : thrift-0.15.0-4.el9.x86_64 4/37 2026-02-17T20:55:39.557 INFO:teuthology.orchestra.run.trial104.stdout: Upgrading : librados2-2:19.2.3-683.g76b494d6.el9.x86_64 5/37 2026-02-17T20:55:39.586 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: librados2-2:19.2.3-683.g76b494d6.el9.x86_64 5/37 2026-02-17T20:55:39.628 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-rados-2:19.2.3-683.g76b494d6.el9.x86_64 6/37 2026-02-17T20:55:39.629 INFO:teuthology.orchestra.run.trial104.stdout: Installing : libcephfs2-2:19.2.3-683.g76b494d6.el9.x86_64 7/37 2026-02-17T20:55:39.641 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: libcephfs2-2:19.2.3-683.g76b494d6.el9.x86_64 7/37 2026-02-17T20:55:39.646 INFO:teuthology.orchestra.run.trial104.stdout: Installing : liboath-2.6.12-1.el9.x86_64 8/37 2026-02-17T20:55:39.655 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-ceph-argparse-2:19.2.3-683.g76b494d6.el9.x 9/37 2026-02-17T20:55:39.677 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-cephfs-2:19.2.3-683.g76b494d6.el9.x86_64 10/37 2026-02-17T20:55:39.678 INFO:teuthology.orchestra.run.trial104.stdout: Installing : libradosstriper1-2:19.2.3-683.g76b494d6.el9.x86_64 11/37 2026-02-17T20:55:39.691 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: libradosstriper1-2:19.2.3-683.g76b494d6.el9.x86_64 11/37 2026-02-17T20:55:39.729 INFO:teuthology.orchestra.run.trial104.stdout: Installing : re2-1:20211101-20.el9.x86_64 12/37 2026-02-17T20:55:39.733 INFO:teuthology.orchestra.run.trial104.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 13/37 2026-02-17T20:55:39.739 INFO:teuthology.orchestra.run.trial104.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/37 2026-02-17T20:55:39.741 INFO:teuthology.orchestra.run.trial104.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/37 2026-02-17T20:55:39.744 INFO:teuthology.orchestra.run.trial104.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 16/37 2026-02-17T20:55:39.749 INFO:teuthology.orchestra.run.trial104.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/37 2026-02-17T20:55:39.891 INFO:teuthology.orchestra.run.trial104.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T20:55:39.892 INFO:teuthology.orchestra.run.trial104.stdout: Upgrading : librbd1-2:19.2.3-683.g76b494d6.el9.x86_64 19/37 2026-02-17T20:55:39.918 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: librbd1-2:19.2.3-683.g76b494d6.el9.x86_64 19/37 2026-02-17T20:55:39.920 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-rbd-2:19.2.3-683.g76b494d6.el9.x86_64 20/37 2026-02-17T20:55:39.928 INFO:teuthology.orchestra.run.trial104.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/37 2026-02-17T20:55:40.153 INFO:teuthology.orchestra.run.trial104.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/37 2026-02-17T20:55:40.154 INFO:teuthology.orchestra.run.trial104.stdout: Installing : librgw2-2:19.2.3-683.g76b494d6.el9.x86_64 23/37 2026-02-17T20:55:40.170 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: librgw2-2:19.2.3-683.g76b494d6.el9.x86_64 23/37 2026-02-17T20:55:40.174 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-rgw-2:19.2.3-683.g76b494d6.el9.x86_64 24/37 2026-02-17T20:55:40.179 INFO:teuthology.orchestra.run.trial104.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/37 2026-02-17T20:55:40.181 INFO:teuthology.orchestra.run.trial104.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/37 2026-02-17T20:55:40.182 INFO:teuthology.orchestra.run.trial104.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T20:55:40.201 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/37 2026-02-17T20:55:40.314 INFO:teuthology.orchestra.run.trial104.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/37 2026-02-17T20:55:40.317 INFO:teuthology.orchestra.run.trial104.stdout: Installing : nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T20:55:40.592 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 29/37 2026-02-17T20:55:40.592 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-17T20:55:40.592 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:40.628 INFO:teuthology.orchestra.run.trial104.stdout: Installing : mailcap-2.1.49-5.el9.noarch 30/37 2026-02-17T20:55:40.630 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-ceph-common-2:19.2.3-683.g76b494d6.el9.x86 31/37 2026-02-17T20:55:41.607 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-common-2:19.2.3-683.g76b494d6.el9.x86_64 32/37 2026-02-17T20:55:41.609 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-common-2:19.2.3-683.g76b494d6.el9.x86_64 32/37 2026-02-17T20:55:41.896 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-common-2:19.2.3-683.g76b494d6.el9.x86_64 32/37 2026-02-17T20:55:41.900 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-base-2:19.2.3-683.g76b494d6.el9.x86_64 33/37 2026-02-17T20:55:41.940 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-base-2:19.2.3-683.g76b494d6.el9.x86_64 33/37 2026-02-17T20:55:41.940 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-17T20:55:41.940 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-17T20:55:41.940 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:41.943 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-selinux-2:19.2.3-683.g76b494d6.el9.x86_64 34/37 2026-02-17T20:55:43.112 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-selinux-2:19.2.3-683.g76b494d6.el9.x86_64 34/37 2026-02-17T20:55:43.113 INFO:teuthology.orchestra.run.trial153.stdout:skipping the directory /sys 2026-02-17T20:55:43.113 INFO:teuthology.orchestra.run.trial153.stdout:skipping the directory /proc 2026-02-17T20:55:43.113 INFO:teuthology.orchestra.run.trial153.stdout:skipping the directory /mnt 2026-02-17T20:55:43.113 INFO:teuthology.orchestra.run.trial153.stdout:skipping the directory /var/tmp 2026-02-17T20:55:43.113 INFO:teuthology.orchestra.run.trial153.stdout:skipping the directory /home 2026-02-17T20:55:43.113 INFO:teuthology.orchestra.run.trial153.stdout:skipping the directory /root 2026-02-17T20:55:43.113 INFO:teuthology.orchestra.run.trial153.stdout:skipping the directory /tmp 2026-02-17T20:55:43.113 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:43.563 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-radosgw-2:19.2.3-683.g76b494d6.el9.x86_64 35/37 2026-02-17T20:55:43.586 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-683.g76b494d6.el9.x86_64 35/37 2026-02-17T20:55:43.586 INFO:teuthology.orchestra.run.trial153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:55:43.586 INFO:teuthology.orchestra.run.trial153.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T20:55:43.586 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T20:55:43.586 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T20:55:43.586 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:43.588 INFO:teuthology.orchestra.run.trial153.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T20:55:43.599 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T20:55:43.600 INFO:teuthology.orchestra.run.trial153.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:55:43.653 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:55:43.653 INFO:teuthology.orchestra.run.trial153.stdout:Creating group 'qat' with GID 992. 2026-02-17T20:55:43.653 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:43.923 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-base-2:19.2.3-683.g76b494d6.el9.x86_64 1/37 2026-02-17T20:55:43.923 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-common-2:19.2.3-683.g76b494d6.el9.x86_64 2/37 2026-02-17T20:55:43.923 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-radosgw-2:19.2.3-683.g76b494d6.el9.x86_64 3/37 2026-02-17T20:55:43.923 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-selinux-2:19.2.3-683.g76b494d6.el9.x86_64 4/37 2026-02-17T20:55:43.923 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libcephfs2-2:19.2.3-683.g76b494d6.el9.x86_64 5/37 2026-02-17T20:55:43.923 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libradosstriper1-2:19.2.3-683.g76b494d6.el9.x86_64 6/37 2026-02-17T20:55:43.924 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librgw2-2:19.2.3-683.g76b494d6.el9.x86_64 7/37 2026-02-17T20:55:43.924 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-ceph-argparse-2:19.2.3-683.g76b494d6.el9.x 8/37 2026-02-17T20:55:43.924 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-ceph-common-2:19.2.3-683.g76b494d6.el9.x86 9/37 2026-02-17T20:55:43.924 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-cephfs-2:19.2.3-683.g76b494d6.el9.x86_64 10/37 2026-02-17T20:55:43.924 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-rados-2:19.2.3-683.g76b494d6.el9.x86_64 11/37 2026-02-17T20:55:43.924 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-rbd-2:19.2.3-683.g76b494d6.el9.x86_64 12/37 2026-02-17T20:55:43.924 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-rgw-2:19.2.3-683.g76b494d6.el9.x86_64 13/37 2026-02-17T20:55:43.924 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T20:55:43.924 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T20:55:43.924 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T20:55:43.924 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T20:55:43.924 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T20:55:43.924 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T20:55:43.925 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T20:55:43.925 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T20:55:43.925 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T20:55:43.925 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T20:55:43.925 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T20:55:43.925 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T20:55:43.925 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T20:55:43.925 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T20:55:43.925 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T20:55:43.925 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T20:55:43.925 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T20:55:43.925 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T20:55:43.926 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T20:55:43.926 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T20:55:43.926 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librados2-2:19.2.3-683.g76b494d6.el9.x86_64 34/37 2026-02-17T20:55:43.926 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T20:55:43.926 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librbd1-2:19.2.3-683.g76b494d6.el9.x86_64 36/37 2026-02-17T20:55:43.979 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:55:43.980 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:43.980 INFO:teuthology.orchestra.run.trial153.stdout:Upgraded: 2026-02-17T20:55:43.980 INFO:teuthology.orchestra.run.trial153.stdout: librados2-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:43.980 INFO:teuthology.orchestra.run.trial153.stdout: librbd1-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:43.980 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T20:55:43.980 INFO:teuthology.orchestra.run.trial153.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T20:55:43.980 INFO:teuthology.orchestra.run.trial153.stdout: ceph-base-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:43.980 INFO:teuthology.orchestra.run.trial153.stdout: ceph-common-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:43.980 INFO:teuthology.orchestra.run.trial153.stdout: ceph-radosgw-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:43.980 INFO:teuthology.orchestra.run.trial153.stdout: ceph-selinux-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:43.980 INFO:teuthology.orchestra.run.trial153.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T20:55:43.981 INFO:teuthology.orchestra.run.trial153.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T20:55:43.981 INFO:teuthology.orchestra.run.trial153.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T20:55:43.981 INFO:teuthology.orchestra.run.trial153.stdout: libcephfs2-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:43.981 INFO:teuthology.orchestra.run.trial153.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T20:55:43.981 INFO:teuthology.orchestra.run.trial153.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T20:55:43.981 INFO:teuthology.orchestra.run.trial153.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T20:55:43.981 INFO:teuthology.orchestra.run.trial153.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T20:55:43.981 INFO:teuthology.orchestra.run.trial153.stdout: libradosstriper1-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:43.981 INFO:teuthology.orchestra.run.trial153.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T20:55:43.981 INFO:teuthology.orchestra.run.trial153.stdout: librgw2-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:43.981 INFO:teuthology.orchestra.run.trial153.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T20:55:43.981 INFO:teuthology.orchestra.run.trial153.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T20:55:43.981 INFO:teuthology.orchestra.run.trial153.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T20:55:43.982 INFO:teuthology.orchestra.run.trial153.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T20:55:43.982 INFO:teuthology.orchestra.run.trial153.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T20:55:43.982 INFO:teuthology.orchestra.run.trial153.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T20:55:43.982 INFO:teuthology.orchestra.run.trial153.stdout: python3-ceph-argparse-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:43.982 INFO:teuthology.orchestra.run.trial153.stdout: python3-ceph-common-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:43.982 INFO:teuthology.orchestra.run.trial153.stdout: python3-cephfs-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:43.982 INFO:teuthology.orchestra.run.trial153.stdout: python3-rados-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:43.982 INFO:teuthology.orchestra.run.trial153.stdout: python3-rbd-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:43.982 INFO:teuthology.orchestra.run.trial153.stdout: python3-rgw-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:43.982 INFO:teuthology.orchestra.run.trial153.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T20:55:43.982 INFO:teuthology.orchestra.run.trial153.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T20:55:43.982 INFO:teuthology.orchestra.run.trial153.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T20:55:43.982 INFO:teuthology.orchestra.run.trial153.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T20:55:43.983 INFO:teuthology.orchestra.run.trial153.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T20:55:43.983 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:43.983 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:55:44.021 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-test 2026-02-17T20:55:44.332 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:12 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:55:44.412 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:55:44.413 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:55:44.414 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repository Size 2026-02-17T20:55:44.414 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:55:44.414 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T20:55:44.414 INFO:teuthology.orchestra.run.trial153.stdout: ceph-test x86_64 2:19.2.3-683.g76b494d6.el9 ceph 50 M 2026-02-17T20:55:44.414 INFO:teuthology.orchestra.run.trial153.stdout:Installing dependencies: 2026-02-17T20:55:44.414 INFO:teuthology.orchestra.run.trial153.stdout: libcephsqlite x86_64 2:19.2.3-683.g76b494d6.el9 ceph 163 k 2026-02-17T20:55:44.414 INFO:teuthology.orchestra.run.trial153.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T20:55:44.414 INFO:teuthology.orchestra.run.trial153.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T20:55:44.414 INFO:teuthology.orchestra.run.trial153.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T20:55:44.414 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:44.414 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T20:55:44.415 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:55:44.415 INFO:teuthology.orchestra.run.trial153.stdout:Install 5 Packages 2026-02-17T20:55:44.415 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:44.415 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 50 M 2026-02-17T20:55:44.415 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 212 M 2026-02-17T20:55:44.415 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T20:55:44.619 INFO:teuthology.orchestra.run.trial153.stdout:(1/5): libcephsqlite-19.2.3-683.g76b494d6.el9.x 1.1 MB/s | 163 kB 00:00 2026-02-17T20:55:44.969 INFO:teuthology.orchestra.run.trial153.stdout:(2/5): libxslt-1.1.34-12.el9.x86_64.rpm 472 kB/s | 233 kB 00:00 2026-02-17T20:55:45.061 INFO:teuthology.orchestra.run.trial153.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 692 kB/s | 64 kB 00:00 2026-02-17T20:55:45.137 INFO:teuthology.orchestra.run.trial153.stdout:(4/5): socat-1.7.4.1-8.el9.x86_64.rpm 585 kB/s | 303 kB 00:00 2026-02-17T20:55:45.574 INFO:teuthology.orchestra.run.trial153.stdout:(5/5): ceph-test-19.2.3-683.g76b494d6.el9.x86_6 45 MB/s | 50 MB 00:01 2026-02-17T20:55:45.575 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:55:45.575 INFO:teuthology.orchestra.run.trial153.stdout:Total 43 MB/s | 50 MB 00:01 2026-02-17T20:55:45.600 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T20:55:45.609 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T20:55:45.609 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T20:55:45.795 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T20:55:45.795 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T20:55:46.005 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T20:55:46.011 INFO:teuthology.orchestra.run.trial153.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T20:55:46.015 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T20:55:46.023 INFO:teuthology.orchestra.run.trial153.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T20:55:46.024 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libcephsqlite-2:19.2.3-683.g76b494d6.el9.x86_64 4/5 2026-02-17T20:55:46.430 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-selinux-2:19.2.3-683.g76b494d6.el9.x86_64 34/37 2026-02-17T20:55:46.430 INFO:teuthology.orchestra.run.trial104.stdout:skipping the directory /sys 2026-02-17T20:55:46.430 INFO:teuthology.orchestra.run.trial104.stdout:skipping the directory /proc 2026-02-17T20:55:46.430 INFO:teuthology.orchestra.run.trial104.stdout:skipping the directory /mnt 2026-02-17T20:55:46.430 INFO:teuthology.orchestra.run.trial104.stdout:skipping the directory /var/tmp 2026-02-17T20:55:46.430 INFO:teuthology.orchestra.run.trial104.stdout:skipping the directory /home 2026-02-17T20:55:46.430 INFO:teuthology.orchestra.run.trial104.stdout:skipping the directory /root 2026-02-17T20:55:46.430 INFO:teuthology.orchestra.run.trial104.stdout:skipping the directory /tmp 2026-02-17T20:55:46.431 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:46.883 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-radosgw-2:19.2.3-683.g76b494d6.el9.x86_64 35/37 2026-02-17T20:55:46.905 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-radosgw-2:19.2.3-683.g76b494d6.el9.x86_64 35/37 2026-02-17T20:55:46.905 INFO:teuthology.orchestra.run.trial104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:55:46.905 INFO:teuthology.orchestra.run.trial104.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-17T20:55:46.905 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T20:55:46.905 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-17T20:55:46.906 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:46.907 INFO:teuthology.orchestra.run.trial104.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T20:55:46.919 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 36/37 2026-02-17T20:55:46.919 INFO:teuthology.orchestra.run.trial104.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:55:46.975 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:55:46.975 INFO:teuthology.orchestra.run.trial104.stdout:Creating group 'qat' with GID 992. 2026-02-17T20:55:46.975 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:47.237 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-base-2:19.2.3-683.g76b494d6.el9.x86_64 1/37 2026-02-17T20:55:47.237 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-common-2:19.2.3-683.g76b494d6.el9.x86_64 2/37 2026-02-17T20:55:47.237 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-radosgw-2:19.2.3-683.g76b494d6.el9.x86_64 3/37 2026-02-17T20:55:47.237 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-selinux-2:19.2.3-683.g76b494d6.el9.x86_64 4/37 2026-02-17T20:55:47.238 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : libcephfs2-2:19.2.3-683.g76b494d6.el9.x86_64 5/37 2026-02-17T20:55:47.238 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : libradosstriper1-2:19.2.3-683.g76b494d6.el9.x86_64 6/37 2026-02-17T20:55:47.238 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : librgw2-2:19.2.3-683.g76b494d6.el9.x86_64 7/37 2026-02-17T20:55:47.238 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-ceph-argparse-2:19.2.3-683.g76b494d6.el9.x 8/37 2026-02-17T20:55:47.238 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-ceph-common-2:19.2.3-683.g76b494d6.el9.x86 9/37 2026-02-17T20:55:47.238 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-cephfs-2:19.2.3-683.g76b494d6.el9.x86_64 10/37 2026-02-17T20:55:47.238 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-rados-2:19.2.3-683.g76b494d6.el9.x86_64 11/37 2026-02-17T20:55:47.238 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-rbd-2:19.2.3-683.g76b494d6.el9.x86_64 12/37 2026-02-17T20:55:47.238 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-rgw-2:19.2.3-683.g76b494d6.el9.x86_64 13/37 2026-02-17T20:55:47.238 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/37 2026-02-17T20:55:47.238 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 15/37 2026-02-17T20:55:47.238 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 16/37 2026-02-17T20:55:47.239 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 17/37 2026-02-17T20:55:47.239 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 18/37 2026-02-17T20:55:47.239 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 19/37 2026-02-17T20:55:47.239 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 20/37 2026-02-17T20:55:47.239 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 21/37 2026-02-17T20:55:47.239 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 22/37 2026-02-17T20:55:47.239 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 23/37 2026-02-17T20:55:47.239 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 24/37 2026-02-17T20:55:47.239 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 25/37 2026-02-17T20:55:47.239 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 26/37 2026-02-17T20:55:47.239 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 27/37 2026-02-17T20:55:47.239 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 28/37 2026-02-17T20:55:47.240 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 29/37 2026-02-17T20:55:47.240 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 30/37 2026-02-17T20:55:47.240 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 31/37 2026-02-17T20:55:47.240 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : re2-1:20211101-20.el9.x86_64 32/37 2026-02-17T20:55:47.240 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 33/37 2026-02-17T20:55:47.240 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : librados2-2:19.2.3-683.g76b494d6.el9.x86_64 34/37 2026-02-17T20:55:47.240 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 35/37 2026-02-17T20:55:47.240 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : librbd1-2:19.2.3-683.g76b494d6.el9.x86_64 36/37 2026-02-17T20:55:47.292 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 37/37 2026-02-17T20:55:47.293 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:47.293 INFO:teuthology.orchestra.run.trial104.stdout:Upgraded: 2026-02-17T20:55:47.293 INFO:teuthology.orchestra.run.trial104.stdout: librados2-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:47.293 INFO:teuthology.orchestra.run.trial104.stdout: librbd1-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:47.293 INFO:teuthology.orchestra.run.trial104.stdout:Installed: 2026-02-17T20:55:47.293 INFO:teuthology.orchestra.run.trial104.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-17T20:55:47.293 INFO:teuthology.orchestra.run.trial104.stdout: ceph-base-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:47.293 INFO:teuthology.orchestra.run.trial104.stdout: ceph-common-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:47.293 INFO:teuthology.orchestra.run.trial104.stdout: ceph-radosgw-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:47.294 INFO:teuthology.orchestra.run.trial104.stdout: ceph-selinux-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:47.294 INFO:teuthology.orchestra.run.trial104.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-17T20:55:47.294 INFO:teuthology.orchestra.run.trial104.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-17T20:55:47.294 INFO:teuthology.orchestra.run.trial104.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-17T20:55:47.294 INFO:teuthology.orchestra.run.trial104.stdout: libcephfs2-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:47.294 INFO:teuthology.orchestra.run.trial104.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-17T20:55:47.294 INFO:teuthology.orchestra.run.trial104.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-17T20:55:47.294 INFO:teuthology.orchestra.run.trial104.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-17T20:55:47.294 INFO:teuthology.orchestra.run.trial104.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-17T20:55:47.294 INFO:teuthology.orchestra.run.trial104.stdout: libradosstriper1-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:47.294 INFO:teuthology.orchestra.run.trial104.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-17T20:55:47.295 INFO:teuthology.orchestra.run.trial104.stdout: librgw2-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:47.295 INFO:teuthology.orchestra.run.trial104.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-17T20:55:47.295 INFO:teuthology.orchestra.run.trial104.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-17T20:55:47.295 INFO:teuthology.orchestra.run.trial104.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-17T20:55:47.295 INFO:teuthology.orchestra.run.trial104.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T20:55:47.295 INFO:teuthology.orchestra.run.trial104.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-17T20:55:47.295 INFO:teuthology.orchestra.run.trial104.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-17T20:55:47.295 INFO:teuthology.orchestra.run.trial104.stdout: python3-ceph-argparse-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:47.295 INFO:teuthology.orchestra.run.trial104.stdout: python3-ceph-common-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:47.295 INFO:teuthology.orchestra.run.trial104.stdout: python3-cephfs-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:47.295 INFO:teuthology.orchestra.run.trial104.stdout: python3-rados-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:47.295 INFO:teuthology.orchestra.run.trial104.stdout: python3-rbd-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:47.296 INFO:teuthology.orchestra.run.trial104.stdout: python3-rgw-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:47.296 INFO:teuthology.orchestra.run.trial104.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-17T20:55:47.296 INFO:teuthology.orchestra.run.trial104.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-17T20:55:47.296 INFO:teuthology.orchestra.run.trial104.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-17T20:55:47.296 INFO:teuthology.orchestra.run.trial104.stdout: re2-1:20211101-20.el9.x86_64 2026-02-17T20:55:47.296 INFO:teuthology.orchestra.run.trial104.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-17T20:55:47.296 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:47.296 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:55:47.333 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install ceph-test 2026-02-17T20:55:47.643 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:15 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:55:47.723 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:55:47.724 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:55:47.724 INFO:teuthology.orchestra.run.trial104.stdout: Package Arch Version Repository Size 2026-02-17T20:55:47.724 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:55:47.724 INFO:teuthology.orchestra.run.trial104.stdout:Installing: 2026-02-17T20:55:47.724 INFO:teuthology.orchestra.run.trial104.stdout: ceph-test x86_64 2:19.2.3-683.g76b494d6.el9 ceph 50 M 2026-02-17T20:55:47.724 INFO:teuthology.orchestra.run.trial104.stdout:Installing dependencies: 2026-02-17T20:55:47.724 INFO:teuthology.orchestra.run.trial104.stdout: libcephsqlite x86_64 2:19.2.3-683.g76b494d6.el9 ceph 163 k 2026-02-17T20:55:47.724 INFO:teuthology.orchestra.run.trial104.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-17T20:55:47.724 INFO:teuthology.orchestra.run.trial104.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-17T20:55:47.724 INFO:teuthology.orchestra.run.trial104.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-17T20:55:47.724 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:47.724 INFO:teuthology.orchestra.run.trial104.stdout:Transaction Summary 2026-02-17T20:55:47.724 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:55:47.724 INFO:teuthology.orchestra.run.trial104.stdout:Install 5 Packages 2026-02-17T20:55:47.725 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:47.725 INFO:teuthology.orchestra.run.trial104.stdout:Total download size: 50 M 2026-02-17T20:55:47.725 INFO:teuthology.orchestra.run.trial104.stdout:Installed size: 212 M 2026-02-17T20:55:47.725 INFO:teuthology.orchestra.run.trial104.stdout:Downloading Packages: 2026-02-17T20:55:48.033 INFO:teuthology.orchestra.run.trial104.stdout:(1/5): libxslt-1.1.34-12.el9.x86_64.rpm 4.9 MB/s | 233 kB 00:00 2026-02-17T20:55:48.050 INFO:teuthology.orchestra.run.trial104.stdout:(2/5): socat-1.7.4.1-8.el9.x86_64.rpm 17 MB/s | 303 kB 00:00 2026-02-17T20:55:48.059 INFO:teuthology.orchestra.run.trial104.stdout:(3/5): xmlstarlet-1.6.1-20.el9.x86_64.rpm 7.2 MB/s | 64 kB 00:00 2026-02-17T20:55:48.072 INFO:teuthology.orchestra.run.trial104.stdout:(4/5): libcephsqlite-19.2.3-683.g76b494d6.el9.x 1.9 MB/s | 163 kB 00:00 2026-02-17T20:55:48.318 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: libcephsqlite-2:19.2.3-683.g76b494d6.el9.x86_64 4/5 2026-02-17T20:55:48.336 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-test-2:19.2.3-683.g76b494d6.el9.x86_64 5/5 2026-02-17T20:55:48.566 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-test-2:19.2.3-683.g76b494d6.el9.x86_64 5/5 2026-02-17T20:55:48.566 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-test-2:19.2.3-683.g76b494d6.el9.x86_64 1/5 2026-02-17T20:55:48.567 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libcephsqlite-2:19.2.3-683.g76b494d6.el9.x86_64 2/5 2026-02-17T20:55:48.567 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T20:55:48.567 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T20:55:48.620 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T20:55:48.620 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:48.620 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T20:55:48.620 INFO:teuthology.orchestra.run.trial153.stdout: ceph-test-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:48.620 INFO:teuthology.orchestra.run.trial153.stdout: libcephsqlite-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:48.620 INFO:teuthology.orchestra.run.trial153.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T20:55:48.620 INFO:teuthology.orchestra.run.trial153.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T20:55:48.620 INFO:teuthology.orchestra.run.trial153.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T20:55:48.620 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:48.621 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:55:48.654 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph 2026-02-17T20:55:48.961 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:16 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:55:49.046 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:55:49.049 INFO:teuthology.orchestra.run.trial153.stdout:====================================================================================== 2026-02-17T20:55:49.049 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repository Size 2026-02-17T20:55:49.049 INFO:teuthology.orchestra.run.trial153.stdout:====================================================================================== 2026-02-17T20:55:49.049 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T20:55:49.049 INFO:teuthology.orchestra.run.trial153.stdout: ceph x86_64 2:19.2.3-683.g76b494d6.el9 ceph 6.5 k 2026-02-17T20:55:49.049 INFO:teuthology.orchestra.run.trial153.stdout:Installing dependencies: 2026-02-17T20:55:49.050 INFO:teuthology.orchestra.run.trial153.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T20:55:49.050 INFO:teuthology.orchestra.run.trial153.stdout: ceph-grafana-dashboards noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 31 k 2026-02-17T20:55:49.050 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mds x86_64 2:19.2.3-683.g76b494d6.el9 ceph 2.4 M 2026-02-17T20:55:49.050 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr x86_64 2:19.2.3-683.g76b494d6.el9 ceph 1.1 M 2026-02-17T20:55:49.050 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-modules-core noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 253 k 2026-02-17T20:55:49.050 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mon x86_64 2:19.2.3-683.g76b494d6.el9 ceph 4.7 M 2026-02-17T20:55:49.050 INFO:teuthology.orchestra.run.trial153.stdout: ceph-osd x86_64 2:19.2.3-683.g76b494d6.el9 ceph 17 M 2026-02-17T20:55:49.050 INFO:teuthology.orchestra.run.trial153.stdout: ceph-prometheus-alerts noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 17 k 2026-02-17T20:55:49.050 INFO:teuthology.orchestra.run.trial153.stdout: cephadm noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 769 k 2026-02-17T20:55:49.050 INFO:teuthology.orchestra.run.trial153.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T20:55:49.050 INFO:teuthology.orchestra.run.trial153.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T20:55:49.051 INFO:teuthology.orchestra.run.trial153.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T20:55:49.051 INFO:teuthology.orchestra.run.trial153.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T20:55:49.051 INFO:teuthology.orchestra.run.trial153.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T20:55:49.051 INFO:teuthology.orchestra.run.trial153.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T20:55:49.051 INFO:teuthology.orchestra.run.trial153.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T20:55:49.051 INFO:teuthology.orchestra.run.trial153.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T20:55:49.051 INFO:teuthology.orchestra.run.trial153.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T20:55:49.051 INFO:teuthology.orchestra.run.trial153.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T20:55:49.051 INFO:teuthology.orchestra.run.trial153.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T20:55:49.051 INFO:teuthology.orchestra.run.trial153.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T20:55:49.051 INFO:teuthology.orchestra.run.trial153.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T20:55:49.051 INFO:teuthology.orchestra.run.trial153.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T20:55:49.052 INFO:teuthology.orchestra.run.trial153.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T20:55:49.052 INFO:teuthology.orchestra.run.trial153.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T20:55:49.052 INFO:teuthology.orchestra.run.trial153.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T20:55:49.052 INFO:teuthology.orchestra.run.trial153.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T20:55:49.052 INFO:teuthology.orchestra.run.trial153.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T20:55:49.052 INFO:teuthology.orchestra.run.trial153.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T20:55:49.052 INFO:teuthology.orchestra.run.trial153.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T20:55:49.052 INFO:teuthology.orchestra.run.trial153.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T20:55:49.052 INFO:teuthology.orchestra.run.trial153.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T20:55:49.052 INFO:teuthology.orchestra.run.trial153.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T20:55:49.052 INFO:teuthology.orchestra.run.trial153.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T20:55:49.052 INFO:teuthology.orchestra.run.trial153.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T20:55:49.052 INFO:teuthology.orchestra.run.trial153.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T20:55:49.053 INFO:teuthology.orchestra.run.trial153.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T20:55:49.053 INFO:teuthology.orchestra.run.trial153.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T20:55:49.053 INFO:teuthology.orchestra.run.trial153.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T20:55:49.053 INFO:teuthology.orchestra.run.trial153.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T20:55:49.053 INFO:teuthology.orchestra.run.trial153.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T20:55:49.053 INFO:teuthology.orchestra.run.trial153.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T20:55:49.053 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T20:55:49.053 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T20:55:49.053 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T20:55:49.053 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T20:55:49.053 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T20:55:49.053 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T20:55:49.053 INFO:teuthology.orchestra.run.trial153.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T20:55:49.054 INFO:teuthology.orchestra.run.trial153.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T20:55:49.054 INFO:teuthology.orchestra.run.trial153.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T20:55:49.054 INFO:teuthology.orchestra.run.trial153.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T20:55:49.054 INFO:teuthology.orchestra.run.trial153.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T20:55:49.054 INFO:teuthology.orchestra.run.trial153.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T20:55:49.054 INFO:teuthology.orchestra.run.trial153.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T20:55:49.054 INFO:teuthology.orchestra.run.trial153.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T20:55:49.054 INFO:teuthology.orchestra.run.trial153.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T20:55:49.054 INFO:teuthology.orchestra.run.trial153.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T20:55:49.054 INFO:teuthology.orchestra.run.trial153.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T20:55:49.054 INFO:teuthology.orchestra.run.trial153.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T20:55:49.054 INFO:teuthology.orchestra.run.trial153.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T20:55:49.055 INFO:teuthology.orchestra.run.trial153.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T20:55:49.055 INFO:teuthology.orchestra.run.trial153.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T20:55:49.055 INFO:teuthology.orchestra.run.trial153.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T20:55:49.055 INFO:teuthology.orchestra.run.trial153.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T20:55:49.055 INFO:teuthology.orchestra.run.trial153.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T20:55:49.055 INFO:teuthology.orchestra.run.trial153.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T20:55:49.055 INFO:teuthology.orchestra.run.trial153.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T20:55:49.055 INFO:teuthology.orchestra.run.trial153.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T20:55:49.055 INFO:teuthology.orchestra.run.trial153.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T20:55:49.055 INFO:teuthology.orchestra.run.trial153.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T20:55:49.055 INFO:teuthology.orchestra.run.trial153.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T20:55:49.056 INFO:teuthology.orchestra.run.trial153.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T20:55:49.056 INFO:teuthology.orchestra.run.trial153.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T20:55:49.056 INFO:teuthology.orchestra.run.trial153.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T20:55:49.056 INFO:teuthology.orchestra.run.trial153.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T20:55:49.056 INFO:teuthology.orchestra.run.trial153.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T20:55:49.056 INFO:teuthology.orchestra.run.trial153.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T20:55:49.056 INFO:teuthology.orchestra.run.trial153.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T20:55:49.056 INFO:teuthology.orchestra.run.trial153.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T20:55:49.056 INFO:teuthology.orchestra.run.trial153.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T20:55:49.056 INFO:teuthology.orchestra.run.trial153.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T20:55:49.056 INFO:teuthology.orchestra.run.trial153.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T20:55:49.056 INFO:teuthology.orchestra.run.trial153.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T20:55:49.056 INFO:teuthology.orchestra.run.trial153.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T20:55:49.057 INFO:teuthology.orchestra.run.trial153.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T20:55:49.057 INFO:teuthology.orchestra.run.trial153.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T20:55:49.057 INFO:teuthology.orchestra.run.trial153.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T20:55:49.057 INFO:teuthology.orchestra.run.trial153.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T20:55:49.057 INFO:teuthology.orchestra.run.trial153.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T20:55:49.057 INFO:teuthology.orchestra.run.trial153.stdout:Installing weak dependencies: 2026-02-17T20:55:49.057 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-cephadm noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 150 k 2026-02-17T20:55:49.057 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-dashboard noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 3.8 M 2026-02-17T20:55:49.057 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 7.4 M 2026-02-17T20:55:49.057 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 22 k 2026-02-17T20:55:49.057 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-rook noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 49 k 2026-02-17T20:55:49.057 INFO:teuthology.orchestra.run.trial153.stdout: ceph-volume noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 299 k 2026-02-17T20:55:49.058 INFO:teuthology.orchestra.run.trial153.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T20:55:49.058 INFO:teuthology.orchestra.run.trial153.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T20:55:49.058 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:49.058 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T20:55:49.058 INFO:teuthology.orchestra.run.trial153.stdout:====================================================================================== 2026-02-17T20:55:49.058 INFO:teuthology.orchestra.run.trial153.stdout:Install 99 Packages 2026-02-17T20:55:49.058 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:49.059 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 95 M 2026-02-17T20:55:49.059 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 520 M 2026-02-17T20:55:49.059 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T20:55:49.102 INFO:teuthology.orchestra.run.trial104.stdout:(5/5): ceph-test-19.2.3-683.g76b494d6.el9.x86_6 44 MB/s | 50 MB 00:01 2026-02-17T20:55:49.103 INFO:teuthology.orchestra.run.trial104.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:55:49.103 INFO:teuthology.orchestra.run.trial104.stdout:Total 37 MB/s | 50 MB 00:01 2026-02-17T20:55:49.132 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction check 2026-02-17T20:55:49.141 INFO:teuthology.orchestra.run.trial104.stdout:Transaction check succeeded. 2026-02-17T20:55:49.141 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction test 2026-02-17T20:55:49.328 INFO:teuthology.orchestra.run.trial104.stdout:Transaction test succeeded. 2026-02-17T20:55:49.328 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction 2026-02-17T20:55:49.421 INFO:teuthology.orchestra.run.trial153.stdout:(1/99): ceph-19.2.3-683.g76b494d6.el9.x86_64.rp 129 kB/s | 6.5 kB 00:00 2026-02-17T20:55:49.507 INFO:teuthology.orchestra.run.trial153.stdout:(2/99): ceph-mgr-19.2.3-683.g76b494d6.el9.x86_6 7.8 MB/s | 1.1 MB 00:00 2026-02-17T20:55:49.535 INFO:teuthology.orchestra.run.trial104.stdout: Preparing : 1/1 2026-02-17T20:55:49.539 INFO:teuthology.orchestra.run.trial153.stdout:(3/99): ceph-mds-19.2.3-683.g76b494d6.el9.x86_6 14 MB/s | 2.4 MB 00:00 2026-02-17T20:55:49.542 INFO:teuthology.orchestra.run.trial104.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 1/5 2026-02-17T20:55:49.546 INFO:teuthology.orchestra.run.trial104.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 2/5 2026-02-17T20:55:49.554 INFO:teuthology.orchestra.run.trial104.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 3/5 2026-02-17T20:55:49.555 INFO:teuthology.orchestra.run.trial104.stdout: Installing : libcephsqlite-2:19.2.3-683.g76b494d6.el9.x86_64 4/5 2026-02-17T20:55:49.574 INFO:teuthology.orchestra.run.trial153.stdout:(4/99): ceph-grafana-dashboards-19.2.3-683.g76b 912 kB/s | 31 kB 00:00 2026-02-17T20:55:49.611 INFO:teuthology.orchestra.run.trial153.stdout:(5/99): ceph-mgr-cephadm-19.2.3-683.g76b494d6.e 3.9 MB/s | 150 kB 00:00 2026-02-17T20:55:49.689 INFO:teuthology.orchestra.run.trial153.stdout:(6/99): ceph-mon-19.2.3-683.g76b494d6.el9.x86_6 18 MB/s | 4.7 MB 00:00 2026-02-17T20:55:49.821 INFO:teuthology.orchestra.run.trial153.stdout:(7/99): ceph-mgr-dashboard-19.2.3-683.g76b494d6 18 MB/s | 3.8 MB 00:00 2026-02-17T20:55:49.865 INFO:teuthology.orchestra.run.trial153.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-683.g76b494d6 511 kB/s | 22 kB 00:00 2026-02-17T20:55:49.916 INFO:teuthology.orchestra.run.trial153.stdout:(9/99): ceph-mgr-modules-core-19.2.3-683.g76b49 4.8 MB/s | 253 kB 00:00 2026-02-17T20:55:49.965 INFO:teuthology.orchestra.run.trial153.stdout:(10/99): ceph-mgr-rook-19.2.3-683.g76b494d6.el9 993 kB/s | 49 kB 00:00 2026-02-17T20:55:50.018 INFO:teuthology.orchestra.run.trial153.stdout:(11/99): ceph-prometheus-alerts-19.2.3-683.g76b 318 kB/s | 17 kB 00:00 2026-02-17T20:55:50.054 INFO:teuthology.orchestra.run.trial153.stdout:(12/99): ceph-mgr-diskprediction-local-19.2.3-6 20 MB/s | 7.4 MB 00:00 2026-02-17T20:55:50.058 INFO:teuthology.orchestra.run.trial153.stdout:(13/99): ceph-volume-19.2.3-683.g76b494d6.el9.n 7.4 MB/s | 299 kB 00:00 2026-02-17T20:55:50.102 INFO:teuthology.orchestra.run.trial153.stdout:(14/99): cephadm-19.2.3-683.g76b494d6.el9.noarc 15 MB/s | 769 kB 00:00 2026-02-17T20:55:50.126 INFO:teuthology.orchestra.run.trial153.stdout:(15/99): ceph-osd-19.2.3-683.g76b494d6.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-17T20:55:50.169 INFO:teuthology.orchestra.run.trial153.stdout:(16/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 611 kB/s | 40 kB 00:00 2026-02-17T20:55:50.189 INFO:teuthology.orchestra.run.trial153.stdout:(17/99): libconfig-1.7.2-9.el9.x86_64.rpm 1.1 MB/s | 72 kB 00:00 2026-02-17T20:55:50.207 INFO:teuthology.orchestra.run.trial153.stdout:(18/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 2.3 MB/s | 350 kB 00:00 2026-02-17T20:55:50.232 INFO:teuthology.orchestra.run.trial153.stdout:(19/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 10 MB/s | 253 kB 00:00 2026-02-17T20:55:50.232 INFO:teuthology.orchestra.run.trial153.stdout:(20/99): libquadmath-11.5.0-14.el9.x86_64.rpm 4.1 MB/s | 184 kB 00:00 2026-02-17T20:55:50.256 INFO:teuthology.orchestra.run.trial153.stdout:(21/99): libgfortran-11.5.0-14.el9.x86_64.rpm 8.9 MB/s | 794 kB 00:00 2026-02-17T20:55:50.256 INFO:teuthology.orchestra.run.trial153.stdout:(22/99): python3-ply-3.11-14.el9.noarch.rpm 4.4 MB/s | 106 kB 00:00 2026-02-17T20:55:50.280 INFO:teuthology.orchestra.run.trial153.stdout:(23/99): python3-pyparsing-2.4.7-9.el9.noarch.r 6.2 MB/s | 150 kB 00:00 2026-02-17T20:55:50.281 INFO:teuthology.orchestra.run.trial153.stdout:(24/99): python3-pycparser-2.20-6.el9.noarch.rp 5.3 MB/s | 135 kB 00:00 2026-02-17T20:55:50.299 INFO:teuthology.orchestra.run.trial153.stdout:(25/99): python3-cryptography-36.0.1-5.el9.x86_ 18 MB/s | 1.2 MB 00:00 2026-02-17T20:55:50.302 INFO:teuthology.orchestra.run.trial153.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 5.5 MB/s | 126 kB 00:00 2026-02-17T20:55:50.306 INFO:teuthology.orchestra.run.trial153.stdout:(27/99): python3-urllib3-1.26.5-7.el9.noarch.rp 8.3 MB/s | 218 kB 00:00 2026-02-17T20:55:50.323 INFO:teuthology.orchestra.run.trial153.stdout:(28/99): unzip-6.0-59.el9.x86_64.rpm 7.6 MB/s | 182 kB 00:00 2026-02-17T20:55:50.326 INFO:teuthology.orchestra.run.trial153.stdout:(29/99): zip-3.0-35.el9.x86_64.rpm 11 MB/s | 266 kB 00:00 2026-02-17T20:55:50.333 INFO:teuthology.orchestra.run.trial153.stdout:(30/99): flexiblas-3.0.4-9.el9.x86_64.rpm 1.1 MB/s | 30 kB 00:00 2026-02-17T20:55:50.351 INFO:teuthology.orchestra.run.trial153.stdout:(31/99): flexiblas-openblas-openmp-3.0.4-9.el9. 610 kB/s | 15 kB 00:00 2026-02-17T20:55:50.367 INFO:teuthology.orchestra.run.trial153.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 7.2 MB/s | 246 kB 00:00 2026-02-17T20:55:50.376 INFO:teuthology.orchestra.run.trial153.stdout:(33/99): openblas-0.3.29-1.el9.x86_64.rpm 4.4 MB/s | 42 kB 00:00 2026-02-17T20:55:50.385 INFO:teuthology.orchestra.run.trial153.stdout:(34/99): lua-5.4.4-4.el9.x86_64.rpm 5.4 MB/s | 188 kB 00:00 2026-02-17T20:55:50.408 INFO:teuthology.orchestra.run.trial153.stdout:(35/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 35 MB/s | 3.0 MB 00:00 2026-02-17T20:55:50.421 INFO:teuthology.orchestra.run.trial153.stdout:(36/99): protobuf-3.14.0-17.el9.x86_64.rpm 28 MB/s | 1.0 MB 00:00 2026-02-17T20:55:50.434 INFO:teuthology.orchestra.run.trial153.stdout:(37/99): python3-devel-3.9.25-2.el9.x86_64.rpm 19 MB/s | 244 kB 00:00 2026-02-17T20:55:50.444 INFO:teuthology.orchestra.run.trial153.stdout:(38/99): python3-babel-2.9.1-2.el9.noarch.rpm 163 MB/s | 6.0 MB 00:00 2026-02-17T20:55:50.448 INFO:teuthology.orchestra.run.trial153.stdout:(39/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 18 MB/s | 249 kB 00:00 2026-02-17T20:55:50.457 INFO:teuthology.orchestra.run.trial153.stdout:(40/99): python3-libstoragemgmt-1.10.1-1.el9.x8 14 MB/s | 177 kB 00:00 2026-02-17T20:55:50.467 INFO:teuthology.orchestra.run.trial153.stdout:(41/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 65 MB/s | 1.2 MB 00:00 2026-02-17T20:55:50.471 INFO:teuthology.orchestra.run.trial153.stdout:(42/99): python3-mako-1.1.4-6.el9.noarch.rpm 12 MB/s | 172 kB 00:00 2026-02-17T20:55:50.477 INFO:teuthology.orchestra.run.trial153.stdout:(43/99): python3-markupsafe-1.1.1-12.el9.x86_64 3.4 MB/s | 35 kB 00:00 2026-02-17T20:55:50.489 INFO:teuthology.orchestra.run.trial153.stdout:(44/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 36 MB/s | 442 kB 00:00 2026-02-17T20:55:50.497 INFO:teuthology.orchestra.run.trial153.stdout:(45/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 44 MB/s | 5.3 MB 00:00 2026-02-17T20:55:50.500 INFO:teuthology.orchestra.run.trial153.stdout:(46/99): python3-packaging-20.9-5.el9.noarch.rp 6.8 MB/s | 77 kB 00:00 2026-02-17T20:55:50.509 INFO:teuthology.orchestra.run.trial153.stdout:(47/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 161 MB/s | 6.1 MB 00:00 2026-02-17T20:55:50.510 INFO:teuthology.orchestra.run.trial153.stdout:(48/99): python3-protobuf-3.14.0-17.el9.noarch. 21 MB/s | 267 kB 00:00 2026-02-17T20:55:50.511 INFO:teuthology.orchestra.run.trial153.stdout:(49/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 15 MB/s | 159 kB 00:00 2026-02-17T20:55:50.520 INFO:teuthology.orchestra.run.trial153.stdout:(50/99): python3-requests-oauthlib-1.3.0-12.el9 5.2 MB/s | 54 kB 00:00 2026-02-17T20:55:50.523 INFO:teuthology.orchestra.run.trial153.stdout:(51/99): python3-pyasn1-modules-0.4.8-6.el9.noa 20 MB/s | 279 kB 00:00 2026-02-17T20:55:50.530 INFO:teuthology.orchestra.run.trial153.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 4.2 MB/s | 42 kB 00:00 2026-02-17T20:55:50.534 INFO:teuthology.orchestra.run.trial153.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 17 MB/s | 189 kB 00:00 2026-02-17T20:55:50.541 INFO:teuthology.orchestra.run.trial153.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 8.3 MB/s | 90 kB 00:00 2026-02-17T20:55:50.605 INFO:teuthology.orchestra.run.trial153.stdout:(55/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 206 MB/s | 19 MB 00:00 2026-02-17T20:55:50.748 INFO:teuthology.orchestra.run.trial153.stdout:(56/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 3.7 MB/s | 551 kB 00:00 2026-02-17T20:55:50.769 INFO:teuthology.orchestra.run.trial153.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 956 kB/s | 19 kB 00:00 2026-02-17T20:55:50.773 INFO:teuthology.orchestra.run.trial153.stdout:(58/99): lua-devel-5.4.4-4.el9.x86_64.rpm 93 kB/s | 22 kB 00:00 2026-02-17T20:55:50.802 INFO:teuthology.orchestra.run.trial153.stdout:(59/99): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2026-02-17T20:55:50.823 INFO:teuthology.orchestra.run.trial153.stdout:(60/99): python3-autocommand-2.2.2-8.el9.noarch 1.4 MB/s | 29 kB 00:00 2026-02-17T20:55:50.844 INFO:teuthology.orchestra.run.trial153.stdout:(61/99): python3-backports-tarfile-1.2.0-1.el9. 2.8 MB/s | 60 kB 00:00 2026-02-17T20:55:50.865 INFO:teuthology.orchestra.run.trial153.stdout:(62/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.0 MB/s | 43 kB 00:00 2026-02-17T20:55:50.886 INFO:teuthology.orchestra.run.trial153.stdout:(63/99): python3-cachetools-4.2.4-1.el9.noarch. 1.5 MB/s | 32 kB 00:00 2026-02-17T20:55:50.907 INFO:teuthology.orchestra.run.trial153.stdout:(64/99): python3-certifi-2023.05.07-4.el9.noarc 680 kB/s | 14 kB 00:00 2026-02-17T20:55:50.910 INFO:teuthology.orchestra.run.trial153.stdout:(65/99): python3-asyncssh-2.13.2-5.el9.noarch.r 3.9 MB/s | 548 kB 00:00 2026-02-17T20:55:50.930 INFO:teuthology.orchestra.run.trial153.stdout:(66/99): python3-cheroot-10.0.1-4.el9.noarch.rp 7.2 MB/s | 173 kB 00:00 2026-02-17T20:55:50.933 INFO:teuthology.orchestra.run.trial153.stdout:(67/99): python3-cherrypy-18.6.1-2.el9.noarch.r 15 MB/s | 358 kB 00:00 2026-02-17T20:55:50.953 INFO:teuthology.orchestra.run.trial153.stdout:(68/99): python3-google-auth-2.45.0-1.el9.noarc 11 MB/s | 254 kB 00:00 2026-02-17T20:55:50.976 INFO:teuthology.orchestra.run.trial153.stdout:(69/99): python3-grpcio-tools-1.46.7-10.el9.x86 6.2 MB/s | 144 kB 00:00 2026-02-17T20:55:50.981 INFO:teuthology.orchestra.run.trial153.stdout:(70/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 43 MB/s | 2.0 MB 00:00 2026-02-17T20:55:50.999 INFO:teuthology.orchestra.run.trial153.stdout:(71/99): python3-influxdb-5.3.1-1.el9.noarch.rp 6.0 MB/s | 139 kB 00:00 2026-02-17T20:55:51.002 INFO:teuthology.orchestra.run.trial153.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 2.6 MB/s | 56 kB 00:00 2026-02-17T20:55:51.019 INFO:teuthology.orchestra.run.trial153.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 518 kB/s | 11 kB 00:00 2026-02-17T20:55:51.023 INFO:teuthology.orchestra.run.trial153.stdout:(74/99): python3-jaraco-classes-3.2.1-5.el9.noa 863 kB/s | 18 kB 00:00 2026-02-17T20:55:51.041 INFO:teuthology.orchestra.run.trial153.stdout:(75/99): python3-jaraco-collections-3.0.0-8.el9 1.1 MB/s | 23 kB 00:00 2026-02-17T20:55:51.043 INFO:teuthology.orchestra.run.trial153.stdout:(76/99): python3-jaraco-context-6.0.1-3.el9.noa 958 kB/s | 20 kB 00:00 2026-02-17T20:55:51.061 INFO:teuthology.orchestra.run.trial153.stdout:(77/99): python3-jaraco-functools-3.5.0-2.el9.n 937 kB/s | 19 kB 00:00 2026-02-17T20:55:51.064 INFO:teuthology.orchestra.run.trial153.stdout:(78/99): python3-jaraco-text-4.0.0-2.el9.noarch 1.2 MB/s | 26 kB 00:00 2026-02-17T20:55:51.085 INFO:teuthology.orchestra.run.trial153.stdout:(79/99): python3-logutils-0.3.5-21.el9.noarch.r 2.1 MB/s | 46 kB 00:00 2026-02-17T20:55:51.105 INFO:teuthology.orchestra.run.trial153.stdout:(80/99): python3-kubernetes-26.1.0-3.el9.noarch 23 MB/s | 1.0 MB 00:00 2026-02-17T20:55:51.107 INFO:teuthology.orchestra.run.trial153.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 3.6 MB/s | 79 kB 00:00 2026-02-17T20:55:51.127 INFO:teuthology.orchestra.run.trial153.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 3.9 MB/s | 86 kB 00:00 2026-02-17T20:55:51.128 INFO:teuthology.orchestra.run.trial153.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 2.7 MB/s | 58 kB 00:00 2026-02-17T20:55:51.149 INFO:teuthology.orchestra.run.trial153.stdout:(84/99): python3-portend-3.1.0-2.el9.noarch.rpm 789 kB/s | 16 kB 00:00 2026-02-17T20:55:51.150 INFO:teuthology.orchestra.run.trial153.stdout:(85/99): python3-pecan-1.4.2-3.el9.noarch.rpm 12 MB/s | 272 kB 00:00 2026-02-17T20:55:51.171 INFO:teuthology.orchestra.run.trial153.stdout:(86/99): python3-repoze-lru-0.7-16.el9.noarch.r 1.4 MB/s | 31 kB 00:00 2026-02-17T20:55:51.171 INFO:teuthology.orchestra.run.trial153.stdout:(87/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 4.0 MB/s | 90 kB 00:00 2026-02-17T20:55:51.175 INFO:teuthology.orchestra.run.trial153.stdout:(88/99): protobuf-compiler-3.14.0-17.el9.x86_64 1.3 MB/s | 862 kB 00:00 2026-02-17T20:55:51.194 INFO:teuthology.orchestra.run.trial153.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 2.6 MB/s | 59 kB 00:00 2026-02-17T20:55:51.194 INFO:teuthology.orchestra.run.trial153.stdout:(90/99): python3-routes-2.5.1-5.el9.noarch.rpm 7.9 MB/s | 188 kB 00:00 2026-02-17T20:55:51.215 INFO:teuthology.orchestra.run.trial153.stdout:(91/99): python3-tempora-5.0.0-2.el9.noarch.rpm 1.7 MB/s | 36 kB 00:00 2026-02-17T20:55:51.216 INFO:teuthology.orchestra.run.trial153.stdout:(92/99): python3-typing-extensions-4.15.0-1.el9 3.9 MB/s | 86 kB 00:00 2026-02-17T20:55:51.238 INFO:teuthology.orchestra.run.trial153.stdout:(93/99): python3-websocket-client-1.2.3-2.el9.n 4.1 MB/s | 90 kB 00:00 2026-02-17T20:55:51.239 INFO:teuthology.orchestra.run.trial153.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 9.6 MB/s | 230 kB 00:00 2026-02-17T20:55:51.260 INFO:teuthology.orchestra.run.trial153.stdout:(95/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 2.2 MB/s | 48 kB 00:00 2026-02-17T20:55:51.262 INFO:teuthology.orchestra.run.trial153.stdout:(96/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 17 MB/s | 427 kB 00:00 2026-02-17T20:55:51.274 INFO:teuthology.orchestra.run.trial153.stdout:(97/99): python3-saml-1.16.0-1.el9.noarch.rpm 1.2 MB/s | 125 kB 00:00 2026-02-17T20:55:51.281 INFO:teuthology.orchestra.run.trial153.stdout:(98/99): python3-xmltodict-0.12.0-15.el9.noarch 1.0 MB/s | 22 kB 00:00 2026-02-17T20:55:51.283 INFO:teuthology.orchestra.run.trial153.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 972 kB/s | 20 kB 00:00 2026-02-17T20:55:51.283 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:55:51.283 INFO:teuthology.orchestra.run.trial153.stdout:Total 43 MB/s | 95 MB 00:02 2026-02-17T20:55:51.707 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T20:55:51.745 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T20:55:51.745 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T20:55:51.807 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: libcephsqlite-2:19.2.3-683.g76b494d6.el9.x86_64 4/5 2026-02-17T20:55:51.825 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-test-2:19.2.3-683.g76b494d6.el9.x86_64 5/5 2026-02-17T20:55:52.043 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-test-2:19.2.3-683.g76b494d6.el9.x86_64 5/5 2026-02-17T20:55:52.043 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-test-2:19.2.3-683.g76b494d6.el9.x86_64 1/5 2026-02-17T20:55:52.043 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : libcephsqlite-2:19.2.3-683.g76b494d6.el9.x86_64 2/5 2026-02-17T20:55:52.043 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 3/5 2026-02-17T20:55:52.044 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 4/5 2026-02-17T20:55:52.095 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/5 2026-02-17T20:55:52.095 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:52.095 INFO:teuthology.orchestra.run.trial104.stdout:Installed: 2026-02-17T20:55:52.095 INFO:teuthology.orchestra.run.trial104.stdout: ceph-test-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:52.095 INFO:teuthology.orchestra.run.trial104.stdout: libcephsqlite-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:52.095 INFO:teuthology.orchestra.run.trial104.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-17T20:55:52.095 INFO:teuthology.orchestra.run.trial104.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-17T20:55:52.095 INFO:teuthology.orchestra.run.trial104.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-17T20:55:52.096 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:52.096 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:55:52.131 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install ceph 2026-02-17T20:55:52.164 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T20:55:52.164 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T20:55:52.440 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:20 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:55:52.525 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:55:52.528 INFO:teuthology.orchestra.run.trial104.stdout:====================================================================================== 2026-02-17T20:55:52.528 INFO:teuthology.orchestra.run.trial104.stdout: Package Arch Version Repository Size 2026-02-17T20:55:52.528 INFO:teuthology.orchestra.run.trial104.stdout:====================================================================================== 2026-02-17T20:55:52.528 INFO:teuthology.orchestra.run.trial104.stdout:Installing: 2026-02-17T20:55:52.528 INFO:teuthology.orchestra.run.trial104.stdout: ceph x86_64 2:19.2.3-683.g76b494d6.el9 ceph 6.5 k 2026-02-17T20:55:52.528 INFO:teuthology.orchestra.run.trial104.stdout:Installing dependencies: 2026-02-17T20:55:52.528 INFO:teuthology.orchestra.run.trial104.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-17T20:55:52.528 INFO:teuthology.orchestra.run.trial104.stdout: ceph-grafana-dashboards noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 31 k 2026-02-17T20:55:52.528 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mds x86_64 2:19.2.3-683.g76b494d6.el9 ceph 2.4 M 2026-02-17T20:55:52.529 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mgr x86_64 2:19.2.3-683.g76b494d6.el9 ceph 1.1 M 2026-02-17T20:55:52.529 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mgr-modules-core noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 253 k 2026-02-17T20:55:52.529 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mon x86_64 2:19.2.3-683.g76b494d6.el9 ceph 4.7 M 2026-02-17T20:55:52.529 INFO:teuthology.orchestra.run.trial104.stdout: ceph-osd x86_64 2:19.2.3-683.g76b494d6.el9 ceph 17 M 2026-02-17T20:55:52.529 INFO:teuthology.orchestra.run.trial104.stdout: ceph-prometheus-alerts noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 17 k 2026-02-17T20:55:52.529 INFO:teuthology.orchestra.run.trial104.stdout: cephadm noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 769 k 2026-02-17T20:55:52.529 INFO:teuthology.orchestra.run.trial104.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-17T20:55:52.529 INFO:teuthology.orchestra.run.trial104.stdout: flexiblas x86_64 3.0.4-9.el9 appstream 30 k 2026-02-17T20:55:52.529 INFO:teuthology.orchestra.run.trial104.stdout: flexiblas-netlib x86_64 3.0.4-9.el9 appstream 3.0 M 2026-02-17T20:55:52.529 INFO:teuthology.orchestra.run.trial104.stdout: flexiblas-openblas-openmp x86_64 3.0.4-9.el9 appstream 15 k 2026-02-17T20:55:52.529 INFO:teuthology.orchestra.run.trial104.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-17T20:55:52.529 INFO:teuthology.orchestra.run.trial104.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-17T20:55:52.530 INFO:teuthology.orchestra.run.trial104.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-17T20:55:52.530 INFO:teuthology.orchestra.run.trial104.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-17T20:55:52.530 INFO:teuthology.orchestra.run.trial104.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-17T20:55:52.530 INFO:teuthology.orchestra.run.trial104.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-17T20:55:52.530 INFO:teuthology.orchestra.run.trial104.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-17T20:55:52.530 INFO:teuthology.orchestra.run.trial104.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-17T20:55:52.530 INFO:teuthology.orchestra.run.trial104.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-17T20:55:52.530 INFO:teuthology.orchestra.run.trial104.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-17T20:55:52.530 INFO:teuthology.orchestra.run.trial104.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-17T20:55:52.530 INFO:teuthology.orchestra.run.trial104.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-17T20:55:52.530 INFO:teuthology.orchestra.run.trial104.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-17T20:55:52.530 INFO:teuthology.orchestra.run.trial104.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-17T20:55:52.530 INFO:teuthology.orchestra.run.trial104.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-17T20:55:52.531 INFO:teuthology.orchestra.run.trial104.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-17T20:55:52.531 INFO:teuthology.orchestra.run.trial104.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-17T20:55:52.531 INFO:teuthology.orchestra.run.trial104.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-17T20:55:52.531 INFO:teuthology.orchestra.run.trial104.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-17T20:55:52.531 INFO:teuthology.orchestra.run.trial104.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-17T20:55:52.531 INFO:teuthology.orchestra.run.trial104.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-17T20:55:52.531 INFO:teuthology.orchestra.run.trial104.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-17T20:55:52.531 INFO:teuthology.orchestra.run.trial104.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-17T20:55:52.531 INFO:teuthology.orchestra.run.trial104.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-17T20:55:52.531 INFO:teuthology.orchestra.run.trial104.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-17T20:55:52.531 INFO:teuthology.orchestra.run.trial104.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-17T20:55:52.531 INFO:teuthology.orchestra.run.trial104.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-17T20:55:52.531 INFO:teuthology.orchestra.run.trial104.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-17T20:55:52.532 INFO:teuthology.orchestra.run.trial104.stdout: python3-isodate noarch 0.6.1-3.el9 epel 56 k 2026-02-17T20:55:52.532 INFO:teuthology.orchestra.run.trial104.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-17T20:55:52.532 INFO:teuthology.orchestra.run.trial104.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-17T20:55:52.532 INFO:teuthology.orchestra.run.trial104.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-17T20:55:52.532 INFO:teuthology.orchestra.run.trial104.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-17T20:55:52.532 INFO:teuthology.orchestra.run.trial104.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-17T20:55:52.532 INFO:teuthology.orchestra.run.trial104.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-17T20:55:52.532 INFO:teuthology.orchestra.run.trial104.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-17T20:55:52.532 INFO:teuthology.orchestra.run.trial104.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-17T20:55:52.532 INFO:teuthology.orchestra.run.trial104.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-17T20:55:52.532 INFO:teuthology.orchestra.run.trial104.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2026-02-17T20:55:52.532 INFO:teuthology.orchestra.run.trial104.stdout: python3-lxml x86_64 4.6.5-3.el9 appstream 1.2 M 2026-02-17T20:55:52.532 INFO:teuthology.orchestra.run.trial104.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2026-02-17T20:55:52.533 INFO:teuthology.orchestra.run.trial104.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-17T20:55:52.533 INFO:teuthology.orchestra.run.trial104.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-17T20:55:52.533 INFO:teuthology.orchestra.run.trial104.stdout: python3-msgpack x86_64 1.0.3-2.el9 epel 86 k 2026-02-17T20:55:52.533 INFO:teuthology.orchestra.run.trial104.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-17T20:55:52.533 INFO:teuthology.orchestra.run.trial104.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-17T20:55:52.533 INFO:teuthology.orchestra.run.trial104.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-17T20:55:52.533 INFO:teuthology.orchestra.run.trial104.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-17T20:55:52.533 INFO:teuthology.orchestra.run.trial104.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2026-02-17T20:55:52.533 INFO:teuthology.orchestra.run.trial104.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-17T20:55:52.533 INFO:teuthology.orchestra.run.trial104.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-17T20:55:52.533 INFO:teuthology.orchestra.run.trial104.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-17T20:55:52.533 INFO:teuthology.orchestra.run.trial104.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-17T20:55:52.533 INFO:teuthology.orchestra.run.trial104.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-17T20:55:52.534 INFO:teuthology.orchestra.run.trial104.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-17T20:55:52.534 INFO:teuthology.orchestra.run.trial104.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-17T20:55:52.534 INFO:teuthology.orchestra.run.trial104.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-17T20:55:52.534 INFO:teuthology.orchestra.run.trial104.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-17T20:55:52.534 INFO:teuthology.orchestra.run.trial104.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-17T20:55:52.534 INFO:teuthology.orchestra.run.trial104.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-17T20:55:52.534 INFO:teuthology.orchestra.run.trial104.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-17T20:55:52.534 INFO:teuthology.orchestra.run.trial104.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-17T20:55:52.534 INFO:teuthology.orchestra.run.trial104.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-17T20:55:52.534 INFO:teuthology.orchestra.run.trial104.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-17T20:55:52.534 INFO:teuthology.orchestra.run.trial104.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-17T20:55:52.534 INFO:teuthology.orchestra.run.trial104.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-17T20:55:52.534 INFO:teuthology.orchestra.run.trial104.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-17T20:55:52.535 INFO:teuthology.orchestra.run.trial104.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2026-02-17T20:55:52.535 INFO:teuthology.orchestra.run.trial104.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-17T20:55:52.535 INFO:teuthology.orchestra.run.trial104.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2026-02-17T20:55:52.535 INFO:teuthology.orchestra.run.trial104.stdout: python3-xmlsec x86_64 1.3.13-1.el9 epel 48 k 2026-02-17T20:55:52.535 INFO:teuthology.orchestra.run.trial104.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-17T20:55:52.535 INFO:teuthology.orchestra.run.trial104.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-17T20:55:52.535 INFO:teuthology.orchestra.run.trial104.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-17T20:55:52.535 INFO:teuthology.orchestra.run.trial104.stdout: xmlsec1 x86_64 1.2.29-13.el9 appstream 189 k 2026-02-17T20:55:52.535 INFO:teuthology.orchestra.run.trial104.stdout: xmlsec1-openssl x86_64 1.2.29-13.el9 appstream 90 k 2026-02-17T20:55:52.535 INFO:teuthology.orchestra.run.trial104.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-17T20:55:52.535 INFO:teuthology.orchestra.run.trial104.stdout:Installing weak dependencies: 2026-02-17T20:55:52.536 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mgr-cephadm noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 150 k 2026-02-17T20:55:52.536 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mgr-dashboard noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 3.8 M 2026-02-17T20:55:52.536 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mgr-diskprediction-local noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 7.4 M 2026-02-17T20:55:52.536 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mgr-k8sevents noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 22 k 2026-02-17T20:55:52.536 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mgr-rook noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 49 k 2026-02-17T20:55:52.536 INFO:teuthology.orchestra.run.trial104.stdout: ceph-volume noarch 2:19.2.3-683.g76b494d6.el9 ceph-noarch 299 k 2026-02-17T20:55:52.536 INFO:teuthology.orchestra.run.trial104.stdout: python3-influxdb noarch 5.3.1-1.el9 epel 139 k 2026-02-17T20:55:52.536 INFO:teuthology.orchestra.run.trial104.stdout: python3-saml noarch 1.16.0-1.el9 epel 125 k 2026-02-17T20:55:52.536 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:52.536 INFO:teuthology.orchestra.run.trial104.stdout:Transaction Summary 2026-02-17T20:55:52.536 INFO:teuthology.orchestra.run.trial104.stdout:====================================================================================== 2026-02-17T20:55:52.536 INFO:teuthology.orchestra.run.trial104.stdout:Install 99 Packages 2026-02-17T20:55:52.536 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:52.537 INFO:teuthology.orchestra.run.trial104.stdout:Total download size: 95 M 2026-02-17T20:55:52.537 INFO:teuthology.orchestra.run.trial104.stdout:Installed size: 520 M 2026-02-17T20:55:52.537 INFO:teuthology.orchestra.run.trial104.stdout:Downloading Packages: 2026-02-17T20:55:52.607 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T20:55:52.609 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T20:55:52.640 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T20:55:52.646 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T20:55:52.667 INFO:teuthology.orchestra.run.trial153.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T20:55:52.673 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T20:55:52.706 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T20:55:52.715 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T20:55:52.722 INFO:teuthology.orchestra.run.trial153.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T20:55:52.724 INFO:teuthology.orchestra.run.trial153.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T20:55:52.728 INFO:teuthology.orchestra.run.trial153.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T20:55:52.751 INFO:teuthology.orchestra.run.trial153.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T20:55:52.764 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T20:55:52.768 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T20:55:52.774 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T20:55:52.776 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T20:55:52.787 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T20:55:52.794 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T20:55:52.818 INFO:teuthology.orchestra.run.trial153.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T20:55:52.822 INFO:teuthology.orchestra.run.trial153.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T20:55:52.829 INFO:teuthology.orchestra.run.trial153.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T20:55:52.854 INFO:teuthology.orchestra.run.trial153.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T20:55:52.905 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T20:55:52.916 INFO:teuthology.orchestra.run.trial104.stdout:(1/99): ceph-19.2.3-683.g76b494d6.el9.x86_64.rp 131 kB/s | 6.5 kB 00:00 2026-02-17T20:55:52.918 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T20:55:52.920 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T20:55:52.925 INFO:teuthology.orchestra.run.trial153.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T20:55:52.930 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T20:55:52.935 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T20:55:52.938 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T20:55:52.953 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T20:55:52.973 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T20:55:52.978 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T20:55:52.983 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T20:55:52.994 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T20:55:53.002 INFO:teuthology.orchestra.run.trial104.stdout:(2/99): ceph-mgr-19.2.3-683.g76b494d6.el9.x86_6 8.0 MB/s | 1.1 MB 00:00 2026-02-17T20:55:53.003 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T20:55:53.009 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T20:55:53.029 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T20:55:53.038 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T20:55:53.066 INFO:teuthology.orchestra.run.trial104.stdout:(3/99): ceph-mds-19.2.3-683.g76b494d6.el9.x86_6 12 MB/s | 2.4 MB 00:00 2026-02-17T20:55:53.092 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T20:55:53.099 INFO:teuthology.orchestra.run.trial104.stdout:(4/99): ceph-grafana-dashboards-19.2.3-683.g76b 944 kB/s | 31 kB 00:00 2026-02-17T20:55:53.104 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T20:55:53.120 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T20:55:53.124 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T20:55:53.132 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T20:55:53.135 INFO:teuthology.orchestra.run.trial104.stdout:(5/99): ceph-mgr-cephadm-19.2.3-683.g76b494d6.e 4.1 MB/s | 150 kB 00:00 2026-02-17T20:55:53.157 INFO:teuthology.orchestra.run.trial104.stdout:(6/99): ceph-mon-19.2.3-683.g76b494d6.el9.x86_6 20 MB/s | 4.7 MB 00:00 2026-02-17T20:55:53.172 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T20:55:53.336 INFO:teuthology.orchestra.run.trial104.stdout:(7/99): ceph-mgr-dashboard-19.2.3-683.g76b494d6 19 MB/s | 3.8 MB 00:00 2026-02-17T20:55:53.379 INFO:teuthology.orchestra.run.trial104.stdout:(8/99): ceph-mgr-k8sevents-19.2.3-683.g76b494d6 515 kB/s | 22 kB 00:00 2026-02-17T20:55:53.428 INFO:teuthology.orchestra.run.trial104.stdout:(9/99): ceph-mgr-modules-core-19.2.3-683.g76b49 5.0 MB/s | 253 kB 00:00 2026-02-17T20:55:53.475 INFO:teuthology.orchestra.run.trial104.stdout:(10/99): ceph-mgr-rook-19.2.3-683.g76b494d6.el9 1.0 MB/s | 49 kB 00:00 2026-02-17T20:55:53.496 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T20:55:53.506 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T20:55:53.510 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T20:55:53.512 INFO:teuthology.orchestra.run.trial104.stdout:(11/99): ceph-mgr-diskprediction-local-19.2.3-6 21 MB/s | 7.4 MB 00:00 2026-02-17T20:55:53.512 INFO:teuthology.orchestra.run.trial104.stdout:(12/99): ceph-prometheus-alerts-19.2.3-683.g76b 447 kB/s | 17 kB 00:00 2026-02-17T20:55:53.519 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T20:55:53.521 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T20:55:53.546 INFO:teuthology.orchestra.run.trial104.stdout:(13/99): ceph-volume-19.2.3-683.g76b494d6.el9.n 8.6 MB/s | 299 kB 00:00 2026-02-17T20:55:53.549 INFO:teuthology.orchestra.run.trial153.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T20:55:53.560 INFO:teuthology.orchestra.run.trial104.stdout:(14/99): cephadm-19.2.3-683.g76b494d6.el9.noarc 16 MB/s | 769 kB 00:00 2026-02-17T20:55:53.589 INFO:teuthology.orchestra.run.trial104.stdout:(15/99): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.4 MB/s | 40 kB 00:00 2026-02-17T20:55:53.594 INFO:teuthology.orchestra.run.trial153.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T20:55:53.596 INFO:teuthology.orchestra.run.trial104.stdout:(16/99): cryptsetup-2.8.1-2.el9.x86_64.rpm 6.9 MB/s | 350 kB 00:00 2026-02-17T20:55:53.601 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T20:55:53.604 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T20:55:53.610 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T20:55:53.614 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T20:55:53.621 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T20:55:53.621 INFO:teuthology.orchestra.run.trial104.stdout:(17/99): ceph-osd-19.2.3-683.g76b494d6.el9.x86_ 28 MB/s | 17 MB 00:00 2026-02-17T20:55:53.622 INFO:teuthology.orchestra.run.trial104.stdout:(18/99): libconfig-1.7.2-9.el9.x86_64.rpm 2.1 MB/s | 72 kB 00:00 2026-02-17T20:55:53.624 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T20:55:53.636 INFO:teuthology.orchestra.run.trial104.stdout:(19/99): libgfortran-11.5.0-14.el9.x86_64.rpm 20 MB/s | 794 kB 00:00 2026-02-17T20:55:53.652 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T20:55:53.653 INFO:teuthology.orchestra.run.trial104.stdout:(20/99): python3-cffi-1.14.5-5.el9.x86_64.rpm 8.1 MB/s | 253 kB 00:00 2026-02-17T20:55:53.662 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T20:55:53.664 INFO:teuthology.orchestra.run.trial104.stdout:(21/99): python3-ply-3.11-14.el9.noarch.rpm 9.5 MB/s | 106 kB 00:00 2026-02-17T20:55:53.665 INFO:teuthology.orchestra.run.trial104.stdout:(22/99): libquadmath-11.5.0-14.el9.x86_64.rpm 4.1 MB/s | 184 kB 00:00 2026-02-17T20:55:53.669 INFO:teuthology.orchestra.run.trial104.stdout:(23/99): python3-cryptography-36.0.1-5.el9.x86_ 37 MB/s | 1.2 MB 00:00 2026-02-17T20:55:53.676 INFO:teuthology.orchestra.run.trial104.stdout:(24/99): python3-pycparser-2.20-6.el9.noarch.rp 11 MB/s | 135 kB 00:00 2026-02-17T20:55:53.677 INFO:teuthology.orchestra.run.trial104.stdout:(25/99): python3-pyparsing-2.4.7-9.el9.noarch.r 12 MB/s | 150 kB 00:00 2026-02-17T20:55:53.679 INFO:teuthology.orchestra.run.trial104.stdout:(26/99): python3-requests-2.25.1-10.el9.noarch. 12 MB/s | 126 kB 00:00 2026-02-17T20:55:53.689 INFO:teuthology.orchestra.run.trial104.stdout:(27/99): unzip-6.0-59.el9.x86_64.rpm 16 MB/s | 182 kB 00:00 2026-02-17T20:55:53.689 INFO:teuthology.orchestra.run.trial104.stdout:(28/99): zip-3.0-35.el9.x86_64.rpm 25 MB/s | 266 kB 00:00 2026-02-17T20:55:53.690 INFO:teuthology.orchestra.run.trial104.stdout:(29/99): python3-urllib3-1.26.5-7.el9.noarch.rp 15 MB/s | 218 kB 00:00 2026-02-17T20:55:53.696 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T20:55:53.704 INFO:teuthology.orchestra.run.trial104.stdout:(30/99): flexiblas-openblas-openmp-3.0.4-9.el9. 1.1 MB/s | 15 kB 00:00 2026-02-17T20:55:53.704 INFO:teuthology.orchestra.run.trial104.stdout:(31/99): flexiblas-3.0.4-9.el9.x86_64.rpm 1.9 MB/s | 30 kB 00:00 2026-02-17T20:55:53.715 INFO:teuthology.orchestra.run.trial104.stdout:(32/99): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 21 MB/s | 246 kB 00:00 2026-02-17T20:55:53.716 INFO:teuthology.orchestra.run.trial104.stdout:(33/99): lua-5.4.4-4.el9.x86_64.rpm 15 MB/s | 188 kB 00:00 2026-02-17T20:55:53.720 INFO:teuthology.orchestra.run.trial104.stdout:(34/99): openblas-0.3.29-1.el9.x86_64.rpm 9.6 MB/s | 42 kB 00:00 2026-02-17T20:55:53.750 INFO:teuthology.orchestra.run.trial104.stdout:(35/99): protobuf-3.14.0-17.el9.x86_64.rpm 33 MB/s | 1.0 MB 00:00 2026-02-17T20:55:53.764 INFO:teuthology.orchestra.run.trial104.stdout:(36/99): flexiblas-netlib-3.0.4-9.el9.x86_64.rp 40 MB/s | 3.0 MB 00:00 2026-02-17T20:55:53.773 INFO:teuthology.orchestra.run.trial104.stdout:(37/99): python3-devel-3.9.25-2.el9.x86_64.rpm 30 MB/s | 244 kB 00:00 2026-02-17T20:55:53.786 INFO:teuthology.orchestra.run.trial104.stdout:(38/99): python3-jinja2-2.11.3-8.el9.noarch.rpm 19 MB/s | 249 kB 00:00 2026-02-17T20:55:53.794 INFO:teuthology.orchestra.run.trial104.stdout:(39/99): python3-libstoragemgmt-1.10.1-1.el9.x8 19 MB/s | 177 kB 00:00 2026-02-17T20:55:53.806 INFO:teuthology.orchestra.run.trial104.stdout:(40/99): python3-babel-2.9.1-2.el9.noarch.rpm 108 MB/s | 6.0 MB 00:00 2026-02-17T20:55:53.813 INFO:teuthology.orchestra.run.trial104.stdout:(41/99): python3-mako-1.1.4-6.el9.noarch.rpm 24 MB/s | 172 kB 00:00 2026-02-17T20:55:53.817 INFO:teuthology.orchestra.run.trial104.stdout:(42/99): python3-markupsafe-1.1.1-12.el9.x86_64 7.3 MB/s | 35 kB 00:00 2026-02-17T20:55:53.821 INFO:teuthology.orchestra.run.trial104.stdout:(43/99): python3-lxml-4.6.5-3.el9.x86_64.rpm 47 MB/s | 1.2 MB 00:00 2026-02-17T20:55:53.831 INFO:teuthology.orchestra.run.trial104.stdout:(44/99): python3-numpy-f2py-1.23.5-2.el9.x86_64 41 MB/s | 442 kB 00:00 2026-02-17T20:55:53.838 INFO:teuthology.orchestra.run.trial104.stdout:(45/99): python3-packaging-20.9-5.el9.noarch.rp 11 MB/s | 77 kB 00:00 2026-02-17T20:55:53.846 INFO:teuthology.orchestra.run.trial104.stdout:(46/99): openblas-openmp-0.3.29-1.el9.x86_64.rp 41 MB/s | 5.3 MB 00:00 2026-02-17T20:55:53.847 INFO:teuthology.orchestra.run.trial104.stdout:(47/99): python3-protobuf-3.14.0-17.el9.noarch. 28 MB/s | 267 kB 00:00 2026-02-17T20:55:53.853 INFO:teuthology.orchestra.run.trial104.stdout:(48/99): python3-pyasn1-0.4.8-6.el9.noarch.rpm 23 MB/s | 159 kB 00:00 2026-02-17T20:55:53.861 INFO:teuthology.orchestra.run.trial104.stdout:(49/99): python3-numpy-1.23.5-2.el9.x86_64.rpm 140 MB/s | 6.1 MB 00:00 2026-02-17T20:55:53.862 INFO:teuthology.orchestra.run.trial104.stdout:(50/99): python3-requests-oauthlib-1.3.0-12.el9 6.0 MB/s | 54 kB 00:00 2026-02-17T20:55:53.863 INFO:teuthology.orchestra.run.trial104.stdout:(51/99): python3-pyasn1-modules-0.4.8-6.el9.noa 18 MB/s | 279 kB 00:00 2026-02-17T20:55:53.867 INFO:teuthology.orchestra.run.trial104.stdout:(52/99): python3-toml-0.10.2-6.el9.noarch.rpm 8.1 MB/s | 42 kB 00:00 2026-02-17T20:55:53.870 INFO:teuthology.orchestra.run.trial104.stdout:(53/99): xmlsec1-1.2.29-13.el9.x86_64.rpm 28 MB/s | 189 kB 00:00 2026-02-17T20:55:53.872 INFO:teuthology.orchestra.run.trial104.stdout:(54/99): xmlsec1-openssl-1.2.29-13.el9.x86_64.r 18 MB/s | 90 kB 00:00 2026-02-17T20:55:53.878 INFO:teuthology.orchestra.run.trial104.stdout:(55/99): lua-devel-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 22 kB 00:00 2026-02-17T20:55:53.898 INFO:teuthology.orchestra.run.trial104.stdout:(56/99): protobuf-compiler-3.14.0-17.el9.x86_64 32 MB/s | 862 kB 00:00 2026-02-17T20:55:53.915 INFO:teuthology.orchestra.run.trial104.stdout:(57/99): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2026-02-17T20:55:53.918 INFO:teuthology.orchestra.run.trial104.stdout:(58/99): abseil-cpp-20211102.0-4.el9.x86_64.rpm 13 MB/s | 551 kB 00:00 2026-02-17T20:55:53.922 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T20:55:53.925 INFO:teuthology.orchestra.run.trial104.stdout:(59/99): python3-asyncssh-2.13.2-5.el9.noarch.r 84 MB/s | 548 kB 00:00 2026-02-17T20:55:53.925 INFO:teuthology.orchestra.run.trial104.stdout:(60/99): luarocks-3.9.2-5.el9.noarch.rpm 14 MB/s | 151 kB 00:00 2026-02-17T20:55:53.945 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T20:55:53.949 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T20:55:53.952 INFO:teuthology.orchestra.run.trial104.stdout:(61/99): python3-scipy-1.9.3-2.el9.x86_64.rpm 214 MB/s | 19 MB 00:00 2026-02-17T20:55:53.952 INFO:teuthology.orchestra.run.trial104.stdout:(62/99): python3-autocommand-2.2.2-8.el9.noarch 1.1 MB/s | 29 kB 00:00 2026-02-17T20:55:53.953 INFO:teuthology.orchestra.run.trial104.stdout:(63/99): python3-backports-tarfile-1.2.0-1.el9. 2.2 MB/s | 60 kB 00:00 2026-02-17T20:55:53.958 INFO:teuthology.orchestra.run.trial104.stdout:(64/99): python3-certifi-2023.05.07-4.el9.noarc 2.4 MB/s | 14 kB 00:00 2026-02-17T20:55:53.959 INFO:teuthology.orchestra.run.trial104.stdout:(65/99): python3-cachetools-4.2.4-1.el9.noarch. 4.7 MB/s | 32 kB 00:00 2026-02-17T20:55:53.964 INFO:teuthology.orchestra.run.trial104.stdout:(66/99): python3-cheroot-10.0.1-4.el9.noarch.rp 33 MB/s | 173 kB 00:00 2026-02-17T20:55:53.964 INFO:teuthology.orchestra.run.trial104.stdout:(67/99): python3-cherrypy-18.6.1-2.el9.noarch.r 63 MB/s | 358 kB 00:00 2026-02-17T20:55:53.969 INFO:teuthology.orchestra.run.trial104.stdout:(68/99): python3-google-auth-2.45.0-1.el9.noarc 49 MB/s | 254 kB 00:00 2026-02-17T20:55:53.970 INFO:teuthology.orchestra.run.trial104.stdout:(69/99): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.3 MB/s | 43 kB 00:00 2026-02-17T20:55:53.975 INFO:teuthology.orchestra.run.trial104.stdout:(70/99): python3-grpcio-1.46.7-10.el9.x86_64.rp 201 MB/s | 2.0 MB 00:00 2026-02-17T20:55:53.975 INFO:teuthology.orchestra.run.trial104.stdout:(71/99): python3-grpcio-tools-1.46.7-10.el9.x86 22 MB/s | 144 kB 00:00 2026-02-17T20:55:53.978 INFO:teuthology.orchestra.run.trial104.stdout:(72/99): python3-isodate-0.6.1-3.el9.noarch.rpm 16 MB/s | 56 kB 00:00 2026-02-17T20:55:53.978 INFO:teuthology.orchestra.run.trial104.stdout:(73/99): python3-jaraco-8.2.1-3.el9.noarch.rpm 3.2 MB/s | 11 kB 00:00 2026-02-17T20:55:53.979 INFO:teuthology.orchestra.run.trial104.stdout:(74/99): python3-influxdb-5.3.1-1.el9.noarch.rp 15 MB/s | 139 kB 00:00 2026-02-17T20:55:53.981 INFO:teuthology.orchestra.run.trial104.stdout:(75/99): python3-jaraco-classes-3.2.1-5.el9.noa 5.3 MB/s | 18 kB 00:00 2026-02-17T20:55:53.982 INFO:teuthology.orchestra.run.trial104.stdout:(76/99): python3-jaraco-collections-3.0.0-8.el9 6.7 MB/s | 23 kB 00:00 2026-02-17T20:55:53.982 INFO:teuthology.orchestra.run.trial104.stdout:(77/99): python3-jaraco-context-6.0.1-3.el9.noa 5.8 MB/s | 20 kB 00:00 2026-02-17T20:55:53.985 INFO:teuthology.orchestra.run.trial104.stdout:(78/99): python3-jaraco-functools-3.5.0-2.el9.n 6.0 MB/s | 19 kB 00:00 2026-02-17T20:55:53.985 INFO:teuthology.orchestra.run.trial104.stdout:(79/99): python3-jaraco-text-4.0.0-2.el9.noarch 8.4 MB/s | 26 kB 00:00 2026-02-17T20:55:53.988 INFO:teuthology.orchestra.run.trial104.stdout:(80/99): python3-logutils-0.3.5-21.el9.noarch.r 14 MB/s | 46 kB 00:00 2026-02-17T20:55:53.989 INFO:teuthology.orchestra.run.trial104.stdout:(81/99): python3-more-itertools-8.12.0-2.el9.no 22 MB/s | 79 kB 00:00 2026-02-17T20:55:53.992 INFO:teuthology.orchestra.run.trial104.stdout:(82/99): python3-msgpack-1.0.3-2.el9.x86_64.rpm 24 MB/s | 86 kB 00:00 2026-02-17T20:55:53.993 INFO:teuthology.orchestra.run.trial104.stdout:(83/99): python3-natsort-7.1.1-5.el9.noarch.rpm 16 MB/s | 58 kB 00:00 2026-02-17T20:55:53.995 INFO:teuthology.orchestra.run.trial104.stdout:(84/99): python3-kubernetes-26.1.0-3.el9.noarch 81 MB/s | 1.0 MB 00:00 2026-02-17T20:55:53.996 INFO:teuthology.orchestra.run.trial104.stdout:(85/99): python3-portend-3.1.0-2.el9.noarch.rpm 5.3 MB/s | 16 kB 00:00 2026-02-17T20:55:53.997 INFO:teuthology.orchestra.run.trial104.stdout:(86/99): python3-pecan-1.4.2-3.el9.noarch.rpm 57 MB/s | 272 kB 00:00 2026-02-17T20:55:53.999 INFO:teuthology.orchestra.run.trial104.stdout:(87/99): python3-pyOpenSSL-21.0.0-1.el9.noarch. 27 MB/s | 90 kB 00:00 2026-02-17T20:55:53.999 INFO:teuthology.orchestra.run.trial104.stdout:(88/99): python3-repoze-lru-0.7-16.el9.noarch.r 9.2 MB/s | 31 kB 00:00 2026-02-17T20:55:54.004 INFO:teuthology.orchestra.run.trial104.stdout:(89/99): python3-rsa-4.9-2.el9.noarch.rpm 12 MB/s | 59 kB 00:00 2026-02-17T20:55:54.004 INFO:teuthology.orchestra.run.trial104.stdout:(90/99): python3-routes-2.5.1-5.el9.noarch.rpm 24 MB/s | 188 kB 00:00 2026-02-17T20:55:54.005 INFO:teuthology.orchestra.run.trial104.stdout:(91/99): python3-saml-1.16.0-1.el9.noarch.rpm 21 MB/s | 125 kB 00:00 2026-02-17T20:55:54.007 INFO:teuthology.orchestra.run.trial104.stdout:(92/99): python3-tempora-5.0.0-2.el9.noarch.rpm 11 MB/s | 36 kB 00:00 2026-02-17T20:55:54.008 INFO:teuthology.orchestra.run.trial153.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T20:55:54.008 INFO:teuthology.orchestra.run.trial104.stdout:(93/99): python3-typing-extensions-4.15.0-1.el9 25 MB/s | 86 kB 00:00 2026-02-17T20:55:54.009 INFO:teuthology.orchestra.run.trial104.stdout:(94/99): python3-webob-1.8.8-2.el9.noarch.rpm 50 MB/s | 230 kB 00:00 2026-02-17T20:55:54.010 INFO:teuthology.orchestra.run.trial153.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T20:55:54.010 INFO:teuthology.orchestra.run.trial104.stdout:(95/99): python3-websocket-client-1.2.3-2.el9.n 27 MB/s | 90 kB 00:00 2026-02-17T20:55:54.012 INFO:teuthology.orchestra.run.trial104.stdout:(96/99): python3-werkzeug-2.0.3-3.el9.1.noarch. 98 MB/s | 427 kB 00:00 2026-02-17T20:55:54.013 INFO:teuthology.orchestra.run.trial104.stdout:(97/99): python3-xmlsec-1.3.13-1.el9.x86_64.rpm 15 MB/s | 48 kB 00:00 2026-02-17T20:55:54.014 INFO:teuthology.orchestra.run.trial104.stdout:(98/99): python3-xmltodict-0.12.0-15.el9.noarch 6.1 MB/s | 22 kB 00:00 2026-02-17T20:55:54.016 INFO:teuthology.orchestra.run.trial104.stdout:(99/99): python3-zc-lockfile-2.0-10.el9.noarch. 5.5 MB/s | 20 kB 00:00 2026-02-17T20:55:54.019 INFO:teuthology.orchestra.run.trial104.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:55:54.019 INFO:teuthology.orchestra.run.trial104.stdout:Total 64 MB/s | 95 MB 00:01 2026-02-17T20:55:54.031 INFO:teuthology.orchestra.run.trial153.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T20:55:54.356 INFO:teuthology.orchestra.run.trial153.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T20:55:54.430 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T20:55:54.466 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction check 2026-02-17T20:55:54.504 INFO:teuthology.orchestra.run.trial104.stdout:Transaction check succeeded. 2026-02-17T20:55:54.505 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction test 2026-02-17T20:55:54.921 INFO:teuthology.orchestra.run.trial104.stdout:Transaction test succeeded. 2026-02-17T20:55:54.921 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction 2026-02-17T20:55:55.106 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T20:55:55.123 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T20:55:55.133 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T20:55:55.140 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T20:55:55.153 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T20:55:55.169 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T20:55:55.245 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T20:55:55.254 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T20:55:55.277 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T20:55:55.307 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T20:55:55.358 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T20:55:55.362 INFO:teuthology.orchestra.run.trial104.stdout: Preparing : 1/1 2026-02-17T20:55:55.364 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T20:55:55.364 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/99 2026-02-17T20:55:55.367 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T20:55:55.368 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T20:55:55.386 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:55:55.386 INFO:teuthology.orchestra.run.trial153.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T20:55:55.387 INFO:teuthology.orchestra.run.trial153.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T20:55:55.387 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:55.395 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:55:55.396 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/99 2026-02-17T20:55:55.401 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 3/99 2026-02-17T20:55:55.423 INFO:teuthology.orchestra.run.trial104.stdout: Installing : xmlsec1-1.2.29-13.el9.x86_64 4/99 2026-02-17T20:55:55.423 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:55:55.423 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T20:55:55.423 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:55.429 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 5/99 2026-02-17T20:55:55.459 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T20:55:55.462 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 6/99 2026-02-17T20:55:55.471 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-lxml-4.6.5-3.el9.x86_64 7/99 2026-02-17T20:55:55.477 INFO:teuthology.orchestra.run.trial104.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 8/99 2026-02-17T20:55:55.479 INFO:teuthology.orchestra.run.trial104.stdout: Installing : lua-5.4.4-4.el9.x86_64 9/99 2026-02-17T20:55:55.483 INFO:teuthology.orchestra.run.trial104.stdout: Installing : flexiblas-3.0.4-9.el9.x86_64 10/99 2026-02-17T20:55:55.507 INFO:teuthology.orchestra.run.trial104.stdout: Installing : unzip-6.0-59.el9.x86_64 11/99 2026-02-17T20:55:55.520 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 12/99 2026-02-17T20:55:55.523 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 13/99 2026-02-17T20:55:55.523 INFO:teuthology.orchestra.run.trial153.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T20:55:55.525 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-volume-2:19.2.3-683.g76b494d6.el9.noarch 85/99 2026-02-17T20:55:55.529 INFO:teuthology.orchestra.run.trial104.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 14/99 2026-02-17T20:55:55.531 INFO:teuthology.orchestra.run.trial104.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 15/99 2026-02-17T20:55:55.539 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-volume-2:19.2.3-683.g76b494d6.el9.noarch 85/99 2026-02-17T20:55:55.540 INFO:teuthology.orchestra.run.trial153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:55:55.540 INFO:teuthology.orchestra.run.trial153.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T20:55:55.540 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:55.542 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 16/99 2026-02-17T20:55:55.548 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 17/99 2026-02-17T20:55:55.573 INFO:teuthology.orchestra.run.trial104.stdout: Installing : zip-3.0-35.el9.x86_64 18/99 2026-02-17T20:55:55.576 INFO:teuthology.orchestra.run.trial104.stdout: Installing : luarocks-3.9.2-5.el9.noarch 19/99 2026-02-17T20:55:55.584 INFO:teuthology.orchestra.run.trial104.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 20/99 2026-02-17T20:55:55.608 INFO:teuthology.orchestra.run.trial104.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 21/99 2026-02-17T20:55:55.660 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 22/99 2026-02-17T20:55:55.673 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 23/99 2026-02-17T20:55:55.676 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-rsa-4.9-2.el9.noarch 24/99 2026-02-17T20:55:55.680 INFO:teuthology.orchestra.run.trial104.stdout: Installing : xmlsec1-openssl-1.2.29-13.el9.x86_64 25/99 2026-02-17T20:55:55.686 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-xmlsec-1.3.13-1.el9.x86_64 26/99 2026-02-17T20:55:55.691 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 27/99 2026-02-17T20:55:55.694 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 28/99 2026-02-17T20:55:55.708 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 29/99 2026-02-17T20:55:55.729 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 30/99 2026-02-17T20:55:55.734 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 31/99 2026-02-17T20:55:55.739 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 32/99 2026-02-17T20:55:55.751 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 33/99 2026-02-17T20:55:55.760 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 34/99 2026-02-17T20:55:55.766 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 35/99 2026-02-17T20:55:55.786 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-msgpack-1.0.3-2.el9.x86_64 36/99 2026-02-17T20:55:55.795 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-influxdb-5.3.1-1.el9.noarch 37/99 2026-02-17T20:55:55.851 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 38/99 2026-02-17T20:55:55.863 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 39/99 2026-02-17T20:55:55.878 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-isodate-0.6.1-3.el9.noarch 40/99 2026-02-17T20:55:55.883 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-saml-1.16.0-1.el9.noarch 41/99 2026-02-17T20:55:55.891 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 42/99 2026-02-17T20:55:55.932 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 43/99 2026-02-17T20:55:56.251 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-osd-2:19.2.3-683.g76b494d6.el9.x86_64 86/99 2026-02-17T20:55:56.261 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 44/99 2026-02-17T20:55:56.271 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 45/99 2026-02-17T20:55:56.276 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-osd-2:19.2.3-683.g76b494d6.el9.x86_64 86/99 2026-02-17T20:55:56.276 INFO:teuthology.orchestra.run.trial153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:55:56.276 INFO:teuthology.orchestra.run.trial153.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T20:55:56.276 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T20:55:56.276 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T20:55:56.276 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:56.277 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 46/99 2026-02-17T20:55:56.282 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 47/99 2026-02-17T20:55:56.284 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 48/99 2026-02-17T20:55:56.313 INFO:teuthology.orchestra.run.trial104.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 49/99 2026-02-17T20:55:56.331 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: cephadm-2:19.2.3-683.g76b494d6.el9.noarch 87/99 2026-02-17T20:55:56.333 INFO:teuthology.orchestra.run.trial153.stdout: Installing : cephadm-2:19.2.3-683.g76b494d6.el9.noarch 87/99 2026-02-17T20:55:56.338 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-683.g76b494d6.el9. 88/99 2026-02-17T20:55:56.357 INFO:teuthology.orchestra.run.trial104.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 50/99 2026-02-17T20:55:56.358 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-683.g76b494d6.el9 89/99 2026-02-17T20:55:56.359 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-683.g76b494d6.el9.noarch 90/99 2026-02-17T20:55:56.364 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 51/99 2026-02-17T20:55:56.367 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 52/99 2026-02-17T20:55:56.373 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 53/99 2026-02-17T20:55:56.378 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 54/99 2026-02-17T20:55:56.385 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 55/99 2026-02-17T20:55:56.389 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 56/99 2026-02-17T20:55:56.417 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 57/99 2026-02-17T20:55:56.427 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 58/99 2026-02-17T20:55:56.463 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 59/99 2026-02-17T20:55:56.690 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 60/99 2026-02-17T20:55:56.714 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 61/99 2026-02-17T20:55:56.718 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 62/99 2026-02-17T20:55:56.777 INFO:teuthology.orchestra.run.trial104.stdout: Installing : openblas-0.3.29-1.el9.x86_64 63/99 2026-02-17T20:55:56.778 INFO:teuthology.orchestra.run.trial104.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 64/99 2026-02-17T20:55:56.800 INFO:teuthology.orchestra.run.trial104.stdout: Installing : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 65/99 2026-02-17T20:55:56.852 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-683.g76b494d6.el9.noarch 90/99 2026-02-17T20:55:56.855 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-683.g76b494d6.el9.noar 91/99 2026-02-17T20:55:57.131 INFO:teuthology.orchestra.run.trial104.stdout: Installing : flexiblas-netlib-3.0.4-9.el9.x86_64 66/99 2026-02-17T20:55:57.205 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 67/99 2026-02-17T20:55:57.313 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-683.g76b494d6.el9.noar 91/99 2026-02-17T20:55:57.314 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-683.g76b494 92/99 2026-02-17T20:55:57.328 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-683.g76b494 92/99 2026-02-17T20:55:57.329 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-683.g76b494d6.el9.noar 93/99 2026-02-17T20:55:57.385 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-683.g76b494d6.el9.noar 93/99 2026-02-17T20:55:57.435 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-683.g76b494d6.el9.n 94/99 2026-02-17T20:55:57.436 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mgr-2:19.2.3-683.g76b494d6.el9.x86_64 95/99 2026-02-17T20:55:57.457 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mgr-2:19.2.3-683.g76b494d6.el9.x86_64 95/99 2026-02-17T20:55:57.457 INFO:teuthology.orchestra.run.trial153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:55:57.457 INFO:teuthology.orchestra.run.trial153.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T20:55:57.457 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T20:55:57.458 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T20:55:57.458 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:57.469 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mgr-rook-2:19.2.3-683.g76b494d6.el9.noarch 96/99 2026-02-17T20:55:57.693 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-683.g76b494d6.el9.noarch 96/99 2026-02-17T20:55:57.695 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mon-2:19.2.3-683.g76b494d6.el9.x86_64 97/99 2026-02-17T20:55:57.716 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mon-2:19.2.3-683.g76b494d6.el9.x86_64 97/99 2026-02-17T20:55:57.716 INFO:teuthology.orchestra.run.trial153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:55:57.716 INFO:teuthology.orchestra.run.trial153.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T20:55:57.716 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T20:55:57.716 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T20:55:57.717 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:57.819 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-mds-2:19.2.3-683.g76b494d6.el9.x86_64 98/99 2026-02-17T20:55:57.841 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-mds-2:19.2.3-683.g76b494d6.el9.x86_64 98/99 2026-02-17T20:55:57.841 INFO:teuthology.orchestra.run.trial153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:55:57.841 INFO:teuthology.orchestra.run.trial153.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T20:55:57.841 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T20:55:57.841 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T20:55:57.841 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:57.860 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-2:19.2.3-683.g76b494d6.el9.x86_64 99/99 2026-02-17T20:55:57.888 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 68/99 2026-02-17T20:55:57.905 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 69/99 2026-02-17T20:55:57.916 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 70/99 2026-02-17T20:55:57.923 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-packaging-20.9-5.el9.noarch 71/99 2026-02-17T20:55:57.936 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-ply-3.11-14.el9.noarch 72/99 2026-02-17T20:55:57.952 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 73/99 2026-02-17T20:55:58.029 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 74/99 2026-02-17T20:55:58.038 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 75/99 2026-02-17T20:55:58.061 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 76/99 2026-02-17T20:55:58.092 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 77/99 2026-02-17T20:55:58.143 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/99 2026-02-17T20:55:58.149 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 79/99 2026-02-17T20:55:58.153 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 80/99 2026-02-17T20:55:58.154 INFO:teuthology.orchestra.run.trial104.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 81/99 2026-02-17T20:55:58.173 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:55:58.173 INFO:teuthology.orchestra.run.trial104.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-17T20:55:58.173 INFO:teuthology.orchestra.run.trial104.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-17T20:55:58.173 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:58.181 INFO:teuthology.orchestra.run.trial104.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:55:58.205 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 82/99 2026-02-17T20:55:58.205 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-17T20:55:58.205 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:58.240 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 83/99 2026-02-17T20:55:58.304 INFO:teuthology.orchestra.run.trial104.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 84/99 2026-02-17T20:55:58.306 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-volume-2:19.2.3-683.g76b494d6.el9.noarch 85/99 2026-02-17T20:55:58.319 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-volume-2:19.2.3-683.g76b494d6.el9.noarch 85/99 2026-02-17T20:55:58.319 INFO:teuthology.orchestra.run.trial104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:55:58.319 INFO:teuthology.orchestra.run.trial104.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-17T20:55:58.319 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:58.479 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-2:19.2.3-683.g76b494d6.el9.x86_64 99/99 2026-02-17T20:55:58.479 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-2:19.2.3-683.g76b494d6.el9.x86_64 1/99 2026-02-17T20:55:58.479 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mds-2:19.2.3-683.g76b494d6.el9.x86_64 2/99 2026-02-17T20:55:58.479 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mgr-2:19.2.3-683.g76b494d6.el9.x86_64 3/99 2026-02-17T20:55:58.479 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mon-2:19.2.3-683.g76b494d6.el9.x86_64 4/99 2026-02-17T20:55:58.479 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-osd-2:19.2.3-683.g76b494d6.el9.x86_64 5/99 2026-02-17T20:55:58.479 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-683.g76b494d6.el9 6/99 2026-02-17T20:55:58.480 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-683.g76b494d6.el9.noarch 7/99 2026-02-17T20:55:58.480 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-683.g76b494d6.el9.noar 8/99 2026-02-17T20:55:58.480 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-683.g76b494 9/99 2026-02-17T20:55:58.480 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-683.g76b494d6.el9.noar 10/99 2026-02-17T20:55:58.480 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-683.g76b494d6.el9.n 11/99 2026-02-17T20:55:58.480 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-mgr-rook-2:19.2.3-683.g76b494d6.el9.noarch 12/99 2026-02-17T20:55:58.480 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-683.g76b494d6.el9. 13/99 2026-02-17T20:55:58.480 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-volume-2:19.2.3-683.g76b494d6.el9.noarch 14/99 2026-02-17T20:55:58.480 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : cephadm-2:19.2.3-683.g76b494d6.el9.noarch 15/99 2026-02-17T20:55:58.480 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T20:55:58.480 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T20:55:58.480 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T20:55:58.481 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T20:55:58.481 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T20:55:58.481 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T20:55:58.481 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T20:55:58.481 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T20:55:58.481 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T20:55:58.481 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T20:55:58.481 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T20:55:58.481 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T20:55:58.481 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T20:55:58.481 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T20:55:58.481 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T20:55:58.481 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T20:55:58.482 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T20:55:58.482 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T20:55:58.482 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T20:55:58.482 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T20:55:58.482 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T20:55:58.482 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T20:55:58.482 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T20:55:58.482 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T20:55:58.482 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T20:55:58.482 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T20:55:58.482 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T20:55:58.482 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T20:55:58.482 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T20:55:58.483 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T20:55:58.483 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T20:55:58.483 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T20:55:58.483 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T20:55:58.483 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T20:55:58.483 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T20:55:58.483 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T20:55:58.483 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T20:55:58.483 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T20:55:58.483 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T20:55:58.483 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T20:55:58.483 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T20:55:58.483 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T20:55:58.484 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T20:55:58.484 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T20:55:58.484 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T20:55:58.484 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T20:55:58.484 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T20:55:58.484 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T20:55:58.484 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T20:55:58.484 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T20:55:58.484 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T20:55:58.484 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T20:55:58.484 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T20:55:58.484 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T20:55:58.484 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T20:55:58.485 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T20:55:58.485 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T20:55:58.485 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T20:55:58.485 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T20:55:58.485 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T20:55:58.485 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T20:55:58.485 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T20:55:58.485 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T20:55:58.485 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T20:55:58.485 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T20:55:58.485 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T20:55:58.485 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T20:55:58.485 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T20:55:58.486 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T20:55:58.486 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T20:55:58.486 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T20:55:58.486 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T20:55:58.486 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T20:55:58.486 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T20:55:58.486 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T20:55:58.486 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T20:55:58.486 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T20:55:58.486 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T20:55:58.486 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T20:55:58.486 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T20:55:58.487 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T20:55:58.487 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T20:55:58.487 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T20:55:58.541 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T20:55:58.542 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:58.542 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T20:55:58.542 INFO:teuthology.orchestra.run.trial153.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T20:55:58.542 INFO:teuthology.orchestra.run.trial153.stdout: ceph-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:58.542 INFO:teuthology.orchestra.run.trial153.stdout: ceph-grafana-dashboards-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:55:58.542 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mds-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:58.542 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:58.542 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-cephadm-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:55:58.542 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-dashboard-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:55:58.542 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-diskprediction-local-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:55:58.542 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-k8sevents-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:55:58.543 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-modules-core-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:55:58.543 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mgr-rook-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:55:58.543 INFO:teuthology.orchestra.run.trial153.stdout: ceph-mon-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:58.543 INFO:teuthology.orchestra.run.trial153.stdout: ceph-osd-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:55:58.543 INFO:teuthology.orchestra.run.trial153.stdout: ceph-prometheus-alerts-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:55:58.543 INFO:teuthology.orchestra.run.trial153.stdout: ceph-volume-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:55:58.543 INFO:teuthology.orchestra.run.trial153.stdout: cephadm-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:55:58.543 INFO:teuthology.orchestra.run.trial153.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T20:55:58.543 INFO:teuthology.orchestra.run.trial153.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T20:55:58.543 INFO:teuthology.orchestra.run.trial153.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T20:55:58.543 INFO:teuthology.orchestra.run.trial153.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T20:55:58.543 INFO:teuthology.orchestra.run.trial153.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T20:55:58.544 INFO:teuthology.orchestra.run.trial153.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T20:55:58.544 INFO:teuthology.orchestra.run.trial153.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T20:55:58.544 INFO:teuthology.orchestra.run.trial153.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T20:55:58.544 INFO:teuthology.orchestra.run.trial153.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T20:55:58.544 INFO:teuthology.orchestra.run.trial153.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T20:55:58.544 INFO:teuthology.orchestra.run.trial153.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T20:55:58.544 INFO:teuthology.orchestra.run.trial153.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T20:55:58.544 INFO:teuthology.orchestra.run.trial153.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T20:55:58.544 INFO:teuthology.orchestra.run.trial153.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T20:55:58.544 INFO:teuthology.orchestra.run.trial153.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T20:55:58.544 INFO:teuthology.orchestra.run.trial153.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T20:55:58.544 INFO:teuthology.orchestra.run.trial153.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T20:55:58.544 INFO:teuthology.orchestra.run.trial153.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T20:55:58.545 INFO:teuthology.orchestra.run.trial153.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T20:55:58.545 INFO:teuthology.orchestra.run.trial153.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T20:55:58.545 INFO:teuthology.orchestra.run.trial153.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T20:55:58.545 INFO:teuthology.orchestra.run.trial153.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T20:55:58.545 INFO:teuthology.orchestra.run.trial153.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T20:55:58.545 INFO:teuthology.orchestra.run.trial153.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T20:55:58.545 INFO:teuthology.orchestra.run.trial153.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T20:55:58.545 INFO:teuthology.orchestra.run.trial153.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T20:55:58.545 INFO:teuthology.orchestra.run.trial153.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T20:55:58.545 INFO:teuthology.orchestra.run.trial153.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T20:55:58.545 INFO:teuthology.orchestra.run.trial153.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T20:55:58.545 INFO:teuthology.orchestra.run.trial153.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T20:55:58.545 INFO:teuthology.orchestra.run.trial153.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T20:55:58.546 INFO:teuthology.orchestra.run.trial153.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T20:55:58.546 INFO:teuthology.orchestra.run.trial153.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T20:55:58.546 INFO:teuthology.orchestra.run.trial153.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T20:55:58.546 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T20:55:58.546 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T20:55:58.546 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T20:55:58.546 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T20:55:58.546 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T20:55:58.546 INFO:teuthology.orchestra.run.trial153.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T20:55:58.546 INFO:teuthology.orchestra.run.trial153.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T20:55:58.546 INFO:teuthology.orchestra.run.trial153.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T20:55:58.546 INFO:teuthology.orchestra.run.trial153.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T20:55:58.546 INFO:teuthology.orchestra.run.trial153.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T20:55:58.547 INFO:teuthology.orchestra.run.trial153.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T20:55:58.547 INFO:teuthology.orchestra.run.trial153.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T20:55:58.547 INFO:teuthology.orchestra.run.trial153.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T20:55:58.547 INFO:teuthology.orchestra.run.trial153.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T20:55:58.547 INFO:teuthology.orchestra.run.trial153.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T20:55:58.547 INFO:teuthology.orchestra.run.trial153.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T20:55:58.547 INFO:teuthology.orchestra.run.trial153.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T20:55:58.547 INFO:teuthology.orchestra.run.trial153.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T20:55:58.547 INFO:teuthology.orchestra.run.trial153.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T20:55:58.547 INFO:teuthology.orchestra.run.trial153.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T20:55:58.547 INFO:teuthology.orchestra.run.trial153.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T20:55:58.547 INFO:teuthology.orchestra.run.trial153.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T20:55:58.547 INFO:teuthology.orchestra.run.trial153.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T20:55:58.548 INFO:teuthology.orchestra.run.trial153.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T20:55:58.548 INFO:teuthology.orchestra.run.trial153.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T20:55:58.548 INFO:teuthology.orchestra.run.trial153.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T20:55:58.548 INFO:teuthology.orchestra.run.trial153.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T20:55:58.548 INFO:teuthology.orchestra.run.trial153.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T20:55:58.548 INFO:teuthology.orchestra.run.trial153.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T20:55:58.548 INFO:teuthology.orchestra.run.trial153.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T20:55:58.548 INFO:teuthology.orchestra.run.trial153.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T20:55:58.548 INFO:teuthology.orchestra.run.trial153.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T20:55:58.548 INFO:teuthology.orchestra.run.trial153.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T20:55:58.548 INFO:teuthology.orchestra.run.trial153.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T20:55:58.548 INFO:teuthology.orchestra.run.trial153.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T20:55:58.548 INFO:teuthology.orchestra.run.trial153.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T20:55:58.549 INFO:teuthology.orchestra.run.trial153.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T20:55:58.549 INFO:teuthology.orchestra.run.trial153.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T20:55:58.549 INFO:teuthology.orchestra.run.trial153.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T20:55:58.549 INFO:teuthology.orchestra.run.trial153.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T20:55:58.549 INFO:teuthology.orchestra.run.trial153.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T20:55:58.549 INFO:teuthology.orchestra.run.trial153.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T20:55:58.549 INFO:teuthology.orchestra.run.trial153.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T20:55:58.549 INFO:teuthology.orchestra.run.trial153.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T20:55:58.549 INFO:teuthology.orchestra.run.trial153.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T20:55:58.549 INFO:teuthology.orchestra.run.trial153.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T20:55:58.549 INFO:teuthology.orchestra.run.trial153.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T20:55:58.549 INFO:teuthology.orchestra.run.trial153.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T20:55:58.549 INFO:teuthology.orchestra.run.trial153.stdout: zip-3.0-35.el9.x86_64 2026-02-17T20:55:58.550 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:58.550 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:55:58.596 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-base 2026-02-17T20:55:58.913 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:26 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:55:58.977 INFO:teuthology.orchestra.run.trial153.stdout:Package ceph-base-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:55:58.995 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:55:58.995 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T20:55:58.995 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:55:59.016 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-osd-2:19.2.3-683.g76b494d6.el9.x86_64 86/99 2026-02-17T20:55:59.017 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install cephadm 2026-02-17T20:55:59.040 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-osd-2:19.2.3-683.g76b494d6.el9.x86_64 86/99 2026-02-17T20:55:59.040 INFO:teuthology.orchestra.run.trial104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:55:59.040 INFO:teuthology.orchestra.run.trial104.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-17T20:55:59.041 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T20:55:59.041 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-17T20:55:59.041 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:55:59.096 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: cephadm-2:19.2.3-683.g76b494d6.el9.noarch 87/99 2026-02-17T20:55:59.098 INFO:teuthology.orchestra.run.trial104.stdout: Installing : cephadm-2:19.2.3-683.g76b494d6.el9.noarch 87/99 2026-02-17T20:55:59.103 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-prometheus-alerts-2:19.2.3-683.g76b494d6.el9. 88/99 2026-02-17T20:55:59.123 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-grafana-dashboards-2:19.2.3-683.g76b494d6.el9 89/99 2026-02-17T20:55:59.124 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-mgr-cephadm-2:19.2.3-683.g76b494d6.el9.noarch 90/99 2026-02-17T20:55:59.327 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:27 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:55:59.390 INFO:teuthology.orchestra.run.trial153.stdout:Package cephadm-2:19.2.3-683.g76b494d6.el9.noarch is already installed. 2026-02-17T20:55:59.408 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:55:59.408 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T20:55:59.409 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:55:59.429 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T20:55:59.620 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.2.3-683.g76b494d6.el9.noarch 90/99 2026-02-17T20:55:59.623 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-mgr-dashboard-2:19.2.3-683.g76b494d6.el9.noar 91/99 2026-02-17T20:55:59.738 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:27 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:55:59.820 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:55:59.821 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:55:59.821 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T20:55:59.821 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:55:59.821 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T20:55:59.821 INFO:teuthology.orchestra.run.trial153.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-683.g76b494d6.el9 ceph 145 k 2026-02-17T20:55:59.821 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:59.821 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T20:55:59.822 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:55:59.822 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T20:55:59.822 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:55:59.822 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 145 k 2026-02-17T20:55:59.822 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 431 k 2026-02-17T20:55:59.822 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T20:55:59.907 INFO:teuthology.orchestra.run.trial153.stdout:ceph-immutable-object-cache-19.2.3-683.g76b494d 1.7 MB/s | 145 kB 00:00 2026-02-17T20:55:59.907 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:55:59.907 INFO:teuthology.orchestra.run.trial153.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-17T20:55:59.907 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T20:55:59.910 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T20:55:59.910 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T20:55:59.942 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T20:55:59.942 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T20:55:59.997 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T20:55:59.998 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-683.g76b494d6.e 1/1 2026-02-17T20:56:00.020 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-683.g76b494d6.e 1/1 2026-02-17T20:56:00.020 INFO:teuthology.orchestra.run.trial153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:56:00.020 INFO:teuthology.orchestra.run.trial153.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T20:56:00.020 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:00.077 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.2.3-683.g76b494d6.el9.noar 91/99 2026-02-17T20:56:00.078 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-mgr-diskprediction-local-2:19.2.3-683.g76b494 92/99 2026-02-17T20:56:00.092 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.2.3-683.g76b494 92/99 2026-02-17T20:56:00.093 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-mgr-k8sevents-2:19.2.3-683.g76b494d6.el9.noar 93/99 2026-02-17T20:56:00.150 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-mgr-k8sevents-2:19.2.3-683.g76b494d6.el9.noar 93/99 2026-02-17T20:56:00.199 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-mgr-modules-core-2:19.2.3-683.g76b494d6.el9.n 94/99 2026-02-17T20:56:00.200 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-mgr-2:19.2.3-683.g76b494d6.el9.x86_64 95/99 2026-02-17T20:56:00.222 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-mgr-2:19.2.3-683.g76b494d6.el9.x86_64 95/99 2026-02-17T20:56:00.222 INFO:teuthology.orchestra.run.trial104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:56:00.222 INFO:teuthology.orchestra.run.trial104.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-17T20:56:00.222 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T20:56:00.222 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-17T20:56:00.222 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:00.234 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-mgr-rook-2:19.2.3-683.g76b494d6.el9.noarch 96/99 2026-02-17T20:56:00.299 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-683.g76b494d6.e 1/1 2026-02-17T20:56:00.299 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:00.299 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T20:56:00.299 INFO:teuthology.orchestra.run.trial153.stdout: ceph-immutable-object-cache-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:00.299 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:00.300 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:00.327 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-mgr 2026-02-17T20:56:00.451 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-mgr-rook-2:19.2.3-683.g76b494d6.el9.noarch 96/99 2026-02-17T20:56:00.452 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-mon-2:19.2.3-683.g76b494d6.el9.x86_64 97/99 2026-02-17T20:56:00.474 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-mon-2:19.2.3-683.g76b494d6.el9.x86_64 97/99 2026-02-17T20:56:00.474 INFO:teuthology.orchestra.run.trial104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:56:00.475 INFO:teuthology.orchestra.run.trial104.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-17T20:56:00.475 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T20:56:00.475 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-17T20:56:00.475 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:00.576 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-mds-2:19.2.3-683.g76b494d6.el9.x86_64 98/99 2026-02-17T20:56:00.596 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-mds-2:19.2.3-683.g76b494d6.el9.x86_64 98/99 2026-02-17T20:56:00.596 INFO:teuthology.orchestra.run.trial104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:56:00.596 INFO:teuthology.orchestra.run.trial104.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-17T20:56:00.597 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T20:56:00.597 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-17T20:56:00.597 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:00.615 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-2:19.2.3-683.g76b494d6.el9.x86_64 99/99 2026-02-17T20:56:00.644 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:28 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:00.709 INFO:teuthology.orchestra.run.trial153.stdout:Package ceph-mgr-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:56:00.726 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:00.727 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T20:56:00.727 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:00.748 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T20:56:01.058 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:01.122 INFO:teuthology.orchestra.run.trial153.stdout:Package ceph-mgr-dashboard-2:19.2.3-683.g76b494d6.el9.noarch is already installed. 2026-02-17T20:56:01.139 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:01.140 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T20:56:01.140 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:01.161 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T20:56:01.307 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-2:19.2.3-683.g76b494d6.el9.x86_64 99/99 2026-02-17T20:56:01.307 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-2:19.2.3-683.g76b494d6.el9.x86_64 1/99 2026-02-17T20:56:01.307 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-mds-2:19.2.3-683.g76b494d6.el9.x86_64 2/99 2026-02-17T20:56:01.307 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-mgr-2:19.2.3-683.g76b494d6.el9.x86_64 3/99 2026-02-17T20:56:01.307 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-mon-2:19.2.3-683.g76b494d6.el9.x86_64 4/99 2026-02-17T20:56:01.307 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-osd-2:19.2.3-683.g76b494d6.el9.x86_64 5/99 2026-02-17T20:56:01.307 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-grafana-dashboards-2:19.2.3-683.g76b494d6.el9 6/99 2026-02-17T20:56:01.307 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-mgr-cephadm-2:19.2.3-683.g76b494d6.el9.noarch 7/99 2026-02-17T20:56:01.308 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-mgr-dashboard-2:19.2.3-683.g76b494d6.el9.noar 8/99 2026-02-17T20:56:01.308 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.2.3-683.g76b494 9/99 2026-02-17T20:56:01.308 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-mgr-k8sevents-2:19.2.3-683.g76b494d6.el9.noar 10/99 2026-02-17T20:56:01.308 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-mgr-modules-core-2:19.2.3-683.g76b494d6.el9.n 11/99 2026-02-17T20:56:01.308 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-mgr-rook-2:19.2.3-683.g76b494d6.el9.noarch 12/99 2026-02-17T20:56:01.308 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-prometheus-alerts-2:19.2.3-683.g76b494d6.el9. 13/99 2026-02-17T20:56:01.308 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-volume-2:19.2.3-683.g76b494d6.el9.noarch 14/99 2026-02-17T20:56:01.308 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : cephadm-2:19.2.3-683.g76b494d6.el9.noarch 15/99 2026-02-17T20:56:01.308 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 16/99 2026-02-17T20:56:01.308 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 17/99 2026-02-17T20:56:01.309 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 18/99 2026-02-17T20:56:01.309 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 19/99 2026-02-17T20:56:01.309 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 20/99 2026-02-17T20:56:01.309 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 21/99 2026-02-17T20:56:01.309 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 22/99 2026-02-17T20:56:01.309 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-ply-3.11-14.el9.noarch 23/99 2026-02-17T20:56:01.309 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 24/99 2026-02-17T20:56:01.309 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 25/99 2026-02-17T20:56:01.309 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 26/99 2026-02-17T20:56:01.309 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 27/99 2026-02-17T20:56:01.309 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : unzip-6.0-59.el9.x86_64 28/99 2026-02-17T20:56:01.310 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : zip-3.0-35.el9.x86_64 29/99 2026-02-17T20:56:01.310 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : flexiblas-3.0.4-9.el9.x86_64 30/99 2026-02-17T20:56:01.310 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : flexiblas-netlib-3.0.4-9.el9.x86_64 31/99 2026-02-17T20:56:01.310 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 32/99 2026-02-17T20:56:01.310 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 33/99 2026-02-17T20:56:01.310 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : lua-5.4.4-4.el9.x86_64 34/99 2026-02-17T20:56:01.310 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 35/99 2026-02-17T20:56:01.310 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 36/99 2026-02-17T20:56:01.310 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 37/99 2026-02-17T20:56:01.310 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 38/99 2026-02-17T20:56:01.310 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 39/99 2026-02-17T20:56:01.311 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 40/99 2026-02-17T20:56:01.311 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 41/99 2026-02-17T20:56:01.311 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-lxml-4.6.5-3.el9.x86_64 42/99 2026-02-17T20:56:01.311 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 43/99 2026-02-17T20:56:01.311 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 44/99 2026-02-17T20:56:01.311 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 45/99 2026-02-17T20:56:01.311 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 46/99 2026-02-17T20:56:01.311 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 47/99 2026-02-17T20:56:01.311 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 48/99 2026-02-17T20:56:01.311 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 49/99 2026-02-17T20:56:01.311 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 50/99 2026-02-17T20:56:01.311 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 51/99 2026-02-17T20:56:01.312 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 52/99 2026-02-17T20:56:01.312 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 53/99 2026-02-17T20:56:01.312 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : xmlsec1-1.2.29-13.el9.x86_64 54/99 2026-02-17T20:56:01.312 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : xmlsec1-openssl-1.2.29-13.el9.x86_64 55/99 2026-02-17T20:56:01.312 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 56/99 2026-02-17T20:56:01.312 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 57/99 2026-02-17T20:56:01.312 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 58/99 2026-02-17T20:56:01.312 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 59/99 2026-02-17T20:56:01.312 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 60/99 2026-02-17T20:56:01.312 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 61/99 2026-02-17T20:56:01.313 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 62/99 2026-02-17T20:56:01.313 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 63/99 2026-02-17T20:56:01.313 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 64/99 2026-02-17T20:56:01.313 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 65/99 2026-02-17T20:56:01.313 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 66/99 2026-02-17T20:56:01.313 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 67/99 2026-02-17T20:56:01.313 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 68/99 2026-02-17T20:56:01.313 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 69/99 2026-02-17T20:56:01.313 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 70/99 2026-02-17T20:56:01.313 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 71/99 2026-02-17T20:56:01.313 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-influxdb-5.3.1-1.el9.noarch 72/99 2026-02-17T20:56:01.313 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-isodate-0.6.1-3.el9.noarch 73/99 2026-02-17T20:56:01.314 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 74/99 2026-02-17T20:56:01.314 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 75/99 2026-02-17T20:56:01.314 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 76/99 2026-02-17T20:56:01.314 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 77/99 2026-02-17T20:56:01.314 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 78/99 2026-02-17T20:56:01.314 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 79/99 2026-02-17T20:56:01.314 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 80/99 2026-02-17T20:56:01.314 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 81/99 2026-02-17T20:56:01.314 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 82/99 2026-02-17T20:56:01.314 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-msgpack-1.0.3-2.el9.x86_64 83/99 2026-02-17T20:56:01.314 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 84/99 2026-02-17T20:56:01.315 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 85/99 2026-02-17T20:56:01.315 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 86/99 2026-02-17T20:56:01.315 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 87/99 2026-02-17T20:56:01.315 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 88/99 2026-02-17T20:56:01.315 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 89/99 2026-02-17T20:56:01.315 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 90/99 2026-02-17T20:56:01.315 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-saml-1.16.0-1.el9.noarch 91/99 2026-02-17T20:56:01.315 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 92/99 2026-02-17T20:56:01.315 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 93/99 2026-02-17T20:56:01.315 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 94/99 2026-02-17T20:56:01.315 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 95/99 2026-02-17T20:56:01.315 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 96/99 2026-02-17T20:56:01.316 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-xmlsec-1.3.13-1.el9.x86_64 97/99 2026-02-17T20:56:01.316 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 98/99 2026-02-17T20:56:01.368 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 99/99 2026-02-17T20:56:01.368 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:01.368 INFO:teuthology.orchestra.run.trial104.stdout:Installed: 2026-02-17T20:56:01.368 INFO:teuthology.orchestra.run.trial104.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-17T20:56:01.369 INFO:teuthology.orchestra.run.trial104.stdout: ceph-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:01.369 INFO:teuthology.orchestra.run.trial104.stdout: ceph-grafana-dashboards-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:56:01.369 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mds-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:01.369 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mgr-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:01.369 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mgr-cephadm-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:56:01.369 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mgr-dashboard-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:56:01.369 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mgr-diskprediction-local-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:56:01.369 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mgr-k8sevents-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:56:01.369 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mgr-modules-core-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:56:01.369 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mgr-rook-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:56:01.370 INFO:teuthology.orchestra.run.trial104.stdout: ceph-mon-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:01.370 INFO:teuthology.orchestra.run.trial104.stdout: ceph-osd-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:01.370 INFO:teuthology.orchestra.run.trial104.stdout: ceph-prometheus-alerts-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:56:01.370 INFO:teuthology.orchestra.run.trial104.stdout: ceph-volume-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:56:01.370 INFO:teuthology.orchestra.run.trial104.stdout: cephadm-2:19.2.3-683.g76b494d6.el9.noarch 2026-02-17T20:56:01.370 INFO:teuthology.orchestra.run.trial104.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-17T20:56:01.370 INFO:teuthology.orchestra.run.trial104.stdout: flexiblas-3.0.4-9.el9.x86_64 2026-02-17T20:56:01.370 INFO:teuthology.orchestra.run.trial104.stdout: flexiblas-netlib-3.0.4-9.el9.x86_64 2026-02-17T20:56:01.370 INFO:teuthology.orchestra.run.trial104.stdout: flexiblas-openblas-openmp-3.0.4-9.el9.x86_64 2026-02-17T20:56:01.370 INFO:teuthology.orchestra.run.trial104.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-17T20:56:01.370 INFO:teuthology.orchestra.run.trial104.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-17T20:56:01.371 INFO:teuthology.orchestra.run.trial104.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-17T20:56:01.371 INFO:teuthology.orchestra.run.trial104.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-17T20:56:01.371 INFO:teuthology.orchestra.run.trial104.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-17T20:56:01.371 INFO:teuthology.orchestra.run.trial104.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T20:56:01.371 INFO:teuthology.orchestra.run.trial104.stdout: lua-5.4.4-4.el9.x86_64 2026-02-17T20:56:01.371 INFO:teuthology.orchestra.run.trial104.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-17T20:56:01.371 INFO:teuthology.orchestra.run.trial104.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-17T20:56:01.371 INFO:teuthology.orchestra.run.trial104.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-17T20:56:01.371 INFO:teuthology.orchestra.run.trial104.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-17T20:56:01.371 INFO:teuthology.orchestra.run.trial104.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-17T20:56:01.371 INFO:teuthology.orchestra.run.trial104.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-17T20:56:01.372 INFO:teuthology.orchestra.run.trial104.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-17T20:56:01.372 INFO:teuthology.orchestra.run.trial104.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-17T20:56:01.372 INFO:teuthology.orchestra.run.trial104.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-17T20:56:01.372 INFO:teuthology.orchestra.run.trial104.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-17T20:56:01.372 INFO:teuthology.orchestra.run.trial104.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-17T20:56:01.372 INFO:teuthology.orchestra.run.trial104.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-17T20:56:01.372 INFO:teuthology.orchestra.run.trial104.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-17T20:56:01.372 INFO:teuthology.orchestra.run.trial104.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-17T20:56:01.372 INFO:teuthology.orchestra.run.trial104.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-17T20:56:01.372 INFO:teuthology.orchestra.run.trial104.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-17T20:56:01.372 INFO:teuthology.orchestra.run.trial104.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-17T20:56:01.373 INFO:teuthology.orchestra.run.trial104.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-17T20:56:01.373 INFO:teuthology.orchestra.run.trial104.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-17T20:56:01.373 INFO:teuthology.orchestra.run.trial104.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-17T20:56:01.373 INFO:teuthology.orchestra.run.trial104.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-17T20:56:01.373 INFO:teuthology.orchestra.run.trial104.stdout: python3-influxdb-5.3.1-1.el9.noarch 2026-02-17T20:56:01.373 INFO:teuthology.orchestra.run.trial104.stdout: python3-isodate-0.6.1-3.el9.noarch 2026-02-17T20:56:01.373 INFO:teuthology.orchestra.run.trial104.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-17T20:56:01.373 INFO:teuthology.orchestra.run.trial104.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-17T20:56:01.373 INFO:teuthology.orchestra.run.trial104.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-17T20:56:01.373 INFO:teuthology.orchestra.run.trial104.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-17T20:56:01.373 INFO:teuthology.orchestra.run.trial104.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-17T20:56:01.374 INFO:teuthology.orchestra.run.trial104.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-17T20:56:01.374 INFO:teuthology.orchestra.run.trial104.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-17T20:56:01.374 INFO:teuthology.orchestra.run.trial104.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-17T20:56:01.374 INFO:teuthology.orchestra.run.trial104.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-17T20:56:01.374 INFO:teuthology.orchestra.run.trial104.stdout: python3-logutils-0.3.5-21.el9.noarch 2026-02-17T20:56:01.374 INFO:teuthology.orchestra.run.trial104.stdout: python3-lxml-4.6.5-3.el9.x86_64 2026-02-17T20:56:01.374 INFO:teuthology.orchestra.run.trial104.stdout: python3-mako-1.1.4-6.el9.noarch 2026-02-17T20:56:01.374 INFO:teuthology.orchestra.run.trial104.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-17T20:56:01.374 INFO:teuthology.orchestra.run.trial104.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-17T20:56:01.374 INFO:teuthology.orchestra.run.trial104.stdout: python3-msgpack-1.0.3-2.el9.x86_64 2026-02-17T20:56:01.374 INFO:teuthology.orchestra.run.trial104.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-17T20:56:01.374 INFO:teuthology.orchestra.run.trial104.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-17T20:56:01.375 INFO:teuthology.orchestra.run.trial104.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-17T20:56:01.375 INFO:teuthology.orchestra.run.trial104.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-17T20:56:01.375 INFO:teuthology.orchestra.run.trial104.stdout: python3-pecan-1.4.2-3.el9.noarch 2026-02-17T20:56:01.375 INFO:teuthology.orchestra.run.trial104.stdout: python3-ply-3.11-14.el9.noarch 2026-02-17T20:56:01.375 INFO:teuthology.orchestra.run.trial104.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-17T20:56:01.375 INFO:teuthology.orchestra.run.trial104.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-17T20:56:01.375 INFO:teuthology.orchestra.run.trial104.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-17T20:56:01.375 INFO:teuthology.orchestra.run.trial104.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-17T20:56:01.375 INFO:teuthology.orchestra.run.trial104.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-17T20:56:01.375 INFO:teuthology.orchestra.run.trial104.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-17T20:56:01.375 INFO:teuthology.orchestra.run.trial104.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-17T20:56:01.376 INFO:teuthology.orchestra.run.trial104.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-17T20:56:01.376 INFO:teuthology.orchestra.run.trial104.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-17T20:56:01.376 INFO:teuthology.orchestra.run.trial104.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-17T20:56:01.376 INFO:teuthology.orchestra.run.trial104.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-17T20:56:01.376 INFO:teuthology.orchestra.run.trial104.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-17T20:56:01.376 INFO:teuthology.orchestra.run.trial104.stdout: python3-saml-1.16.0-1.el9.noarch 2026-02-17T20:56:01.376 INFO:teuthology.orchestra.run.trial104.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-17T20:56:01.376 INFO:teuthology.orchestra.run.trial104.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-17T20:56:01.376 INFO:teuthology.orchestra.run.trial104.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-17T20:56:01.376 INFO:teuthology.orchestra.run.trial104.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-17T20:56:01.376 INFO:teuthology.orchestra.run.trial104.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-17T20:56:01.377 INFO:teuthology.orchestra.run.trial104.stdout: python3-webob-1.8.8-2.el9.noarch 2026-02-17T20:56:01.377 INFO:teuthology.orchestra.run.trial104.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-17T20:56:01.377 INFO:teuthology.orchestra.run.trial104.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2026-02-17T20:56:01.377 INFO:teuthology.orchestra.run.trial104.stdout: python3-xmlsec-1.3.13-1.el9.x86_64 2026-02-17T20:56:01.377 INFO:teuthology.orchestra.run.trial104.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-17T20:56:01.377 INFO:teuthology.orchestra.run.trial104.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-17T20:56:01.377 INFO:teuthology.orchestra.run.trial104.stdout: unzip-6.0-59.el9.x86_64 2026-02-17T20:56:01.377 INFO:teuthology.orchestra.run.trial104.stdout: xmlsec1-1.2.29-13.el9.x86_64 2026-02-17T20:56:01.377 INFO:teuthology.orchestra.run.trial104.stdout: xmlsec1-openssl-1.2.29-13.el9.x86_64 2026-02-17T20:56:01.377 INFO:teuthology.orchestra.run.trial104.stdout: zip-3.0-35.el9.x86_64 2026-02-17T20:56:01.377 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:01.378 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:01.421 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install ceph-base 2026-02-17T20:56:01.472 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:01.536 INFO:teuthology.orchestra.run.trial153.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-683.g76b494d6.el9.noarch is already installed. 2026-02-17T20:56:01.554 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:01.554 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T20:56:01.554 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:01.576 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-mgr-rook 2026-02-17T20:56:01.730 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:01.794 INFO:teuthology.orchestra.run.trial104.stdout:Package ceph-base-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:56:01.812 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:01.812 INFO:teuthology.orchestra.run.trial104.stdout:Nothing to do. 2026-02-17T20:56:01.813 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:01.833 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install cephadm 2026-02-17T20:56:01.889 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:29 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:01.954 INFO:teuthology.orchestra.run.trial153.stdout:Package ceph-mgr-rook-2:19.2.3-683.g76b494d6.el9.noarch is already installed. 2026-02-17T20:56:01.972 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:01.973 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T20:56:01.973 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:01.994 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T20:56:02.145 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:02.208 INFO:teuthology.orchestra.run.trial104.stdout:Package cephadm-2:19.2.3-683.g76b494d6.el9.noarch is already installed. 2026-02-17T20:56:02.226 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:02.227 INFO:teuthology.orchestra.run.trial104.stdout:Nothing to do. 2026-02-17T20:56:02.227 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:02.248 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install ceph-immutable-object-cache 2026-02-17T20:56:02.307 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:02.373 INFO:teuthology.orchestra.run.trial153.stdout:Package ceph-mgr-cephadm-2:19.2.3-683.g76b494d6.el9.noarch is already installed. 2026-02-17T20:56:02.391 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:02.392 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T20:56:02.392 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:02.414 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-fuse 2026-02-17T20:56:02.557 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:02.639 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:02.639 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:02.639 INFO:teuthology.orchestra.run.trial104.stdout: Package Arch Version Repo Size 2026-02-17T20:56:02.639 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:02.639 INFO:teuthology.orchestra.run.trial104.stdout:Installing: 2026-02-17T20:56:02.639 INFO:teuthology.orchestra.run.trial104.stdout: ceph-immutable-object-cache x86_64 2:19.2.3-683.g76b494d6.el9 ceph 145 k 2026-02-17T20:56:02.639 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:02.640 INFO:teuthology.orchestra.run.trial104.stdout:Transaction Summary 2026-02-17T20:56:02.640 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:02.640 INFO:teuthology.orchestra.run.trial104.stdout:Install 1 Package 2026-02-17T20:56:02.640 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:02.640 INFO:teuthology.orchestra.run.trial104.stdout:Total download size: 145 k 2026-02-17T20:56:02.640 INFO:teuthology.orchestra.run.trial104.stdout:Installed size: 431 k 2026-02-17T20:56:02.640 INFO:teuthology.orchestra.run.trial104.stdout:Downloading Packages: 2026-02-17T20:56:02.725 INFO:teuthology.orchestra.run.trial104.stdout:ceph-immutable-object-cache-19.2.3-683.g76b494d 1.7 MB/s | 145 kB 00:00 2026-02-17T20:56:02.726 INFO:teuthology.orchestra.run.trial104.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:56:02.726 INFO:teuthology.orchestra.run.trial104.stdout:Total 1.6 MB/s | 145 kB 00:00 2026-02-17T20:56:02.726 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction check 2026-02-17T20:56:02.727 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:30 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:02.729 INFO:teuthology.orchestra.run.trial104.stdout:Transaction check succeeded. 2026-02-17T20:56:02.730 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction test 2026-02-17T20:56:02.761 INFO:teuthology.orchestra.run.trial104.stdout:Transaction test succeeded. 2026-02-17T20:56:02.761 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction 2026-02-17T20:56:02.810 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:02.811 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:02.811 INFO:teuthology.orchestra.run.trial153.stdout: Package Architecture Version Repository Size 2026-02-17T20:56:02.811 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:02.811 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T20:56:02.811 INFO:teuthology.orchestra.run.trial153.stdout: ceph-fuse x86_64 2:19.2.3-683.g76b494d6.el9 ceph 1.2 M 2026-02-17T20:56:02.811 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:02.812 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T20:56:02.812 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:02.812 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T20:56:02.812 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:02.812 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 1.2 M 2026-02-17T20:56:02.812 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 3.6 M 2026-02-17T20:56:02.812 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T20:56:02.816 INFO:teuthology.orchestra.run.trial104.stdout: Preparing : 1/1 2026-02-17T20:56:02.818 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-immutable-object-cache-2:19.2.3-683.g76b494d6.e 1/1 2026-02-17T20:56:02.840 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.2.3-683.g76b494d6.e 1/1 2026-02-17T20:56:02.840 INFO:teuthology.orchestra.run.trial104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:56:02.840 INFO:teuthology.orchestra.run.trial104.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-17T20:56:02.841 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:02.929 INFO:teuthology.orchestra.run.trial153.stdout:ceph-fuse-19.2.3-683.g76b494d6.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2026-02-17T20:56:02.930 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:56:02.930 INFO:teuthology.orchestra.run.trial153.stdout:Total 9.6 MB/s | 1.2 MB 00:00 2026-02-17T20:56:02.930 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T20:56:02.934 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T20:56:02.934 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T20:56:02.969 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T20:56:02.969 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T20:56:03.071 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T20:56:03.088 INFO:teuthology.orchestra.run.trial153.stdout: Installing : ceph-fuse-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:03.140 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-immutable-object-cache-2:19.2.3-683.g76b494d6.e 1/1 2026-02-17T20:56:03.140 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:03.141 INFO:teuthology.orchestra.run.trial104.stdout:Installed: 2026-02-17T20:56:03.141 INFO:teuthology.orchestra.run.trial104.stdout: ceph-immutable-object-cache-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:03.141 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:03.141 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:03.170 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install ceph-mgr 2026-02-17T20:56:03.303 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: ceph-fuse-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:03.360 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : ceph-fuse-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:03.360 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:03.360 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T20:56:03.360 INFO:teuthology.orchestra.run.trial153.stdout: ceph-fuse-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:03.360 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:03.360 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:03.388 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install ceph-volume 2026-02-17T20:56:03.482 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:03.547 INFO:teuthology.orchestra.run.trial104.stdout:Package ceph-mgr-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:56:03.565 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:03.565 INFO:teuthology.orchestra.run.trial104.stdout:Nothing to do. 2026-02-17T20:56:03.566 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:03.586 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install ceph-mgr-dashboard 2026-02-17T20:56:03.706 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:03.771 INFO:teuthology.orchestra.run.trial153.stdout:Package ceph-volume-2:19.2.3-683.g76b494d6.el9.noarch is already installed. 2026-02-17T20:56:03.789 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:03.789 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T20:56:03.789 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:03.810 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install librados-devel 2026-02-17T20:56:03.897 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:31 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:03.961 INFO:teuthology.orchestra.run.trial104.stdout:Package ceph-mgr-dashboard-2:19.2.3-683.g76b494d6.el9.noarch is already installed. 2026-02-17T20:56:03.978 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:03.979 INFO:teuthology.orchestra.run.trial104.stdout:Nothing to do. 2026-02-17T20:56:03.979 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:04.001 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-17T20:56:04.118 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:04.200 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:04.200 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:04.200 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T20:56:04.200 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:04.200 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T20:56:04.200 INFO:teuthology.orchestra.run.trial153.stdout: librados-devel x86_64 2:19.2.3-683.g76b494d6.el9 ceph 126 k 2026-02-17T20:56:04.200 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:04.201 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T20:56:04.201 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:04.201 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T20:56:04.201 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:04.201 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 126 k 2026-02-17T20:56:04.201 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 456 k 2026-02-17T20:56:04.201 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T20:56:04.285 INFO:teuthology.orchestra.run.trial153.stdout:librados-devel-19.2.3-683.g76b494d6.el9.x86_64. 1.5 MB/s | 126 kB 00:00 2026-02-17T20:56:04.286 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:56:04.286 INFO:teuthology.orchestra.run.trial153.stdout:Total 1.5 MB/s | 126 kB 00:00 2026-02-17T20:56:04.286 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T20:56:04.289 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T20:56:04.289 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T20:56:04.310 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:04.320 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T20:56:04.320 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T20:56:04.374 INFO:teuthology.orchestra.run.trial104.stdout:Package ceph-mgr-diskprediction-local-2:19.2.3-683.g76b494d6.el9.noarch is already installed. 2026-02-17T20:56:04.375 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T20:56:04.391 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:04.392 INFO:teuthology.orchestra.run.trial153.stdout: Installing : librados-devel-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:04.392 INFO:teuthology.orchestra.run.trial104.stdout:Nothing to do. 2026-02-17T20:56:04.392 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:04.413 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install ceph-mgr-rook 2026-02-17T20:56:04.470 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: librados-devel-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:04.528 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : librados-devel-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:04.528 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:04.528 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T20:56:04.529 INFO:teuthology.orchestra.run.trial153.stdout: librados-devel-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:04.529 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:04.529 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:04.557 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install libcephfs2 2026-02-17T20:56:04.721 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:04.785 INFO:teuthology.orchestra.run.trial104.stdout:Package ceph-mgr-rook-2:19.2.3-683.g76b494d6.el9.noarch is already installed. 2026-02-17T20:56:04.802 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:04.803 INFO:teuthology.orchestra.run.trial104.stdout:Nothing to do. 2026-02-17T20:56:04.803 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:04.824 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install ceph-mgr-cephadm 2026-02-17T20:56:04.868 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:32 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:04.934 INFO:teuthology.orchestra.run.trial153.stdout:Package libcephfs2-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:56:04.952 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:04.952 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T20:56:04.953 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:04.974 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install libcephfs-devel 2026-02-17T20:56:05.138 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:05.204 INFO:teuthology.orchestra.run.trial104.stdout:Package ceph-mgr-cephadm-2:19.2.3-683.g76b494d6.el9.noarch is already installed. 2026-02-17T20:56:05.223 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:05.223 INFO:teuthology.orchestra.run.trial104.stdout:Nothing to do. 2026-02-17T20:56:05.223 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:05.245 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install ceph-fuse 2026-02-17T20:56:05.281 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:05.362 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:05.363 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:05.363 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T20:56:05.363 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:05.364 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T20:56:05.364 INFO:teuthology.orchestra.run.trial153.stdout: libcephfs-devel x86_64 2:19.2.3-683.g76b494d6.el9 ceph 34 k 2026-02-17T20:56:05.364 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:05.364 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T20:56:05.364 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:05.364 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T20:56:05.364 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:05.364 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 34 k 2026-02-17T20:56:05.364 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 153 k 2026-02-17T20:56:05.364 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T20:56:05.426 INFO:teuthology.orchestra.run.trial153.stdout:libcephfs-devel-19.2.3-683.g76b494d6.el9.x86_64 531 kB/s | 34 kB 00:00 2026-02-17T20:56:05.427 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:56:05.427 INFO:teuthology.orchestra.run.trial153.stdout:Total 524 kB/s | 34 kB 00:00 2026-02-17T20:56:05.427 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T20:56:05.429 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T20:56:05.429 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T20:56:05.431 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T20:56:05.431 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T20:56:05.451 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T20:56:05.467 INFO:teuthology.orchestra.run.trial153.stdout: Installing : libcephfs-devel-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:05.521 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:05.553 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:05.577 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libcephfs-devel-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:05.577 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:05.577 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T20:56:05.577 INFO:teuthology.orchestra.run.trial153.stdout: libcephfs-devel-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:05.577 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:05.577 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:05.603 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install librados2 2026-02-17T20:56:05.637 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:05.638 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:05.638 INFO:teuthology.orchestra.run.trial104.stdout: Package Architecture Version Repository Size 2026-02-17T20:56:05.638 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:05.638 INFO:teuthology.orchestra.run.trial104.stdout:Installing: 2026-02-17T20:56:05.638 INFO:teuthology.orchestra.run.trial104.stdout: ceph-fuse x86_64 2:19.2.3-683.g76b494d6.el9 ceph 1.2 M 2026-02-17T20:56:05.638 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:05.638 INFO:teuthology.orchestra.run.trial104.stdout:Transaction Summary 2026-02-17T20:56:05.638 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:05.638 INFO:teuthology.orchestra.run.trial104.stdout:Install 1 Package 2026-02-17T20:56:05.638 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:05.639 INFO:teuthology.orchestra.run.trial104.stdout:Total download size: 1.2 M 2026-02-17T20:56:05.639 INFO:teuthology.orchestra.run.trial104.stdout:Installed size: 3.6 M 2026-02-17T20:56:05.639 INFO:teuthology.orchestra.run.trial104.stdout:Downloading Packages: 2026-02-17T20:56:05.758 INFO:teuthology.orchestra.run.trial104.stdout:ceph-fuse-19.2.3-683.g76b494d6.el9.x86_64.rpm 9.6 MB/s | 1.2 MB 00:00 2026-02-17T20:56:05.759 INFO:teuthology.orchestra.run.trial104.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:56:05.759 INFO:teuthology.orchestra.run.trial104.stdout:Total 9.5 MB/s | 1.2 MB 00:00 2026-02-17T20:56:05.759 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction check 2026-02-17T20:56:05.762 INFO:teuthology.orchestra.run.trial104.stdout:Transaction check succeeded. 2026-02-17T20:56:05.763 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction test 2026-02-17T20:56:05.798 INFO:teuthology.orchestra.run.trial104.stdout:Transaction test succeeded. 2026-02-17T20:56:05.798 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction 2026-02-17T20:56:05.900 INFO:teuthology.orchestra.run.trial104.stdout: Preparing : 1/1 2026-02-17T20:56:05.915 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:33 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:05.916 INFO:teuthology.orchestra.run.trial104.stdout: Installing : ceph-fuse-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:05.982 INFO:teuthology.orchestra.run.trial153.stdout:Package librados2-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:56:05.999 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:06.000 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T20:56:06.000 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:06.021 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install librbd1 2026-02-17T20:56:06.162 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: ceph-fuse-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:06.218 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : ceph-fuse-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:06.218 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:06.219 INFO:teuthology.orchestra.run.trial104.stdout:Installed: 2026-02-17T20:56:06.219 INFO:teuthology.orchestra.run.trial104.stdout: ceph-fuse-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:06.219 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:06.219 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:06.245 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install ceph-volume 2026-02-17T20:56:06.332 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:06.396 INFO:teuthology.orchestra.run.trial153.stdout:Package librbd1-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:56:06.414 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:06.415 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T20:56:06.415 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:06.436 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install python3-rados 2026-02-17T20:56:06.555 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:06.620 INFO:teuthology.orchestra.run.trial104.stdout:Package ceph-volume-2:19.2.3-683.g76b494d6.el9.noarch is already installed. 2026-02-17T20:56:06.637 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:06.638 INFO:teuthology.orchestra.run.trial104.stdout:Nothing to do. 2026-02-17T20:56:06.638 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:06.659 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install librados-devel 2026-02-17T20:56:06.747 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:06.810 INFO:teuthology.orchestra.run.trial153.stdout:Package python3-rados-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:56:06.828 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:06.829 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T20:56:06.829 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:06.851 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install python3-rgw 2026-02-17T20:56:06.976 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:34 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:07.060 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:07.060 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:07.060 INFO:teuthology.orchestra.run.trial104.stdout: Package Arch Version Repo Size 2026-02-17T20:56:07.061 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:07.061 INFO:teuthology.orchestra.run.trial104.stdout:Installing: 2026-02-17T20:56:07.061 INFO:teuthology.orchestra.run.trial104.stdout: librados-devel x86_64 2:19.2.3-683.g76b494d6.el9 ceph 126 k 2026-02-17T20:56:07.061 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:07.061 INFO:teuthology.orchestra.run.trial104.stdout:Transaction Summary 2026-02-17T20:56:07.061 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:07.061 INFO:teuthology.orchestra.run.trial104.stdout:Install 1 Package 2026-02-17T20:56:07.061 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:07.061 INFO:teuthology.orchestra.run.trial104.stdout:Total download size: 126 k 2026-02-17T20:56:07.061 INFO:teuthology.orchestra.run.trial104.stdout:Installed size: 456 k 2026-02-17T20:56:07.062 INFO:teuthology.orchestra.run.trial104.stdout:Downloading Packages: 2026-02-17T20:56:07.146 INFO:teuthology.orchestra.run.trial104.stdout:librados-devel-19.2.3-683.g76b494d6.el9.x86_64. 1.4 MB/s | 126 kB 00:00 2026-02-17T20:56:07.147 INFO:teuthology.orchestra.run.trial104.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:56:07.147 INFO:teuthology.orchestra.run.trial104.stdout:Total 1.4 MB/s | 126 kB 00:00 2026-02-17T20:56:07.147 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction check 2026-02-17T20:56:07.150 INFO:teuthology.orchestra.run.trial104.stdout:Transaction check succeeded. 2026-02-17T20:56:07.150 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction test 2026-02-17T20:56:07.159 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:07.181 INFO:teuthology.orchestra.run.trial104.stdout:Transaction test succeeded. 2026-02-17T20:56:07.181 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction 2026-02-17T20:56:07.224 INFO:teuthology.orchestra.run.trial153.stdout:Package python3-rgw-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:56:07.235 INFO:teuthology.orchestra.run.trial104.stdout: Preparing : 1/1 2026-02-17T20:56:07.241 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:07.242 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T20:56:07.242 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:07.252 INFO:teuthology.orchestra.run.trial104.stdout: Installing : librados-devel-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:07.264 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install python3-cephfs 2026-02-17T20:56:07.330 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: librados-devel-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:07.387 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : librados-devel-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:07.387 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:07.387 INFO:teuthology.orchestra.run.trial104.stdout:Installed: 2026-02-17T20:56:07.388 INFO:teuthology.orchestra.run.trial104.stdout: librados-devel-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:07.388 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:07.388 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:07.415 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install libcephfs2 2026-02-17T20:56:07.576 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:07.641 INFO:teuthology.orchestra.run.trial153.stdout:Package python3-cephfs-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:56:07.658 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:07.659 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T20:56:07.659 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:07.680 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install python3-rbd 2026-02-17T20:56:07.726 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:07.789 INFO:teuthology.orchestra.run.trial104.stdout:Package libcephfs2-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:56:07.807 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:07.808 INFO:teuthology.orchestra.run.trial104.stdout:Nothing to do. 2026-02-17T20:56:07.808 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:07.828 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install libcephfs-devel 2026-02-17T20:56:07.990 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:35 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:08.054 INFO:teuthology.orchestra.run.trial153.stdout:Package python3-rbd-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:56:08.072 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:08.073 INFO:teuthology.orchestra.run.trial153.stdout:Nothing to do. 2026-02-17T20:56:08.073 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:08.095 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install rbd-fuse 2026-02-17T20:56:08.140 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:08.224 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:08.224 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:08.224 INFO:teuthology.orchestra.run.trial104.stdout: Package Arch Version Repo Size 2026-02-17T20:56:08.225 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:08.225 INFO:teuthology.orchestra.run.trial104.stdout:Installing: 2026-02-17T20:56:08.225 INFO:teuthology.orchestra.run.trial104.stdout: libcephfs-devel x86_64 2:19.2.3-683.g76b494d6.el9 ceph 34 k 2026-02-17T20:56:08.225 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:08.225 INFO:teuthology.orchestra.run.trial104.stdout:Transaction Summary 2026-02-17T20:56:08.225 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:08.225 INFO:teuthology.orchestra.run.trial104.stdout:Install 1 Package 2026-02-17T20:56:08.225 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:08.225 INFO:teuthology.orchestra.run.trial104.stdout:Total download size: 34 k 2026-02-17T20:56:08.225 INFO:teuthology.orchestra.run.trial104.stdout:Installed size: 153 k 2026-02-17T20:56:08.226 INFO:teuthology.orchestra.run.trial104.stdout:Downloading Packages: 2026-02-17T20:56:08.287 INFO:teuthology.orchestra.run.trial104.stdout:libcephfs-devel-19.2.3-683.g76b494d6.el9.x86_64 542 kB/s | 34 kB 00:00 2026-02-17T20:56:08.287 INFO:teuthology.orchestra.run.trial104.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:56:08.287 INFO:teuthology.orchestra.run.trial104.stdout:Total 536 kB/s | 34 kB 00:00 2026-02-17T20:56:08.287 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction check 2026-02-17T20:56:08.289 INFO:teuthology.orchestra.run.trial104.stdout:Transaction check succeeded. 2026-02-17T20:56:08.289 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction test 2026-02-17T20:56:08.290 INFO:teuthology.orchestra.run.trial104.stdout:Transaction test succeeded. 2026-02-17T20:56:08.291 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction 2026-02-17T20:56:08.311 INFO:teuthology.orchestra.run.trial104.stdout: Preparing : 1/1 2026-02-17T20:56:08.327 INFO:teuthology.orchestra.run.trial104.stdout: Installing : libcephfs-devel-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:08.382 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: libcephfs-devel-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:08.408 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:08.439 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : libcephfs-devel-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:08.439 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:08.439 INFO:teuthology.orchestra.run.trial104.stdout:Installed: 2026-02-17T20:56:08.439 INFO:teuthology.orchestra.run.trial104.stdout: libcephfs-devel-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:08.439 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:08.439 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:08.467 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install librados2 2026-02-17T20:56:08.490 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:08.491 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:08.492 INFO:teuthology.orchestra.run.trial153.stdout: Package Architecture Version Repository Size 2026-02-17T20:56:08.492 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:08.492 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T20:56:08.492 INFO:teuthology.orchestra.run.trial153.stdout: rbd-fuse x86_64 2:19.2.3-683.g76b494d6.el9 ceph 85 k 2026-02-17T20:56:08.492 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:08.492 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T20:56:08.492 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:08.492 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T20:56:08.493 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:08.493 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 85 k 2026-02-17T20:56:08.493 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 227 k 2026-02-17T20:56:08.493 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T20:56:08.574 INFO:teuthology.orchestra.run.trial153.stdout:rbd-fuse-19.2.3-683.g76b494d6.el9.x86_64.rpm 1.0 MB/s | 85 kB 00:00 2026-02-17T20:56:08.574 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:56:08.575 INFO:teuthology.orchestra.run.trial153.stdout:Total 1.0 MB/s | 85 kB 00:00 2026-02-17T20:56:08.575 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T20:56:08.577 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T20:56:08.578 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T20:56:08.610 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T20:56:08.610 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T20:56:08.661 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T20:56:08.678 INFO:teuthology.orchestra.run.trial153.stdout: Installing : rbd-fuse-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:08.757 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: rbd-fuse-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:08.781 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:36 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:08.815 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : rbd-fuse-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:08.815 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:08.816 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T20:56:08.816 INFO:teuthology.orchestra.run.trial153.stdout: rbd-fuse-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:08.816 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:08.816 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:08.845 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install rbd-mirror 2026-02-17T20:56:08.846 INFO:teuthology.orchestra.run.trial104.stdout:Package librados2-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:56:08.863 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:08.863 INFO:teuthology.orchestra.run.trial104.stdout:Nothing to do. 2026-02-17T20:56:08.864 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:08.885 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install librbd1 2026-02-17T20:56:09.153 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:09.194 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:09.234 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:09.235 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:09.235 INFO:teuthology.orchestra.run.trial153.stdout: Package Arch Version Repo Size 2026-02-17T20:56:09.235 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:09.236 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T20:56:09.236 INFO:teuthology.orchestra.run.trial153.stdout: rbd-mirror x86_64 2:19.2.3-683.g76b494d6.el9 ceph 3.1 M 2026-02-17T20:56:09.236 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:09.236 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T20:56:09.236 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:09.236 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T20:56:09.236 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:09.236 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 3.1 M 2026-02-17T20:56:09.236 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 13 M 2026-02-17T20:56:09.236 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T20:56:09.258 INFO:teuthology.orchestra.run.trial104.stdout:Package librbd1-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:56:09.276 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:09.277 INFO:teuthology.orchestra.run.trial104.stdout:Nothing to do. 2026-02-17T20:56:09.277 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:09.299 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install python3-rados 2026-02-17T20:56:09.384 INFO:teuthology.orchestra.run.trial153.stdout:rbd-mirror-19.2.3-683.g76b494d6.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T20:56:09.385 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:56:09.385 INFO:teuthology.orchestra.run.trial153.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T20:56:09.385 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T20:56:09.389 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T20:56:09.389 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T20:56:09.431 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T20:56:09.431 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T20:56:09.604 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:37 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:09.629 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T20:56:09.631 INFO:teuthology.orchestra.run.trial153.stdout: Installing : rbd-mirror-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:09.654 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: rbd-mirror-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:09.654 INFO:teuthology.orchestra.run.trial153.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:56:09.654 INFO:teuthology.orchestra.run.trial153.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T20:56:09.654 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T20:56:09.654 INFO:teuthology.orchestra.run.trial153.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T20:56:09.654 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:09.669 INFO:teuthology.orchestra.run.trial104.stdout:Package python3-rados-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:56:09.686 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:09.687 INFO:teuthology.orchestra.run.trial104.stdout:Nothing to do. 2026-02-17T20:56:09.687 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:09.709 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install python3-rgw 2026-02-17T20:56:09.930 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : rbd-mirror-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:09.930 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:09.931 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T20:56:09.931 INFO:teuthology.orchestra.run.trial153.stdout: rbd-mirror-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:09.931 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:09.931 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:09.958 DEBUG:teuthology.orchestra.run.trial153:> sudo yum -y install rbd-nbd 2026-02-17T20:56:10.020 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:10.084 INFO:teuthology.orchestra.run.trial104.stdout:Package python3-rgw-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:56:10.103 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:10.104 INFO:teuthology.orchestra.run.trial104.stdout:Nothing to do. 2026-02-17T20:56:10.104 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:10.126 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install python3-cephfs 2026-02-17T20:56:10.271 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:10.353 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T20:56:10.353 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:10.353 INFO:teuthology.orchestra.run.trial153.stdout: Package Architecture Version Repository Size 2026-02-17T20:56:10.353 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:10.353 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T20:56:10.353 INFO:teuthology.orchestra.run.trial153.stdout: rbd-nbd x86_64 2:19.2.3-683.g76b494d6.el9 ceph 171 k 2026-02-17T20:56:10.354 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:10.354 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T20:56:10.354 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T20:56:10.354 INFO:teuthology.orchestra.run.trial153.stdout:Install 1 Package 2026-02-17T20:56:10.354 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:10.354 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 171 k 2026-02-17T20:56:10.354 INFO:teuthology.orchestra.run.trial153.stdout:Installed size: 490 k 2026-02-17T20:56:10.354 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T20:56:10.439 INFO:teuthology.orchestra.run.trial153.stdout:rbd-nbd-19.2.3-683.g76b494d6.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2026-02-17T20:56:10.440 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:56:10.440 INFO:teuthology.orchestra.run.trial153.stdout:Total 1.9 MB/s | 171 kB 00:00 2026-02-17T20:56:10.440 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T20:56:10.443 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T20:56:10.443 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T20:56:10.444 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:10.475 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T20:56:10.475 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T20:56:10.510 INFO:teuthology.orchestra.run.trial104.stdout:Package python3-cephfs-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:56:10.528 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:10.529 INFO:teuthology.orchestra.run.trial104.stdout:Nothing to do. 2026-02-17T20:56:10.529 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:10.530 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T20:56:10.546 INFO:teuthology.orchestra.run.trial153.stdout: Installing : rbd-nbd-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:10.551 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install python3-rbd 2026-02-17T20:56:10.625 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: rbd-nbd-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:10.683 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : rbd-nbd-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:10.683 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:10.683 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T20:56:10.683 INFO:teuthology.orchestra.run.trial153.stdout: rbd-nbd-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:10.684 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:10.684 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T20:56:10.713 DEBUG:teuthology.parallel:result is None 2026-02-17T20:56:10.859 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:38 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:10.923 INFO:teuthology.orchestra.run.trial104.stdout:Package python3-rbd-2:19.2.3-683.g76b494d6.el9.x86_64 is already installed. 2026-02-17T20:56:10.941 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:10.942 INFO:teuthology.orchestra.run.trial104.stdout:Nothing to do. 2026-02-17T20:56:10.942 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:10.964 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install rbd-fuse 2026-02-17T20:56:11.278 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:39 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:11.361 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:11.361 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:11.361 INFO:teuthology.orchestra.run.trial104.stdout: Package Architecture Version Repository Size 2026-02-17T20:56:11.361 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:11.361 INFO:teuthology.orchestra.run.trial104.stdout:Installing: 2026-02-17T20:56:11.361 INFO:teuthology.orchestra.run.trial104.stdout: rbd-fuse x86_64 2:19.2.3-683.g76b494d6.el9 ceph 85 k 2026-02-17T20:56:11.361 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:11.362 INFO:teuthology.orchestra.run.trial104.stdout:Transaction Summary 2026-02-17T20:56:11.362 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:11.362 INFO:teuthology.orchestra.run.trial104.stdout:Install 1 Package 2026-02-17T20:56:11.362 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:11.362 INFO:teuthology.orchestra.run.trial104.stdout:Total download size: 85 k 2026-02-17T20:56:11.362 INFO:teuthology.orchestra.run.trial104.stdout:Installed size: 227 k 2026-02-17T20:56:11.362 INFO:teuthology.orchestra.run.trial104.stdout:Downloading Packages: 2026-02-17T20:56:11.434 INFO:teuthology.orchestra.run.trial104.stdout:rbd-fuse-19.2.3-683.g76b494d6.el9.x86_64.rpm 1.1 MB/s | 85 kB 00:00 2026-02-17T20:56:11.435 INFO:teuthology.orchestra.run.trial104.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:56:11.436 INFO:teuthology.orchestra.run.trial104.stdout:Total 1.1 MB/s | 85 kB 00:00 2026-02-17T20:56:11.436 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction check 2026-02-17T20:56:11.438 INFO:teuthology.orchestra.run.trial104.stdout:Transaction check succeeded. 2026-02-17T20:56:11.438 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction test 2026-02-17T20:56:11.470 INFO:teuthology.orchestra.run.trial104.stdout:Transaction test succeeded. 2026-02-17T20:56:11.471 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction 2026-02-17T20:56:11.522 INFO:teuthology.orchestra.run.trial104.stdout: Preparing : 1/1 2026-02-17T20:56:11.540 INFO:teuthology.orchestra.run.trial104.stdout: Installing : rbd-fuse-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:11.619 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: rbd-fuse-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:11.677 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : rbd-fuse-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:11.677 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:11.677 INFO:teuthology.orchestra.run.trial104.stdout:Installed: 2026-02-17T20:56:11.677 INFO:teuthology.orchestra.run.trial104.stdout: rbd-fuse-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:11.677 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:11.677 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:11.705 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install rbd-mirror 2026-02-17T20:56:12.024 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:40 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:12.106 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:12.107 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:12.107 INFO:teuthology.orchestra.run.trial104.stdout: Package Arch Version Repo Size 2026-02-17T20:56:12.107 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:12.107 INFO:teuthology.orchestra.run.trial104.stdout:Installing: 2026-02-17T20:56:12.107 INFO:teuthology.orchestra.run.trial104.stdout: rbd-mirror x86_64 2:19.2.3-683.g76b494d6.el9 ceph 3.1 M 2026-02-17T20:56:12.107 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:12.107 INFO:teuthology.orchestra.run.trial104.stdout:Transaction Summary 2026-02-17T20:56:12.107 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:12.107 INFO:teuthology.orchestra.run.trial104.stdout:Install 1 Package 2026-02-17T20:56:12.107 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:12.108 INFO:teuthology.orchestra.run.trial104.stdout:Total download size: 3.1 M 2026-02-17T20:56:12.108 INFO:teuthology.orchestra.run.trial104.stdout:Installed size: 13 M 2026-02-17T20:56:12.108 INFO:teuthology.orchestra.run.trial104.stdout:Downloading Packages: 2026-02-17T20:56:12.255 INFO:teuthology.orchestra.run.trial104.stdout:rbd-mirror-19.2.3-683.g76b494d6.el9.x86_64.rpm 21 MB/s | 3.1 MB 00:00 2026-02-17T20:56:12.256 INFO:teuthology.orchestra.run.trial104.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:56:12.256 INFO:teuthology.orchestra.run.trial104.stdout:Total 21 MB/s | 3.1 MB 00:00 2026-02-17T20:56:12.256 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction check 2026-02-17T20:56:12.260 INFO:teuthology.orchestra.run.trial104.stdout:Transaction check succeeded. 2026-02-17T20:56:12.260 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction test 2026-02-17T20:56:12.302 INFO:teuthology.orchestra.run.trial104.stdout:Transaction test succeeded. 2026-02-17T20:56:12.302 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction 2026-02-17T20:56:12.497 INFO:teuthology.orchestra.run.trial104.stdout: Preparing : 1/1 2026-02-17T20:56:12.499 INFO:teuthology.orchestra.run.trial104.stdout: Installing : rbd-mirror-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:12.521 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: rbd-mirror-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:12.522 INFO:teuthology.orchestra.run.trial104.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-17T20:56:12.522 INFO:teuthology.orchestra.run.trial104.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-17T20:56:12.522 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T20:56:12.522 INFO:teuthology.orchestra.run.trial104.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-17T20:56:12.522 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:12.838 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : rbd-mirror-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:12.839 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:12.839 INFO:teuthology.orchestra.run.trial104.stdout:Installed: 2026-02-17T20:56:12.839 INFO:teuthology.orchestra.run.trial104.stdout: rbd-mirror-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:12.839 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:12.839 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:12.867 DEBUG:teuthology.orchestra.run.trial104:> sudo yum -y install rbd-nbd 2026-02-17T20:56:13.180 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:00:41 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T20:56:13.262 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T20:56:13.263 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:13.263 INFO:teuthology.orchestra.run.trial104.stdout: Package Architecture Version Repository Size 2026-02-17T20:56:13.263 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:13.263 INFO:teuthology.orchestra.run.trial104.stdout:Installing: 2026-02-17T20:56:13.263 INFO:teuthology.orchestra.run.trial104.stdout: rbd-nbd x86_64 2:19.2.3-683.g76b494d6.el9 ceph 171 k 2026-02-17T20:56:13.264 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:13.264 INFO:teuthology.orchestra.run.trial104.stdout:Transaction Summary 2026-02-17T20:56:13.264 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T20:56:13.264 INFO:teuthology.orchestra.run.trial104.stdout:Install 1 Package 2026-02-17T20:56:13.264 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:13.264 INFO:teuthology.orchestra.run.trial104.stdout:Total download size: 171 k 2026-02-17T20:56:13.264 INFO:teuthology.orchestra.run.trial104.stdout:Installed size: 490 k 2026-02-17T20:56:13.264 INFO:teuthology.orchestra.run.trial104.stdout:Downloading Packages: 2026-02-17T20:56:13.348 INFO:teuthology.orchestra.run.trial104.stdout:rbd-nbd-19.2.3-683.g76b494d6.el9.x86_64.rpm 2.0 MB/s | 171 kB 00:00 2026-02-17T20:56:13.348 INFO:teuthology.orchestra.run.trial104.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:56:13.348 INFO:teuthology.orchestra.run.trial104.stdout:Total 2.0 MB/s | 171 kB 00:00 2026-02-17T20:56:13.348 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction check 2026-02-17T20:56:13.351 INFO:teuthology.orchestra.run.trial104.stdout:Transaction check succeeded. 2026-02-17T20:56:13.351 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction test 2026-02-17T20:56:13.384 INFO:teuthology.orchestra.run.trial104.stdout:Transaction test succeeded. 2026-02-17T20:56:13.384 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction 2026-02-17T20:56:13.440 INFO:teuthology.orchestra.run.trial104.stdout: Preparing : 1/1 2026-02-17T20:56:13.457 INFO:teuthology.orchestra.run.trial104.stdout: Installing : rbd-nbd-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:13.541 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: rbd-nbd-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:13.599 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : rbd-nbd-2:19.2.3-683.g76b494d6.el9.x86_64 1/1 2026-02-17T20:56:13.599 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:13.599 INFO:teuthology.orchestra.run.trial104.stdout:Installed: 2026-02-17T20:56:13.600 INFO:teuthology.orchestra.run.trial104.stdout: rbd-nbd-2:19.2.3-683.g76b494d6.el9.x86_64 2026-02-17T20:56:13.600 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:13.600 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T20:56:13.633 DEBUG:teuthology.parallel:result is None 2026-02-17T20:56:13.634 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=76b494d6529326129dc43abf3fffd48fbf35c395 2026-02-17T20:56:13.808 DEBUG:teuthology.orchestra.run.trial104:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T20:56:13.830 INFO:teuthology.orchestra.run.trial104.stdout:19.2.3-683.g76b494d6.el9 2026-02-17T20:56:13.831 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-683.g76b494d6.el9 2026-02-17T20:56:13.831 INFO:teuthology.task.install:The correct ceph version 19.2.3-683.g76b494d6 is installed. 2026-02-17T20:56:13.833 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=76b494d6529326129dc43abf3fffd48fbf35c395 2026-02-17T20:56:13.993 DEBUG:teuthology.orchestra.run.trial153:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-17T20:56:14.015 INFO:teuthology.orchestra.run.trial153.stdout:19.2.3-683.g76b494d6.el9 2026-02-17T20:56:14.015 INFO:teuthology.packaging:The installed version of ceph is 19.2.3-683.g76b494d6.el9 2026-02-17T20:56:14.015 INFO:teuthology.task.install:The correct ceph version 19.2.3-683.g76b494d6 is installed. 2026-02-17T20:56:14.018 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-17T20:56:14.018 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:56:14.018 DEBUG:teuthology.orchestra.run.trial104:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T20:56:14.044 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T20:56:14.044 DEBUG:teuthology.orchestra.run.trial153:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-17T20:56:14.083 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-17T20:56:14.083 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:56:14.083 DEBUG:teuthology.orchestra.run.trial104:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T20:56:14.108 DEBUG:teuthology.orchestra.run.trial104:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T20:56:14.173 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T20:56:14.173 DEBUG:teuthology.orchestra.run.trial153:> sudo dd of=/usr/bin/daemon-helper 2026-02-17T20:56:14.198 DEBUG:teuthology.orchestra.run.trial153:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-17T20:56:14.262 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-17T20:56:14.263 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:56:14.263 DEBUG:teuthology.orchestra.run.trial104:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T20:56:14.288 DEBUG:teuthology.orchestra.run.trial104:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T20:56:14.351 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T20:56:14.352 DEBUG:teuthology.orchestra.run.trial153:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-17T20:56:14.377 DEBUG:teuthology.orchestra.run.trial153:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-17T20:56:14.440 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-17T20:56:14.440 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:56:14.441 DEBUG:teuthology.orchestra.run.trial104:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T20:56:14.466 DEBUG:teuthology.orchestra.run.trial104:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T20:56:14.529 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T20:56:14.529 DEBUG:teuthology.orchestra.run.trial153:> sudo dd of=/usr/bin/stdin-killer 2026-02-17T20:56:14.554 DEBUG:teuthology.orchestra.run.trial153:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-17T20:56:14.619 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-17T20:56:14.743 INFO:tasks.cephadm:Config: {'roleless': True, 'cluster-conf': {'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'MGR_MODULE_ERROR', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded', 'pg .* is stuck peering'], 'sha1': '76b494d6529326129dc43abf3fffd48fbf35c395'} 2026-02-17T20:56:14.743 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 2026-02-17T20:56:14.745 INFO:tasks.cephadm:Cluster fsid is 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T20:56:14.745 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-17T20:56:14.745 INFO:tasks.cephadm:No mon roles; fabricating mons 2026-02-17T20:56:14.745 INFO:tasks.cephadm:Monitor IPs: {'mon.trial104': '10.20.193.104', 'mon.trial153': '10.20.193.153'} 2026-02-17T20:56:14.745 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-17T20:56:14.745 DEBUG:teuthology.orchestra.run.trial104:> sudo hostname $(hostname -s) 2026-02-17T20:56:14.770 DEBUG:teuthology.orchestra.run.trial153:> sudo hostname $(hostname -s) 2026-02-17T20:56:14.794 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-17T20:56:14.795 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=76b494d6529326129dc43abf3fffd48fbf35c395 2026-02-17T20:56:14.914 INFO:tasks.cephadm:builder_project result: [{'url': 'https://1.chacra.ceph.com/r/ceph/wip-jcollin-testing-20260217.024944-squid/76b494d6529326129dc43abf3fffd48fbf35c395/centos/9/flavors/default/', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-jcollin-testing-20260217.024944-squid/76b494d6529326129dc43abf3fffd48fbf35c395/centos/9/flavors/default/', 'ref': 'wip-jcollin-testing-20260217.024944-squid', 'sha1': '76b494d6529326129dc43abf3fffd48fbf35c395', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-17 08:22:27.127422', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['x86_64', 'source'], 'extra': {'version': '19.2.3-683-g76b494d6', 'package_manager_version': '19.2.3-683.g76b494d6', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/3012/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-17T20:56:15.058 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-jcollin-testing-20260217.024944-squid, sha1 76b494d6529326129dc43abf3fffd48fbf35c395 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=76b494d6529326129dc43abf3fffd48fbf35c395 2026-02-17T20:56:15.059 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-jcollin-testing-20260217.024944-squid/76b494d6529326129dc43abf3fffd48fbf35c395/centos/9/x86_64/flavors/default/cephadm 2026-02-17T20:56:15.059 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/wip-jcollin-testing-20260217.024944-squid/76b494d6529326129dc43abf3fffd48fbf35c395/centos/9/x86_64/flavors/default/cephadm 2026-02-17T20:56:15.060 DEBUG:teuthology.orchestra.run.trial104:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-jcollin-testing-20260217.024944-squid/76b494d6529326129dc43abf3fffd48fbf35c395/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-17T20:56:15.314 INFO:teuthology.orchestra.run.trial104.stdout:-rw-r--r--. 1 ubuntu ubuntu 788313 Feb 17 20:56 /home/ubuntu/cephtest/cephadm 2026-02-17T20:56:15.315 DEBUG:teuthology.orchestra.run.trial153:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-jcollin-testing-20260217.024944-squid/76b494d6529326129dc43abf3fffd48fbf35c395/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-17T20:56:15.561 INFO:teuthology.orchestra.run.trial153.stdout:-rw-r--r--. 1 ubuntu ubuntu 788313 Feb 17 20:56 /home/ubuntu/cephtest/cephadm 2026-02-17T20:56:15.561 DEBUG:teuthology.orchestra.run.trial104:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-17T20:56:15.581 DEBUG:teuthology.orchestra.run.trial153:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-17T20:56:15.615 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 on all hosts... 2026-02-17T20:56:15.615 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 pull 2026-02-17T20:56:15.624 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 pull 2026-02-17T20:56:15.765 INFO:teuthology.orchestra.run.trial104.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395... 2026-02-17T20:56:15.791 INFO:teuthology.orchestra.run.trial153.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395... 2026-02-17T20:56:26.013 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-17T20:56:26.014 INFO:teuthology.orchestra.run.trial104.stdout: "ceph_version": "ceph version 19.2.3-683-g76b494d6 (76b494d6529326129dc43abf3fffd48fbf35c395) squid (stable)", 2026-02-17T20:56:26.014 INFO:teuthology.orchestra.run.trial104.stdout: "image_id": "84fe6a74d1a3b04fa5507f6b41ae53d9c56c792c6c3b180af58806b7da32b8a7", 2026-02-17T20:56:26.014 INFO:teuthology.orchestra.run.trial104.stdout: "repo_digests": [ 2026-02-17T20:56:26.014 INFO:teuthology.orchestra.run.trial104.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf" 2026-02-17T20:56:26.014 INFO:teuthology.orchestra.run.trial104.stdout: ] 2026-02-17T20:56:26.014 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-17T20:56:26.047 INFO:teuthology.orchestra.run.trial153.stdout:{ 2026-02-17T20:56:26.048 INFO:teuthology.orchestra.run.trial153.stdout: "ceph_version": "ceph version 19.2.3-683-g76b494d6 (76b494d6529326129dc43abf3fffd48fbf35c395) squid (stable)", 2026-02-17T20:56:26.048 INFO:teuthology.orchestra.run.trial153.stdout: "image_id": "84fe6a74d1a3b04fa5507f6b41ae53d9c56c792c6c3b180af58806b7da32b8a7", 2026-02-17T20:56:26.048 INFO:teuthology.orchestra.run.trial153.stdout: "repo_digests": [ 2026-02-17T20:56:26.048 INFO:teuthology.orchestra.run.trial153.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf" 2026-02-17T20:56:26.048 INFO:teuthology.orchestra.run.trial153.stdout: ] 2026-02-17T20:56:26.048 INFO:teuthology.orchestra.run.trial153.stdout:} 2026-02-17T20:56:26.063 DEBUG:teuthology.orchestra.run.trial104:> sudo mkdir -p /etc/ceph 2026-02-17T20:56:26.093 DEBUG:teuthology.orchestra.run.trial153:> sudo mkdir -p /etc/ceph 2026-02-17T20:56:26.120 DEBUG:teuthology.orchestra.run.trial104:> sudo chmod 777 /etc/ceph 2026-02-17T20:56:26.156 DEBUG:teuthology.orchestra.run.trial153:> sudo chmod 777 /etc/ceph 2026-02-17T20:56:26.185 INFO:tasks.cephadm:Writing seed config... 2026-02-17T20:56:26.187 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2026-02-17T20:56:26.187 INFO:tasks.cephadm: override: [client] debug client = 20 2026-02-17T20:56:26.188 INFO:tasks.cephadm: override: [client] debug ms = 1 2026-02-17T20:56:26.188 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2026-02-17T20:56:26.188 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2026-02-17T20:56:26.188 INFO:tasks.cephadm: override: [mds] debug mds = 20 2026-02-17T20:56:26.188 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2026-02-17T20:56:26.188 INFO:tasks.cephadm: override: [mds] debug ms = 1 2026-02-17T20:56:26.188 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2026-02-17T20:56:26.188 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2026-02-17T20:56:26.188 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2026-02-17T20:56:26.188 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2026-02-17T20:56:26.188 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2026-02-17T20:56:26.189 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2026-02-17T20:56:26.189 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2026-02-17T20:56:26.189 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-17T20:56:26.189 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-17T20:56:26.189 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-17T20:56:26.189 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-17T20:56:26.189 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-17T20:56:26.189 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-17T20:56:26.189 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2026-02-17T20:56:26.189 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-17T20:56:26.189 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-17T20:56:26.189 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2026-02-17T20:56:26.189 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-17T20:56:26.191 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:56:26.191 DEBUG:teuthology.orchestra.run.trial104:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-17T20:56:26.212 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 19072504-0c43-11f1-93a3-d404e6e7d460 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2026-02-17T20:56:26.213 DEBUG:teuthology.orchestra.run.trial104:mon.trial104> sudo journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@mon.trial104.service 2026-02-17T20:56:26.254 INFO:tasks.cephadm:Bootstrapping... 2026-02-17T20:56:26.254 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 -v bootstrap --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 10.20.193.104 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-17T20:56:26.390 INFO:teuthology.orchestra.run.trial104.stdout:-------------------------------------------------------------------------------- 2026-02-17T20:56:26.390 INFO:teuthology.orchestra.run.trial104.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395', '-v', 'bootstrap', '--fsid', '19072504-0c43-11f1-93a3-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '10.20.193.104', '--skip-admin-label'] 2026-02-17T20:56:26.390 INFO:teuthology.orchestra.run.trial104.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-17T20:56:26.391 INFO:teuthology.orchestra.run.trial104.stdout:Verifying podman|docker is present... 2026-02-17T20:56:26.405 INFO:teuthology.orchestra.run.trial104.stdout:/bin/podman: stdout 5.6.0 2026-02-17T20:56:26.405 INFO:teuthology.orchestra.run.trial104.stdout:Verifying lvm2 is present... 2026-02-17T20:56:26.406 INFO:teuthology.orchestra.run.trial104.stdout:Verifying time synchronization is in place... 2026-02-17T20:56:26.412 INFO:teuthology.orchestra.run.trial104.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-17T20:56:26.412 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-17T20:56:26.418 INFO:teuthology.orchestra.run.trial104.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-17T20:56:26.418 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stdout inactive 2026-02-17T20:56:26.423 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stdout enabled 2026-02-17T20:56:26.429 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stdout active 2026-02-17T20:56:26.429 INFO:teuthology.orchestra.run.trial104.stdout:Unit chronyd.service is enabled and running 2026-02-17T20:56:26.429 INFO:teuthology.orchestra.run.trial104.stdout:Repeating the final host check... 2026-02-17T20:56:26.444 INFO:teuthology.orchestra.run.trial104.stdout:/bin/podman: stdout 5.6.0 2026-02-17T20:56:26.444 INFO:teuthology.orchestra.run.trial104.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-17T20:56:26.444 INFO:teuthology.orchestra.run.trial104.stdout:systemctl is present 2026-02-17T20:56:26.444 INFO:teuthology.orchestra.run.trial104.stdout:lvcreate is present 2026-02-17T20:56:26.449 INFO:teuthology.orchestra.run.trial104.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-17T20:56:26.449 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-17T20:56:26.454 INFO:teuthology.orchestra.run.trial104.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-17T20:56:26.454 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stdout inactive 2026-02-17T20:56:26.460 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stdout enabled 2026-02-17T20:56:26.466 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stdout active 2026-02-17T20:56:26.466 INFO:teuthology.orchestra.run.trial104.stdout:Unit chronyd.service is enabled and running 2026-02-17T20:56:26.466 INFO:teuthology.orchestra.run.trial104.stdout:Host looks OK 2026-02-17T20:56:26.466 INFO:teuthology.orchestra.run.trial104.stdout:Cluster fsid: 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T20:56:26.466 INFO:teuthology.orchestra.run.trial104.stdout:Acquiring lock 140555706634784 on /run/cephadm/19072504-0c43-11f1-93a3-d404e6e7d460.lock 2026-02-17T20:56:26.467 INFO:teuthology.orchestra.run.trial104.stdout:Lock 140555706634784 acquired on /run/cephadm/19072504-0c43-11f1-93a3-d404e6e7d460.lock 2026-02-17T20:56:26.467 INFO:teuthology.orchestra.run.trial104.stdout:Verifying IP 10.20.193.104 port 3300 ... 2026-02-17T20:56:26.467 INFO:teuthology.orchestra.run.trial104.stdout:Verifying IP 10.20.193.104 port 6789 ... 2026-02-17T20:56:26.467 INFO:teuthology.orchestra.run.trial104.stdout:Base mon IP(s) is [10.20.193.104:3300, 10.20.193.104:6789], mon addrv is [v2:10.20.193.104:3300,v1:10.20.193.104:6789] 2026-02-17T20:56:26.470 INFO:teuthology.orchestra.run.trial104.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.104 metric 102 2026-02-17T20:56:26.470 INFO:teuthology.orchestra.run.trial104.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.104 metric 102 2026-02-17T20:56:26.470 INFO:teuthology.orchestra.run.trial104.stdout:/sbin/ip: stdout 169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-17T20:56:26.472 INFO:teuthology.orchestra.run.trial104.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-17T20:56:26.472 INFO:teuthology.orchestra.run.trial104.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2026-02-17T20:56:26.472 INFO:teuthology.orchestra.run.trial104.stdout:/sbin/ip: stdout fe80::/64 dev enp7s0f4u2u2c2 proto kernel metric 1024 pref medium 2026-02-17T20:56:26.475 INFO:teuthology.orchestra.run.trial104.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-17T20:56:26.475 INFO:teuthology.orchestra.run.trial104.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-17T20:56:26.475 INFO:teuthology.orchestra.run.trial104.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T20:56:26.476 INFO:teuthology.orchestra.run.trial104.stdout:/sbin/ip: stdout 2: enp7s0f4u2u2c2: mtu 1500 state UNKNOWN qlen 1000 2026-02-17T20:56:26.476 INFO:teuthology.orchestra.run.trial104.stdout:/sbin/ip: stdout inet6 fe80::e028:ad31:1ea:b356/64 scope link noprefixroute 2026-02-17T20:56:26.476 INFO:teuthology.orchestra.run.trial104.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T20:56:26.476 INFO:teuthology.orchestra.run.trial104.stdout:/sbin/ip: stdout 3: enp1s0f0: mtu 1500 state UP qlen 1000 2026-02-17T20:56:26.476 INFO:teuthology.orchestra.run.trial104.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:645e/64 scope link 2026-02-17T20:56:26.476 INFO:teuthology.orchestra.run.trial104.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-17T20:56:26.476 INFO:teuthology.orchestra.run.trial104.stdout:Mon IP `10.20.193.104` is in CIDR network `10.20.192.0/20` 2026-02-17T20:56:26.476 INFO:teuthology.orchestra.run.trial104.stdout:Mon IP `10.20.193.104` is in CIDR network `10.20.192.0/20` 2026-02-17T20:56:26.476 INFO:teuthology.orchestra.run.trial104.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-17T20:56:26.476 INFO:teuthology.orchestra.run.trial104.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-17T20:56:26.477 INFO:teuthology.orchestra.run.trial104.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395... 2026-02-17T20:56:26.745 INFO:teuthology.orchestra.run.trial104.stdout:/bin/podman: stdout 84fe6a74d1a3b04fa5507f6b41ae53d9c56c792c6c3b180af58806b7da32b8a7 2026-02-17T20:56:26.746 INFO:teuthology.orchestra.run.trial104.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395... 2026-02-17T20:56:26.746 INFO:teuthology.orchestra.run.trial104.stdout:/bin/podman: stderr Getting image source signatures 2026-02-17T20:56:26.746 INFO:teuthology.orchestra.run.trial104.stdout:/bin/podman: stderr Copying blob sha256:6159efc34100d0fd7f59ccd51479cdc2462259449397eddb697a6bf79f130b47 2026-02-17T20:56:26.746 INFO:teuthology.orchestra.run.trial104.stdout:/bin/podman: stderr Copying blob sha256:5dd85e1a50663785d86adae5ef92579a03e6f64059ca9c005010518acdd62048 2026-02-17T20:56:26.746 INFO:teuthology.orchestra.run.trial104.stdout:/bin/podman: stderr Copying config sha256:84fe6a74d1a3b04fa5507f6b41ae53d9c56c792c6c3b180af58806b7da32b8a7 2026-02-17T20:56:26.746 INFO:teuthology.orchestra.run.trial104.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-17T20:56:26.852 INFO:teuthology.orchestra.run.trial104.stdout:ceph: stdout ceph version 19.2.3-683-g76b494d6 (76b494d6529326129dc43abf3fffd48fbf35c395) squid (stable) 2026-02-17T20:56:26.852 INFO:teuthology.orchestra.run.trial104.stdout:Ceph version: ceph version 19.2.3-683-g76b494d6 (76b494d6529326129dc43abf3fffd48fbf35c395) squid (stable) 2026-02-17T20:56:26.853 INFO:teuthology.orchestra.run.trial104.stdout:Extracting ceph user uid/gid from container image... 2026-02-17T20:56:26.978 INFO:teuthology.orchestra.run.trial104.stdout:stat: stdout 167 167 2026-02-17T20:56:26.978 INFO:teuthology.orchestra.run.trial104.stdout:Creating initial keys... 2026-02-17T20:56:27.100 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph-authtool: stdout AQD71ZRp9fN0BBAA9GcSA/1GSIGIUo0J7EeYSQ== 2026-02-17T20:56:27.236 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph-authtool: stdout AQD71ZRpmaQdDBAA8tmL7+iwIVdZr7kLSxBAJA== 2026-02-17T20:56:27.357 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph-authtool: stdout AQD71ZRpde7uExAAV7o4FAh8Bvs5r/RjrARpKg== 2026-02-17T20:56:27.358 INFO:teuthology.orchestra.run.trial104.stdout:Creating initial monmap... 2026-02-17T20:56:27.483 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-17T20:56:27.483 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2026-02-17T20:56:27.483 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T20:56:27.483 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-17T20:56:27.483 INFO:teuthology.orchestra.run.trial104.stdout:monmaptool for trial104 [v2:10.20.193.104:3300,v1:10.20.193.104:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-17T20:56:27.483 INFO:teuthology.orchestra.run.trial104.stdout:setting min_mon_release = quincy 2026-02-17T20:56:27.483 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/monmaptool: set fsid to 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T20:56:27.484 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-17T20:56:27.484 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:27.484 INFO:teuthology.orchestra.run.trial104.stdout:Creating mon... 2026-02-17T20:56:27.604 INFO:teuthology.orchestra.run.trial104.stdout:create mon.trial104 on 2026-02-17T20:56:27.777 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-17T20:56:27.870 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-17T20:56:27.980 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-19072504-0c43-11f1-93a3-d404e6e7d460.target → /etc/systemd/system/ceph-19072504-0c43-11f1-93a3-d404e6e7d460.target. 2026-02-17T20:56:27.980 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-19072504-0c43-11f1-93a3-d404e6e7d460.target → /etc/systemd/system/ceph-19072504-0c43-11f1-93a3-d404e6e7d460.target. 2026-02-17T20:56:28.107 INFO:teuthology.orchestra.run.trial104.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-19072504-0c43-11f1-93a3-d404e6e7d460@mon.trial104 2026-02-17T20:56:28.107 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stderr Failed to reset failed state of unit ceph-19072504-0c43-11f1-93a3-d404e6e7d460@mon.trial104.service: Unit ceph-19072504-0c43-11f1-93a3-d404e6e7d460@mon.trial104.service not loaded. 2026-02-17T20:56:28.233 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-19072504-0c43-11f1-93a3-d404e6e7d460.target.wants/ceph-19072504-0c43-11f1-93a3-d404e6e7d460@mon.trial104.service → /etc/systemd/system/ceph-19072504-0c43-11f1-93a3-d404e6e7d460@.service. 2026-02-17T20:56:28.373 INFO:teuthology.orchestra.run.trial104.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T20:56:28.373 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stdout disabled 2026-02-17T20:56:28.379 INFO:teuthology.orchestra.run.trial104.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T20:56:28.379 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stdout inactive 2026-02-17T20:56:28.379 INFO:teuthology.orchestra.run.trial104.stdout:firewalld.service is not enabled 2026-02-17T20:56:28.379 INFO:teuthology.orchestra.run.trial104.stdout:Not possible to enable service . firewalld.service is not available 2026-02-17T20:56:28.379 INFO:teuthology.orchestra.run.trial104.stdout:Waiting for mon to start... 2026-02-17T20:56:28.379 INFO:teuthology.orchestra.run.trial104.stdout:Waiting for mon... 2026-02-17T20:56:28.385 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:28 trial104 systemd[1]: Started Ceph mon.trial104 for 19072504-0c43-11f1-93a3-d404e6e7d460. 2026-02-17T20:56:28.540 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout cluster: 2026-02-17T20:56:28.540 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout id: 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T20:56:28.540 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-17T20:56:28.540 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout 2026-02-17T20:56:28.541 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout services: 2026-02-17T20:56:28.541 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum trial104 (age 0.132321s) 2026-02-17T20:56:28.541 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-17T20:56:28.541 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-17T20:56:28.541 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout 2026-02-17T20:56:28.541 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout data: 2026-02-17T20:56:28.541 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-17T20:56:28.541 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-17T20:56:28.541 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-17T20:56:28.541 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout pgs: 2026-02-17T20:56:28.541 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout 2026-02-17T20:56:28.541 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.477+0000 7f371689a640 1 Processor -- start 2026-02-17T20:56:28.542 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.477+0000 7f371689a640 1 -- start start 2026-02-17T20:56:28.542 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.477+0000 7f371689a640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37101075d0 0x7f37101079d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:28.542 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.477+0000 7f371689a640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3710107fa0 con 0x7f37101075d0 2026-02-17T20:56:28.542 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.478+0000 7f370ffff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37101075d0 0x7f37101079d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:28.542 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.478+0000 7f370ffff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37101075d0 0x7f37101079d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33410/0 (socket says 10.20.193.104:33410) 2026-02-17T20:56:28.542 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.478+0000 7f370ffff640 1 -- 10.20.193.104:0/2496672069 learned_addr learned my addr 10.20.193.104:0/2496672069 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:28.542 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.478+0000 7f370ffff640 1 -- 10.20.193.104:0/2496672069 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37101087d0 con 0x7f37101075d0 2026-02-17T20:56:28.542 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.479+0000 7f370ffff640 1 --2- 10.20.193.104:0/2496672069 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37101075d0 0x7f37101079d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009920 tx=0x7f36fc02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48789cdaab227798 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:28.542 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.479+0000 7f370effd640 1 -- 10.20.193.104:0/2496672069 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f36fc03c070 con 0x7f37101075d0 2026-02-17T20:56:28.542 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.479+0000 7f370effd640 1 -- 10.20.193.104:0/2496672069 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36fc02f9b0 con 0x7f37101075d0 2026-02-17T20:56:28.542 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.479+0000 7f370effd640 1 -- 10.20.193.104:0/2496672069 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f36fc02fcd0 con 0x7f37101075d0 2026-02-17T20:56:28.542 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.479+0000 7f371689a640 1 -- 10.20.193.104:0/2496672069 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37101075d0 msgr2=0x7f37101079d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:28.543 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.479+0000 7f371689a640 1 --2- 10.20.193.104:0/2496672069 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37101075d0 0x7f37101079d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009920 tx=0x7f36fc02ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:28.543 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.480+0000 7f371689a640 1 -- 10.20.193.104:0/2496672069 shutdown_connections 2026-02-17T20:56:28.543 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.480+0000 7f371689a640 1 --2- 10.20.193.104:0/2496672069 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37101075d0 0x7f37101079d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:28.543 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.480+0000 7f371689a640 1 -- 10.20.193.104:0/2496672069 >> 10.20.193.104:0/2496672069 conn(0x7f3710102d80 msgr2=0x7f37101051a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:28.543 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.480+0000 7f371689a640 1 -- 10.20.193.104:0/2496672069 shutdown_connections 2026-02-17T20:56:28.543 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.480+0000 7f371689a640 1 -- 10.20.193.104:0/2496672069 wait complete. 2026-02-17T20:56:28.543 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.480+0000 7f371689a640 1 Processor -- start 2026-02-17T20:56:28.543 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.480+0000 7f371689a640 1 -- start start 2026-02-17T20:56:28.543 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.480+0000 7f371689a640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37101075d0 0x7f371019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:28.543 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.480+0000 7f371689a640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3710108d00 con 0x7f37101075d0 2026-02-17T20:56:28.543 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.480+0000 7f370ffff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37101075d0 0x7f371019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:28.543 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.480+0000 7f370ffff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37101075d0 0x7f371019cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33424/0 (socket says 10.20.193.104:33424) 2026-02-17T20:56:28.544 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.480+0000 7f370ffff640 1 -- 10.20.193.104:0/1564766772 learned_addr learned my addr 10.20.193.104:0/1564766772 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:28.544 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.481+0000 7f370ffff640 1 -- 10.20.193.104:0/1564766772 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371019d1d0 con 0x7f37101075d0 2026-02-17T20:56:28.544 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.481+0000 7f370ffff640 1 --2- 10.20.193.104:0/1564766772 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37101075d0 0x7f371019cc90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009a50 tx=0x7f36fc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:28.544 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.481+0000 7f370d7fa640 1 -- 10.20.193.104:0/1564766772 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f36fc043410 con 0x7f37101075d0 2026-02-17T20:56:28.544 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.481+0000 7f370d7fa640 1 -- 10.20.193.104:0/1564766772 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36fc048070 con 0x7f37101075d0 2026-02-17T20:56:28.544 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.481+0000 7f371689a640 1 -- 10.20.193.104:0/1564766772 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f371019d460 con 0x7f37101075d0 2026-02-17T20:56:28.544 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.481+0000 7f370d7fa640 1 -- 10.20.193.104:0/1564766772 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f36fc043760 con 0x7f37101075d0 2026-02-17T20:56:28.544 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.481+0000 7f371689a640 1 -- 10.20.193.104:0/1564766772 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37101a0150 con 0x7f37101075d0 2026-02-17T20:56:28.544 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.481+0000 7f370d7fa640 1 -- 10.20.193.104:0/1564766772 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f36fc043900 con 0x7f37101075d0 2026-02-17T20:56:28.544 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.481+0000 7f370d7fa640 1 -- 10.20.193.104:0/1564766772 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f36fc04da40 con 0x7f37101075d0 2026-02-17T20:56:28.544 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.481+0000 7f371689a640 1 -- 10.20.193.104:0/1564766772 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37101093c0 con 0x7f37101075d0 2026-02-17T20:56:28.544 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.483+0000 7f370d7fa640 1 -- 10.20.193.104:0/1564766772 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f36fc040050 con 0x7f37101075d0 2026-02-17T20:56:28.545 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.513+0000 7f371689a640 1 -- 10.20.193.104:0/1564766772 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f3710195be0 con 0x7f37101075d0 2026-02-17T20:56:28.545 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.513+0000 7f370d7fa640 1 -- 10.20.193.104:0/1564766772 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+324 (secure 0 0 0) 0x7f3710195be0 con 0x7f37101075d0 2026-02-17T20:56:28.545 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.514+0000 7f371689a640 1 -- 10.20.193.104:0/1564766772 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37101075d0 msgr2=0x7f371019cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:28.545 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.514+0000 7f371689a640 1 --2- 10.20.193.104:0/1564766772 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37101075d0 0x7f371019cc90 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f36fc009a50 tx=0x7f36fc0047c0 comp rx=0 tx=0).stop 2026-02-17T20:56:28.545 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.514+0000 7f371689a640 1 -- 10.20.193.104:0/1564766772 shutdown_connections 2026-02-17T20:56:28.545 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.514+0000 7f371689a640 1 --2- 10.20.193.104:0/1564766772 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37101075d0 0x7f371019cc90 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:28.545 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.514+0000 7f371689a640 1 -- 10.20.193.104:0/1564766772 >> 10.20.193.104:0/1564766772 conn(0x7f3710102d80 msgr2=0x7f3710190e60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:28.545 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.514+0000 7f371689a640 1 -- 10.20.193.104:0/1564766772 shutdown_connections 2026-02-17T20:56:28.545 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.514+0000 7f371689a640 1 -- 10.20.193.104:0/1564766772 wait complete. 2026-02-17T20:56:28.545 INFO:teuthology.orchestra.run.trial104.stdout:mon is available 2026-02-17T20:56:28.545 INFO:teuthology.orchestra.run.trial104.stdout:Assimilating anything we can from ceph.conf... 2026-02-17T20:56:28.635 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:28 trial104 ceph-mon[20182]: mkfs 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T20:56:28.635 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:28 trial104 ceph-mon[20182]: mon.trial104 is new leader, mons trial104 in quorum (ranks 0) 2026-02-17T20:56:28.689 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout 2026-02-17T20:56:28.689 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout [global] 2026-02-17T20:56:28.689 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout fsid = 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T20:56:28.689 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-17T20:56:28.689 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.104:3300,v1:10.20.193.104:6789] 2026-02-17T20:56:28.689 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-17T20:56:28.690 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-17T20:56:28.690 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-17T20:56:28.690 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-17T20:56:28.690 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout 2026-02-17T20:56:28.690 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-17T20:56:28.690 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-17T20:56:28.690 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout 2026-02-17T20:56:28.690 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout [osd] 2026-02-17T20:56:28.690 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-17T20:56:28.690 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-17T20:56:28.690 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.632+0000 7f1f21bb8640 1 Processor -- start 2026-02-17T20:56:28.690 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.632+0000 7f1f21bb8640 1 -- start start 2026-02-17T20:56:28.691 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.632+0000 7f1f21bb8640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1f1c109880 0x7f1f1c109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:28.691 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.632+0000 7f1f21bb8640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c10a250 con 0x7f1f1c109880 2026-02-17T20:56:28.691 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.632+0000 7f1f1b7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1f1c109880 0x7f1f1c109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:28.691 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.632+0000 7f1f1b7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1f1c109880 0x7f1f1c109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33430/0 (socket says 10.20.193.104:33430) 2026-02-17T20:56:28.691 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.632+0000 7f1f1b7fe640 1 -- 10.20.193.104:0/2590137500 learned_addr learned my addr 10.20.193.104:0/2590137500 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:28.691 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.632+0000 7f1f1b7fe640 1 -- 10.20.193.104:0/2590137500 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c10aa80 con 0x7f1f1c109880 2026-02-17T20:56:28.691 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.633+0000 7f1f1b7fe640 1 --2- 10.20.193.104:0/2590137500 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1f1c109880 0x7f1f1c109c80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1f08009920 tx=0x7f1f0802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d20c566109e6a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:28.691 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.633+0000 7f1f1a7fc640 1 -- 10.20.193.104:0/2590137500 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f1f0803c070 con 0x7f1f1c109880 2026-02-17T20:56:28.691 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.633+0000 7f1f1a7fc640 1 -- 10.20.193.104:0/2590137500 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f0802f9b0 con 0x7f1f1c109880 2026-02-17T20:56:28.691 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.633+0000 7f1f1a7fc640 1 -- 10.20.193.104:0/2590137500 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f1f0802fcd0 con 0x7f1f1c109880 2026-02-17T20:56:28.691 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.633+0000 7f1f21bb8640 1 -- 10.20.193.104:0/2590137500 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1f1c109880 msgr2=0x7f1f1c109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:28.691 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.633+0000 7f1f21bb8640 1 --2- 10.20.193.104:0/2590137500 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1f1c109880 0x7f1f1c109c80 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f1f08009920 tx=0x7f1f0802ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:28.692 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.633+0000 7f1f21bb8640 1 -- 10.20.193.104:0/2590137500 shutdown_connections 2026-02-17T20:56:28.692 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.633+0000 7f1f21bb8640 1 --2- 10.20.193.104:0/2590137500 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1f1c109880 0x7f1f1c109c80 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:28.692 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.633+0000 7f1f21bb8640 1 -- 10.20.193.104:0/2590137500 >> 10.20.193.104:0/2590137500 conn(0x7f1f1c07ce10 msgr2=0x7f1f1c07d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:28.692 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.633+0000 7f1f21bb8640 1 -- 10.20.193.104:0/2590137500 shutdown_connections 2026-02-17T20:56:28.692 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.633+0000 7f1f21bb8640 1 -- 10.20.193.104:0/2590137500 wait complete. 2026-02-17T20:56:28.692 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.634+0000 7f1f21bb8640 1 Processor -- start 2026-02-17T20:56:28.692 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.634+0000 7f1f21bb8640 1 -- start start 2026-02-17T20:56:28.692 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.634+0000 7f1f21bb8640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1f1c109880 0x7f1f1c19eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:28.692 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.634+0000 7f1f21bb8640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1c10afb0 con 0x7f1f1c109880 2026-02-17T20:56:28.692 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.634+0000 7f1f1b7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1f1c109880 0x7f1f1c19eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:28.692 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.634+0000 7f1f1b7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1f1c109880 0x7f1f1c19eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33438/0 (socket says 10.20.193.104:33438) 2026-02-17T20:56:28.692 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.634+0000 7f1f1b7fe640 1 -- 10.20.193.104:0/3853360358 learned_addr learned my addr 10.20.193.104:0/3853360358 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:28.693 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.634+0000 7f1f1b7fe640 1 -- 10.20.193.104:0/3853360358 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f1c19f420 con 0x7f1f1c109880 2026-02-17T20:56:28.693 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.634+0000 7f1f1b7fe640 1 --2- 10.20.193.104:0/3853360358 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1f1c109880 0x7f1f1c19eee0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1f08009a50 tx=0x7f1f080047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:28.693 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.634+0000 7f1f18ff9640 1 -- 10.20.193.104:0/3853360358 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f1f08043410 con 0x7f1f1c109880 2026-02-17T20:56:28.693 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.634+0000 7f1f18ff9640 1 -- 10.20.193.104:0/3853360358 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f08048070 con 0x7f1f1c109880 2026-02-17T20:56:28.693 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.634+0000 7f1f21bb8640 1 -- 10.20.193.104:0/3853360358 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1c19f6b0 con 0x7f1f1c109880 2026-02-17T20:56:28.693 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.634+0000 7f1f18ff9640 1 -- 10.20.193.104:0/3853360358 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f1f08043760 con 0x7f1f1c109880 2026-02-17T20:56:28.693 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.634+0000 7f1f21bb8640 1 -- 10.20.193.104:0/3853360358 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1c1a23a0 con 0x7f1f1c109880 2026-02-17T20:56:28.693 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.634+0000 7f1f18ff9640 1 -- 10.20.193.104:0/3853360358 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f1f08043900 con 0x7f1f1c109880 2026-02-17T20:56:28.693 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.634+0000 7f1f18ff9640 1 -- 10.20.193.104:0/3853360358 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1f0804da40 con 0x7f1f1c109880 2026-02-17T20:56:28.693 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.635+0000 7f1f21bb8640 1 -- 10.20.193.104:0/3853360358 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f1c10b670 con 0x7f1f1c109880 2026-02-17T20:56:28.693 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.636+0000 7f1f18ff9640 1 -- 10.20.193.104:0/3853360358 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f1f08040050 con 0x7f1f1c109880 2026-02-17T20:56:28.693 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.663+0000 7f1f21bb8640 1 -- 10.20.193.104:0/3853360358 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f1f1c1981a0 con 0x7f1f1c109880 2026-02-17T20:56:28.694 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.665+0000 7f1f18ff9640 1 -- 10.20.193.104:0/3853360358 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+376 (secure 0 0 0) 0x7f1f0804d460 con 0x7f1f1c109880 2026-02-17T20:56:28.694 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.666+0000 7f1f18ff9640 1 -- 10.20.193.104:0/3853360358 <== mon.0 v2:10.20.193.104:3300/0 8 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f1f0802f9b0 con 0x7f1f1c109880 2026-02-17T20:56:28.694 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.666+0000 7f1f21bb8640 1 -- 10.20.193.104:0/3853360358 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1f1c109880 msgr2=0x7f1f1c19eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:28.694 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.666+0000 7f1f21bb8640 1 --2- 10.20.193.104:0/3853360358 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1f1c109880 0x7f1f1c19eee0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1f08009a50 tx=0x7f1f080047c0 comp rx=0 tx=0).stop 2026-02-17T20:56:28.694 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.666+0000 7f1f21bb8640 1 -- 10.20.193.104:0/3853360358 shutdown_connections 2026-02-17T20:56:28.694 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.666+0000 7f1f21bb8640 1 --2- 10.20.193.104:0/3853360358 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1f1c109880 0x7f1f1c19eee0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:28.694 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.666+0000 7f1f21bb8640 1 -- 10.20.193.104:0/3853360358 >> 10.20.193.104:0/3853360358 conn(0x7f1f1c07ce10 msgr2=0x7f1f1c1931d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:28.694 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.666+0000 7f1f21bb8640 1 -- 10.20.193.104:0/3853360358 shutdown_connections 2026-02-17T20:56:28.694 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.666+0000 7f1f21bb8640 1 -- 10.20.193.104:0/3853360358 wait complete. 2026-02-17T20:56:28.694 INFO:teuthology.orchestra.run.trial104.stdout:Generating new minimal ceph.conf... 2026-02-17T20:56:28.845 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.778+0000 7fc98cc57640 1 Processor -- start 2026-02-17T20:56:28.845 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.778+0000 7fc98cc57640 1 -- start start 2026-02-17T20:56:28.845 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.778+0000 7fc98cc57640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc988107600 0x7fc988107a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:28.845 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.778+0000 7fc98cc57640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc988107fd0 con 0x7fc988107600 2026-02-17T20:56:28.845 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.778+0000 7fc986575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc988107600 0x7fc988107a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:28.846 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.778+0000 7fc986575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc988107600 0x7fc988107a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33442/0 (socket says 10.20.193.104:33442) 2026-02-17T20:56:28.846 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.778+0000 7fc986575640 1 -- 10.20.193.104:0/890012163 learned_addr learned my addr 10.20.193.104:0/890012163 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:28.847 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.778+0000 7fc986575640 1 -- 10.20.193.104:0/890012163 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc988108800 con 0x7fc988107600 2026-02-17T20:56:28.847 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.778+0000 7fc986575640 1 --2- 10.20.193.104:0/890012163 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc988107600 0x7fc988107a00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009920 tx=0x7fc97c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78afa207c2b0b25a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:28.847 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.779+0000 7fc985573640 1 -- 10.20.193.104:0/890012163 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fc97c03c070 con 0x7fc988107600 2026-02-17T20:56:28.847 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.779+0000 7fc985573640 1 -- 10.20.193.104:0/890012163 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fc97c02fe00 con 0x7fc988107600 2026-02-17T20:56:28.847 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.779+0000 7fc985573640 1 -- 10.20.193.104:0/890012163 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fc97c035340 con 0x7fc988107600 2026-02-17T20:56:28.847 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.779+0000 7fc98cc57640 1 -- 10.20.193.104:0/890012163 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc988107600 msgr2=0x7fc988107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:28.847 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.779+0000 7fc98cc57640 1 --2- 10.20.193.104:0/890012163 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc988107600 0x7fc988107a00 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009920 tx=0x7fc97c02ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:28.847 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.779+0000 7fc98cc57640 1 -- 10.20.193.104:0/890012163 shutdown_connections 2026-02-17T20:56:28.847 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.779+0000 7fc98cc57640 1 --2- 10.20.193.104:0/890012163 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc988107600 0x7fc988107a00 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:28.848 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.779+0000 7fc98cc57640 1 -- 10.20.193.104:0/890012163 >> 10.20.193.104:0/890012163 conn(0x7fc988102dd0 msgr2=0x7fc9881051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:28.848 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.779+0000 7fc98cc57640 1 -- 10.20.193.104:0/890012163 shutdown_connections 2026-02-17T20:56:28.848 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.779+0000 7fc98cc57640 1 -- 10.20.193.104:0/890012163 wait complete. 2026-02-17T20:56:28.848 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.779+0000 7fc98cc57640 1 Processor -- start 2026-02-17T20:56:28.848 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.779+0000 7fc98cc57640 1 -- start start 2026-02-17T20:56:28.848 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.779+0000 7fc98cc57640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc988107600 0x7fc98807d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:28.848 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.779+0000 7fc98cc57640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc98810ba30 con 0x7fc988107600 2026-02-17T20:56:28.848 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.779+0000 7fc986575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc988107600 0x7fc98807d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:28.848 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.779+0000 7fc986575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc988107600 0x7fc98807d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33454/0 (socket says 10.20.193.104:33454) 2026-02-17T20:56:28.848 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.779+0000 7fc986575640 1 -- 10.20.193.104:0/1342306590 learned_addr learned my addr 10.20.193.104:0/1342306590 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:28.849 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.780+0000 7fc986575640 1 -- 10.20.193.104:0/1342306590 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc98807d9a0 con 0x7fc988107600 2026-02-17T20:56:28.849 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.780+0000 7fc986575640 1 --2- 10.20.193.104:0/1342306590 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc988107600 0x7fc98807d460 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc97c037b20 tx=0x7fc97c0358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:28.849 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.780+0000 7fc96f7fe640 1 -- 10.20.193.104:0/1342306590 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fc97c035c10 con 0x7fc988107600 2026-02-17T20:56:28.849 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.780+0000 7fc96f7fe640 1 -- 10.20.193.104:0/1342306590 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fc97c035db0 con 0x7fc988107600 2026-02-17T20:56:28.849 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.780+0000 7fc96f7fe640 1 -- 10.20.193.104:0/1342306590 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fc97c0413a0 con 0x7fc988107600 2026-02-17T20:56:28.849 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.780+0000 7fc98cc57640 1 -- 10.20.193.104:0/1342306590 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc98807bb90 con 0x7fc988107600 2026-02-17T20:56:28.849 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.780+0000 7fc98cc57640 1 -- 10.20.193.104:0/1342306590 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc98807c010 con 0x7fc988107600 2026-02-17T20:56:28.849 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.780+0000 7fc96f7fe640 1 -- 10.20.193.104:0/1342306590 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fc97c041650 con 0x7fc988107600 2026-02-17T20:56:28.849 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.780+0000 7fc96f7fe640 1 -- 10.20.193.104:0/1342306590 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc97c04b920 con 0x7fc988107600 2026-02-17T20:56:28.849 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.780+0000 7fc98cc57640 1 -- 10.20.193.104:0/1342306590 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc988107a80 con 0x7fc988107600 2026-02-17T20:56:28.850 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.781+0000 7fc96f7fe640 1 -- 10.20.193.104:0/1342306590 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fc97c04b3f0 con 0x7fc988107600 2026-02-17T20:56:28.850 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.808+0000 7fc98cc57640 1 -- 10.20.193.104:0/1342306590 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fc98807c320 con 0x7fc988107600 2026-02-17T20:56:28.850 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.808+0000 7fc96f7fe640 1 -- 10.20.193.104:0/1342306590 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7fc97c04bb20 con 0x7fc988107600 2026-02-17T20:56:28.850 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.809+0000 7fc98cc57640 1 -- 10.20.193.104:0/1342306590 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc988107600 msgr2=0x7fc98807d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:28.850 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.809+0000 7fc98cc57640 1 --2- 10.20.193.104:0/1342306590 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc988107600 0x7fc98807d460 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc97c037b20 tx=0x7fc97c0358c0 comp rx=0 tx=0).stop 2026-02-17T20:56:28.850 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.809+0000 7fc98cc57640 1 -- 10.20.193.104:0/1342306590 shutdown_connections 2026-02-17T20:56:28.850 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.809+0000 7fc98cc57640 1 --2- 10.20.193.104:0/1342306590 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc988107600 0x7fc98807d460 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:28.850 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.809+0000 7fc98cc57640 1 -- 10.20.193.104:0/1342306590 >> 10.20.193.104:0/1342306590 conn(0x7fc988102dd0 msgr2=0x7fc988103940 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:28.850 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.809+0000 7fc98cc57640 1 -- 10.20.193.104:0/1342306590 shutdown_connections 2026-02-17T20:56:28.850 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:28.809+0000 7fc98cc57640 1 -- 10.20.193.104:0/1342306590 wait complete. 2026-02-17T20:56:28.850 INFO:teuthology.orchestra.run.trial104.stdout:Restarting the monitor... 2026-02-17T20:56:28.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:28 trial104 systemd[1]: Stopping Ceph mon.trial104 for 19072504-0c43-11f1-93a3-d404e6e7d460... 2026-02-17T20:56:29.170 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:28 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial104[20178]: 2026-02-17T20:56:28.913+0000 7f3d87fd1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.trial104 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T20:56:29.170 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:28 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial104[20178]: 2026-02-17T20:56:28.913+0000 7f3d87fd1640 -1 mon.trial104@0(leader) e1 *** Got Signal Terminated *** 2026-02-17T20:56:29.171 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 podman[20460]: 2026-02-17 20:56:29.026739369 +0000 UTC m=+0.124686177 container died 1aed8be3d2256a8809593ef09061a197b54fae5f18a25c2b60426da863fe6626 (image=quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial104, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.build-date=20260216, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2026-02-17T20:56:29.171 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 podman[20460]: 2026-02-17 20:56:29.035440879 +0000 UTC m=+0.133387687 container remove 1aed8be3d2256a8809593ef09061a197b54fae5f18a25c2b60426da863fe6626 (image=quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial104, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3) 2026-02-17T20:56:29.171 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 bash[20460]: ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial104 2026-02-17T20:56:29.171 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 systemd[1]: ceph-19072504-0c43-11f1-93a3-d404e6e7d460@mon.trial104.service: Deactivated successfully. 2026-02-17T20:56:29.171 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 systemd[1]: Stopped Ceph mon.trial104 for 19072504-0c43-11f1-93a3-d404e6e7d460. 2026-02-17T20:56:29.171 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 systemd[1]: Starting Ceph mon.trial104 for 19072504-0c43-11f1-93a3-d404e6e7d460... 2026-02-17T20:56:29.171 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 podman[20586]: 2026-02-17 20:56:29.169022735 +0000 UTC m=+0.015598595 container create 23121052e3237832733ba590e6f1cb30649b6804b3c21640872430b063a02f06 (image=quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial104, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, io.buildah.version=1.41.3, ceph=True, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-17T20:56:29.201 INFO:teuthology.orchestra.run.trial104.stdout:Setting public_network to 10.20.192.0/20 in mon config section 2026-02-17T20:56:29.377 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.304+0000 7f9ee194b640 1 Processor -- start 2026-02-17T20:56:29.377 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.304+0000 7f9ee194b640 1 -- start start 2026-02-17T20:56:29.377 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.304+0000 7f9ee194b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9edc109880 0x7f9edc109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:29.378 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.304+0000 7f9ee194b640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc10a250 con 0x7f9edc109880 2026-02-17T20:56:29.378 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.304+0000 7f9edaffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9edc109880 0x7f9edc109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:29.378 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.304+0000 7f9edaffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9edc109880 0x7f9edc109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33464/0 (socket says 10.20.193.104:33464) 2026-02-17T20:56:29.378 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.304+0000 7f9edaffd640 1 -- 10.20.193.104:0/2192336014 learned_addr learned my addr 10.20.193.104:0/2192336014 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:29.378 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.304+0000 7f9edaffd640 1 -- 10.20.193.104:0/2192336014 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc10aa80 con 0x7f9edc109880 2026-02-17T20:56:29.378 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.305+0000 7f9edaffd640 1 --2- 10.20.193.104:0/2192336014 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9edc109880 0x7f9edc109c80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009920 tx=0x7f9ed002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ddf0bd8658e448 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:29.378 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.305+0000 7f9ed9ffb640 1 -- 10.20.193.104:0/2192336014 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f9ed003c070 con 0x7f9edc109880 2026-02-17T20:56:29.378 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.305+0000 7f9ed9ffb640 1 -- 10.20.193.104:0/2192336014 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f9ed002fe00 con 0x7f9edc109880 2026-02-17T20:56:29.378 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.306+0000 7f9ed9ffb640 1 -- 10.20.193.104:0/2192336014 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f9ed0035340 con 0x7f9edc109880 2026-02-17T20:56:29.378 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.306+0000 7f9ee194b640 1 -- 10.20.193.104:0/2192336014 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9edc109880 msgr2=0x7f9edc109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:29.378 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.306+0000 7f9ee194b640 1 --2- 10.20.193.104:0/2192336014 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9edc109880 0x7f9edc109c80 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0009920 tx=0x7f9ed002ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:29.378 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.306+0000 7f9ee194b640 1 -- 10.20.193.104:0/2192336014 shutdown_connections 2026-02-17T20:56:29.379 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.306+0000 7f9ee194b640 1 --2- 10.20.193.104:0/2192336014 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9edc109880 0x7f9edc109c80 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:29.379 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.306+0000 7f9ee194b640 1 -- 10.20.193.104:0/2192336014 >> 10.20.193.104:0/2192336014 conn(0x7f9edc07cf00 msgr2=0x7f9edc07d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:29.379 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.306+0000 7f9ee194b640 1 -- 10.20.193.104:0/2192336014 shutdown_connections 2026-02-17T20:56:29.379 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.306+0000 7f9ee194b640 1 -- 10.20.193.104:0/2192336014 wait complete. 2026-02-17T20:56:29.379 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.306+0000 7f9ee194b640 1 Processor -- start 2026-02-17T20:56:29.379 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.306+0000 7f9ee194b640 1 -- start start 2026-02-17T20:56:29.379 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.306+0000 7f9ee194b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9edc109880 0x7f9edc19f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:29.379 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.306+0000 7f9ee194b640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc10dcb0 con 0x7f9edc109880 2026-02-17T20:56:29.379 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.306+0000 7f9edaffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9edc109880 0x7f9edc19f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:29.379 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.306+0000 7f9edaffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9edc109880 0x7f9edc19f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33468/0 (socket says 10.20.193.104:33468) 2026-02-17T20:56:29.379 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.306+0000 7f9edaffd640 1 -- 10.20.193.104:0/1518344452 learned_addr learned my addr 10.20.193.104:0/1518344452 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:29.379 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.307+0000 7f9edaffd640 1 -- 10.20.193.104:0/1518344452 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc19fce0 con 0x7f9edc109880 2026-02-17T20:56:29.380 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.307+0000 7f9edaffd640 1 --2- 10.20.193.104:0/1518344452 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9edc109880 0x7f9edc19f7a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0037b20 tx=0x7f9ed00358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:29.380 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.307+0000 7f9ee0949640 1 -- 10.20.193.104:0/1518344452 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f9ed0035c10 con 0x7f9edc109880 2026-02-17T20:56:29.380 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.307+0000 7f9ee0949640 1 -- 10.20.193.104:0/1518344452 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f9ed0035db0 con 0x7f9edc109880 2026-02-17T20:56:29.380 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.307+0000 7f9ee0949640 1 -- 10.20.193.104:0/1518344452 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f9ed00413a0 con 0x7f9edc109880 2026-02-17T20:56:29.380 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.307+0000 7f9ee194b640 1 -- 10.20.193.104:0/1518344452 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc19ff70 con 0x7f9edc109880 2026-02-17T20:56:29.380 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.307+0000 7f9ee194b640 1 -- 10.20.193.104:0/1518344452 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9edc1a2c60 con 0x7f9edc109880 2026-02-17T20:56:29.380 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.307+0000 7f9ee0949640 1 -- 10.20.193.104:0/1518344452 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f9ed0041650 con 0x7f9edc109880 2026-02-17T20:56:29.380 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.307+0000 7f9ee0949640 1 -- 10.20.193.104:0/1518344452 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9ed004b920 con 0x7f9edc109880 2026-02-17T20:56:29.380 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.307+0000 7f9ee194b640 1 -- 10.20.193.104:0/1518344452 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9edc109d00 con 0x7f9edc109880 2026-02-17T20:56:29.380 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.309+0000 7f9ee0949640 1 -- 10.20.193.104:0/1518344452 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f9ed004b3f0 con 0x7f9edc109880 2026-02-17T20:56:29.381 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.336+0000 7f9ee194b640 1 -- 10.20.193.104:0/1518344452 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f9edc1a2ed0 con 0x7f9edc109880 2026-02-17T20:56:29.381 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.337+0000 7f9ee0949640 1 -- 10.20.193.104:0/1518344452 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 125+0+0 (secure 0 0 0) 0x7f9ed004bb20 con 0x7f9edc109880 2026-02-17T20:56:29.381 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.337+0000 7f9ee194b640 1 -- 10.20.193.104:0/1518344452 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9edc109880 msgr2=0x7f9edc19f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:29.381 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.337+0000 7f9ee194b640 1 --2- 10.20.193.104:0/1518344452 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9edc109880 0x7f9edc19f7a0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9ed0037b20 tx=0x7f9ed00358c0 comp rx=0 tx=0).stop 2026-02-17T20:56:29.381 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.337+0000 7f9ee194b640 1 -- 10.20.193.104:0/1518344452 shutdown_connections 2026-02-17T20:56:29.381 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.337+0000 7f9ee194b640 1 --2- 10.20.193.104:0/1518344452 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9edc109880 0x7f9edc19f7a0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:29.381 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.337+0000 7f9ee194b640 1 -- 10.20.193.104:0/1518344452 >> 10.20.193.104:0/1518344452 conn(0x7f9edc07cf00 msgr2=0x7f9edc1070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:29.381 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.337+0000 7f9ee194b640 1 -- 10.20.193.104:0/1518344452 shutdown_connections 2026-02-17T20:56:29.381 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.337+0000 7f9ee194b640 1 -- 10.20.193.104:0/1518344452 wait complete. 2026-02-17T20:56:29.381 INFO:teuthology.orchestra.run.trial104.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-17T20:56:29.381 INFO:teuthology.orchestra.run.trial104.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-17T20:56:29.381 INFO:teuthology.orchestra.run.trial104.stdout:Creating mgr... 2026-02-17T20:56:29.382 INFO:teuthology.orchestra.run.trial104.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-17T20:56:29.382 INFO:teuthology.orchestra.run.trial104.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-17T20:56:29.382 INFO:teuthology.orchestra.run.trial104.stdout:Verifying port 0.0.0.0:8443 ... 2026-02-17T20:56:29.491 INFO:teuthology.orchestra.run.trial104.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-19072504-0c43-11f1-93a3-d404e6e7d460@mgr.trial104.irrhmt 2026-02-17T20:56:29.492 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stderr Failed to reset failed state of unit ceph-19072504-0c43-11f1-93a3-d404e6e7d460@mgr.trial104.irrhmt.service: Unit ceph-19072504-0c43-11f1-93a3-d404e6e7d460@mgr.trial104.irrhmt.service not loaded. 2026-02-17T20:56:29.498 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 podman[20586]: 2026-02-17 20:56:29.193845154 +0000 UTC m=+0.040421014 container init 23121052e3237832733ba590e6f1cb30649b6804b3c21640872430b063a02f06 (image=quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial104, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, io.buildah.version=1.41.3, ceph=True) 2026-02-17T20:56:29.498 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 podman[20586]: 2026-02-17 20:56:29.196280547 +0000 UTC m=+0.042856407 container start 23121052e3237832733ba590e6f1cb30649b6804b3c21640872430b063a02f06 (image=quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial104, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-17T20:56:29.498 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 bash[20586]: 23121052e3237832733ba590e6f1cb30649b6804b3c21640872430b063a02f06 2026-02-17T20:56:29.498 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 podman[20586]: 2026-02-17 20:56:29.162565631 +0000 UTC m=+0.009141491 image pull 84fe6a74d1a3b04fa5507f6b41ae53d9c56c792c6c3b180af58806b7da32b8a7 quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 2026-02-17T20:56:29.498 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 systemd[1]: Started Ceph mon.trial104 for 19072504-0c43-11f1-93a3-d404e6e7d460. 2026-02-17T20:56:29.498 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: set uid:gid to 167:167 (ceph:ceph) 2026-02-17T20:56:29.498 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: ceph version 19.2.3-683-g76b494d6 (76b494d6529326129dc43abf3fffd48fbf35c395) squid (stable), process ceph-mon, pid 2 2026-02-17T20:56:29.499 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: pidfile_write: ignore empty --pid-file 2026-02-17T20:56:29.499 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: load: jerasure load: lrc 2026-02-17T20:56:29.499 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: RocksDB version: 7.9.2 2026-02-17T20:56:29.499 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Git sha 0 2026-02-17T20:56:29.499 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Compile date 2026-02-17 07:38:05 2026-02-17T20:56:29.499 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: DB SUMMARY 2026-02-17T20:56:29.499 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: DB Session ID: NG94QN1FRH712I8FXZDW 2026-02-17T20:56:29.499 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: CURRENT file: CURRENT 2026-02-17T20:56:29.499 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: IDENTITY file: IDENTITY 2026-02-17T20:56:29.499 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-17T20:56:29.499 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: SST files in /var/lib/ceph/mon/ceph-trial104/store.db dir, Total Num: 1, files: 000008.sst 2026-02-17T20:56:29.500 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-trial104/store.db: 000009.log size: 82941 ; 2026-02-17T20:56:29.500 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.error_if_exists: 0 2026-02-17T20:56:29.500 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.create_if_missing: 0 2026-02-17T20:56:29.500 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.paranoid_checks: 1 2026-02-17T20:56:29.500 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-17T20:56:29.500 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-17T20:56:29.500 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-17T20:56:29.500 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.env: 0x5654102d8dc0 2026-02-17T20:56:29.500 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.fs: PosixFileSystem 2026-02-17T20:56:29.500 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.info_log: 0x565411627a20 2026-02-17T20:56:29.500 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_file_opening_threads: 16 2026-02-17T20:56:29.500 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.statistics: (nil) 2026-02-17T20:56:29.501 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.use_fsync: 0 2026-02-17T20:56:29.501 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_log_file_size: 0 2026-02-17T20:56:29.501 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-17T20:56:29.501 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-17T20:56:29.501 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.keep_log_file_num: 1000 2026-02-17T20:56:29.501 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.recycle_log_file_num: 0 2026-02-17T20:56:29.501 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.allow_fallocate: 1 2026-02-17T20:56:29.501 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.allow_mmap_reads: 0 2026-02-17T20:56:29.501 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.allow_mmap_writes: 0 2026-02-17T20:56:29.501 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.use_direct_reads: 0 2026-02-17T20:56:29.501 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-17T20:56:29.501 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.create_missing_column_families: 0 2026-02-17T20:56:29.501 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.db_log_dir: 2026-02-17T20:56:29.502 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.wal_dir: 2026-02-17T20:56:29.502 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-17T20:56:29.502 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-17T20:56:29.502 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-17T20:56:29.502 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-17T20:56:29.502 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-17T20:56:29.502 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-17T20:56:29.502 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.advise_random_on_open: 1 2026-02-17T20:56:29.502 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.db_write_buffer_size: 0 2026-02-17T20:56:29.502 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.write_buffer_manager: 0x56541162b900 2026-02-17T20:56:29.502 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-17T20:56:29.502 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-17T20:56:29.502 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-17T20:56:29.503 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.rate_limiter: (nil) 2026-02-17T20:56:29.503 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-17T20:56:29.503 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.wal_recovery_mode: 2 2026-02-17T20:56:29.503 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.enable_thread_tracking: 0 2026-02-17T20:56:29.503 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.enable_pipelined_write: 0 2026-02-17T20:56:29.503 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.unordered_write: 0 2026-02-17T20:56:29.503 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-17T20:56:29.503 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-17T20:56:29.503 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-17T20:56:29.503 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-17T20:56:29.503 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.row_cache: None 2026-02-17T20:56:29.503 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.wal_filter: None 2026-02-17T20:56:29.504 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-17T20:56:29.504 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.allow_ingest_behind: 0 2026-02-17T20:56:29.504 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.two_write_queues: 0 2026-02-17T20:56:29.504 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.manual_wal_flush: 0 2026-02-17T20:56:29.504 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.wal_compression: 0 2026-02-17T20:56:29.504 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.atomic_flush: 0 2026-02-17T20:56:29.504 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-17T20:56:29.504 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-17T20:56:29.504 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-17T20:56:29.504 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.log_readahead_size: 0 2026-02-17T20:56:29.504 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-17T20:56:29.504 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.best_efforts_recovery: 0 2026-02-17T20:56:29.505 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-17T20:56:29.505 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-17T20:56:29.505 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.allow_data_in_errors: 0 2026-02-17T20:56:29.505 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.db_host_id: __hostname__ 2026-02-17T20:56:29.505 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-17T20:56:29.505 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_background_jobs: 2 2026-02-17T20:56:29.505 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_background_compactions: -1 2026-02-17T20:56:29.505 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_subcompactions: 1 2026-02-17T20:56:29.505 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-17T20:56:29.505 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-17T20:56:29.505 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-17T20:56:29.505 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_total_wal_size: 0 2026-02-17T20:56:29.505 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-17T20:56:29.506 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-17T20:56:29.506 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-17T20:56:29.506 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-17T20:56:29.506 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_open_files: -1 2026-02-17T20:56:29.506 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.bytes_per_sync: 0 2026-02-17T20:56:29.506 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-17T20:56:29.506 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-17T20:56:29.506 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compaction_readahead_size: 0 2026-02-17T20:56:29.506 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_background_flushes: -1 2026-02-17T20:56:29.506 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Compression algorithms supported: 2026-02-17T20:56:29.506 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: kZSTD supported: 0 2026-02-17T20:56:29.506 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: kXpressCompression supported: 0 2026-02-17T20:56:29.506 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: kBZip2Compression supported: 0 2026-02-17T20:56:29.506 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-17T20:56:29.507 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: kLZ4Compression supported: 1 2026-02-17T20:56:29.507 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: kZlibCompression supported: 1 2026-02-17T20:56:29.507 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: kLZ4HCCompression supported: 1 2026-02-17T20:56:29.507 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: kSnappyCompression supported: 1 2026-02-17T20:56:29.507 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-17T20:56:29.507 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-17T20:56:29.507 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-trial104/store.db/MANIFEST-000010 2026-02-17T20:56:29.507 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-17T20:56:29.507 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-17T20:56:29.507 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.merge_operator: 2026-02-17T20:56:29.507 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compaction_filter: None 2026-02-17T20:56:29.507 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compaction_filter_factory: None 2026-02-17T20:56:29.508 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.sst_partitioner_factory: None 2026-02-17T20:56:29.508 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-17T20:56:29.508 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-17T20:56:29.508 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x565411626700) 2026-02-17T20:56:29.508 INFO:journalctl@ceph.mon.trial104.trial104.stdout: cache_index_and_filter_blocks: 1 2026-02-17T20:56:29.508 INFO:journalctl@ceph.mon.trial104.trial104.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-17T20:56:29.508 INFO:journalctl@ceph.mon.trial104.trial104.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-17T20:56:29.508 INFO:journalctl@ceph.mon.trial104.trial104.stdout: pin_top_level_index_and_filter: 1 2026-02-17T20:56:29.508 INFO:journalctl@ceph.mon.trial104.trial104.stdout: index_type: 0 2026-02-17T20:56:29.508 INFO:journalctl@ceph.mon.trial104.trial104.stdout: data_block_index_type: 0 2026-02-17T20:56:29.508 INFO:journalctl@ceph.mon.trial104.trial104.stdout: index_shortening: 1 2026-02-17T20:56:29.508 INFO:journalctl@ceph.mon.trial104.trial104.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-17T20:56:29.509 INFO:journalctl@ceph.mon.trial104.trial104.stdout: checksum: 4 2026-02-17T20:56:29.509 INFO:journalctl@ceph.mon.trial104.trial104.stdout: no_block_cache: 0 2026-02-17T20:56:29.509 INFO:journalctl@ceph.mon.trial104.trial104.stdout: block_cache: 0x56541164b350 2026-02-17T20:56:29.509 INFO:journalctl@ceph.mon.trial104.trial104.stdout: block_cache_name: BinnedLRUCache 2026-02-17T20:56:29.509 INFO:journalctl@ceph.mon.trial104.trial104.stdout: block_cache_options: 2026-02-17T20:56:29.509 INFO:journalctl@ceph.mon.trial104.trial104.stdout: capacity : 536870912 2026-02-17T20:56:29.509 INFO:journalctl@ceph.mon.trial104.trial104.stdout: num_shard_bits : 4 2026-02-17T20:56:29.509 INFO:journalctl@ceph.mon.trial104.trial104.stdout: strict_capacity_limit : 0 2026-02-17T20:56:29.509 INFO:journalctl@ceph.mon.trial104.trial104.stdout: high_pri_pool_ratio: 0.000 2026-02-17T20:56:29.509 INFO:journalctl@ceph.mon.trial104.trial104.stdout: block_cache_compressed: (nil) 2026-02-17T20:56:29.509 INFO:journalctl@ceph.mon.trial104.trial104.stdout: persistent_cache: (nil) 2026-02-17T20:56:29.509 INFO:journalctl@ceph.mon.trial104.trial104.stdout: block_size: 4096 2026-02-17T20:56:29.509 INFO:journalctl@ceph.mon.trial104.trial104.stdout: block_size_deviation: 10 2026-02-17T20:56:29.510 INFO:journalctl@ceph.mon.trial104.trial104.stdout: block_restart_interval: 16 2026-02-17T20:56:29.510 INFO:journalctl@ceph.mon.trial104.trial104.stdout: index_block_restart_interval: 1 2026-02-17T20:56:29.510 INFO:journalctl@ceph.mon.trial104.trial104.stdout: metadata_block_size: 4096 2026-02-17T20:56:29.510 INFO:journalctl@ceph.mon.trial104.trial104.stdout: partition_filters: 0 2026-02-17T20:56:29.510 INFO:journalctl@ceph.mon.trial104.trial104.stdout: use_delta_encoding: 1 2026-02-17T20:56:29.510 INFO:journalctl@ceph.mon.trial104.trial104.stdout: filter_policy: bloomfilter 2026-02-17T20:56:29.510 INFO:journalctl@ceph.mon.trial104.trial104.stdout: whole_key_filtering: 1 2026-02-17T20:56:29.510 INFO:journalctl@ceph.mon.trial104.trial104.stdout: verify_compression: 0 2026-02-17T20:56:29.510 INFO:journalctl@ceph.mon.trial104.trial104.stdout: read_amp_bytes_per_bit: 0 2026-02-17T20:56:29.510 INFO:journalctl@ceph.mon.trial104.trial104.stdout: format_version: 5 2026-02-17T20:56:29.510 INFO:journalctl@ceph.mon.trial104.trial104.stdout: enable_index_compression: 1 2026-02-17T20:56:29.510 INFO:journalctl@ceph.mon.trial104.trial104.stdout: block_align: 0 2026-02-17T20:56:29.510 INFO:journalctl@ceph.mon.trial104.trial104.stdout: max_auto_readahead_size: 262144 2026-02-17T20:56:29.511 INFO:journalctl@ceph.mon.trial104.trial104.stdout: prepopulate_block_cache: 0 2026-02-17T20:56:29.511 INFO:journalctl@ceph.mon.trial104.trial104.stdout: initial_auto_readahead_size: 8192 2026-02-17T20:56:29.511 INFO:journalctl@ceph.mon.trial104.trial104.stdout: num_file_reads_for_auto_readahead: 2 2026-02-17T20:56:29.511 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.write_buffer_size: 33554432 2026-02-17T20:56:29.511 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_write_buffer_number: 2 2026-02-17T20:56:29.511 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compression: NoCompression 2026-02-17T20:56:29.511 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.bottommost_compression: Disabled 2026-02-17T20:56:29.511 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.prefix_extractor: nullptr 2026-02-17T20:56:29.511 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-17T20:56:29.511 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.num_levels: 7 2026-02-17T20:56:29.511 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-17T20:56:29.511 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-17T20:56:29.511 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-17T20:56:29.512 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-17T20:56:29.512 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-17T20:56:29.512 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-17T20:56:29.512 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-17T20:56:29.512 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-17T20:56:29.512 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-17T20:56:29.512 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-17T20:56:29.512 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-17T20:56:29.512 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-17T20:56:29.512 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-17T20:56:29.513 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compression_opts.level: 32767 2026-02-17T20:56:29.513 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compression_opts.strategy: 0 2026-02-17T20:56:29.513 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-17T20:56:29.513 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-17T20:56:29.513 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-17T20:56:29.513 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-17T20:56:29.513 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compression_opts.enabled: false 2026-02-17T20:56:29.513 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-17T20:56:29.513 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-17T20:56:29.513 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-17T20:56:29.513 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-17T20:56:29.513 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.target_file_size_base: 67108864 2026-02-17T20:56:29.515 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-17T20:56:29.515 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-17T20:56:29.515 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-17T20:56:29.515 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-17T20:56:29.515 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-17T20:56:29.515 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-17T20:56:29.515 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-17T20:56:29.515 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-17T20:56:29.515 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-17T20:56:29.516 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-17T20:56:29.516 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-17T20:56:29.516 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-17T20:56:29.516 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-17T20:56:29.516 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-17T20:56:29.516 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.arena_block_size: 1048576 2026-02-17T20:56:29.516 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-17T20:56:29.516 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-17T20:56:29.516 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.disable_auto_compactions: 0 2026-02-17T20:56:29.516 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-17T20:56:29.516 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-17T20:56:29.516 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-17T20:56:29.517 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-17T20:56:29.517 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-17T20:56:29.517 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-17T20:56:29.517 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-17T20:56:29.517 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-17T20:56:29.517 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-17T20:56:29.517 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-17T20:56:29.517 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-17T20:56:29.517 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.inplace_update_support: 0 2026-02-17T20:56:29.517 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-17T20:56:29.517 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-17T20:56:29.517 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-17T20:56:29.517 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-17T20:56:29.518 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.bloom_locality: 0 2026-02-17T20:56:29.518 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.max_successive_merges: 0 2026-02-17T20:56:29.518 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-17T20:56:29.518 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.paranoid_file_checks: 0 2026-02-17T20:56:29.518 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.force_consistency_checks: 1 2026-02-17T20:56:29.518 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.report_bg_io_stats: 0 2026-02-17T20:56:29.518 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.ttl: 2592000 2026-02-17T20:56:29.518 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-17T20:56:29.518 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-17T20:56:29.518 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-17T20:56:29.518 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.enable_blob_files: false 2026-02-17T20:56:29.518 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.min_blob_size: 0 2026-02-17T20:56:29.519 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.blob_file_size: 268435456 2026-02-17T20:56:29.519 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-17T20:56:29.519 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-17T20:56:29.519 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-17T20:56:29.519 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-17T20:56:29.519 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-17T20:56:29.519 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.blob_file_starting_level: 0 2026-02-17T20:56:29.519 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-17T20:56:29.519 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-trial104/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-17T20:56:29.519 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-17T20:56:29.519 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: cf2dbf86-0fa9-41cb-a4d7-b1d924c9b2a9 2026-02-17T20:56:29.519 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771361789214020, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-17T20:56:29.519 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-17T20:56:29.520 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771361789214873, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 79340, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 257, "table_properties": {"data_size": 77517, "index_size": 208, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 11481, "raw_average_key_size": 50, "raw_value_size": 71164, "raw_average_value_size": 312, "num_data_blocks": 9, "num_entries": 228, "num_filter_entries": 228, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1771361789, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "cf2dbf86-0fa9-41cb-a4d7-b1d924c9b2a9", "db_session_id": "NG94QN1FRH712I8FXZDW", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-17T20:56:29.520 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: EVENT_LOG_v1 {"time_micros": 1771361789214936, "job": 1, "event": "recovery_finished"} 2026-02-17T20:56:29.520 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-17T20:56:29.520 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-trial104/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-17T20:56:29.520 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56541164ce00 2026-02-17T20:56:29.520 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: DB pointer 0x56541175a000 2026-02-17T20:56:29.520 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-17T20:56:29.520 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-17T20:56:29.520 INFO:journalctl@ceph.mon.trial104.trial104.stdout: ** DB Stats ** 2026-02-17T20:56:29.520 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-17T20:56:29.520 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-17T20:56:29.521 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-17T20:56:29.521 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-17T20:56:29.521 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-17T20:56:29.521 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-17T20:56:29.521 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-17T20:56:29.521 INFO:journalctl@ceph.mon.trial104.trial104.stdout: 2026-02-17T20:56:29.521 INFO:journalctl@ceph.mon.trial104.trial104.stdout: ** Compaction Stats [default] ** 2026-02-17T20:56:29.521 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-17T20:56:29.521 INFO:journalctl@ceph.mon.trial104.trial104.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-17T20:56:29.521 INFO:journalctl@ceph.mon.trial104.trial104.stdout: L0 2/0 79.37 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-17T20:56:29.521 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Sum 2/0 79.37 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-17T20:56:29.521 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 126.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-17T20:56:29.522 INFO:journalctl@ceph.mon.trial104.trial104.stdout: 2026-02-17T20:56:29.522 INFO:journalctl@ceph.mon.trial104.trial104.stdout: ** Compaction Stats [default] ** 2026-02-17T20:56:29.522 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-17T20:56:29.522 INFO:journalctl@ceph.mon.trial104.trial104.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-17T20:56:29.522 INFO:journalctl@ceph.mon.trial104.trial104.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 126.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-17T20:56:29.522 INFO:journalctl@ceph.mon.trial104.trial104.stdout: 2026-02-17T20:56:29.522 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-17T20:56:29.522 INFO:journalctl@ceph.mon.trial104.trial104.stdout: 2026-02-17T20:56:29.522 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-17T20:56:29.522 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-17T20:56:29.522 INFO:journalctl@ceph.mon.trial104.trial104.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-17T20:56:29.523 INFO:journalctl@ceph.mon.trial104.trial104.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-17T20:56:29.523 INFO:journalctl@ceph.mon.trial104.trial104.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-17T20:56:29.523 INFO:journalctl@ceph.mon.trial104.trial104.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-17T20:56:29.523 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Cumulative compaction: 0.00 GB write, 24.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-17T20:56:29.523 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Interval compaction: 0.00 GB write, 24.91 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-17T20:56:29.523 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-17T20:56:29.523 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Block cache BinnedLRUCache@0x56541164b350#2 capacity: 512.00 MB usage: 1.16 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2026-02-17T20:56:29.523 INFO:journalctl@ceph.mon.trial104.trial104.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.77 KB,0.000146031%) IndexBlock(2,0.39 KB,7.45058e-05%) Misc(1,0.00 KB,0%) 2026-02-17T20:56:29.523 INFO:journalctl@ceph.mon.trial104.trial104.stdout: 2026-02-17T20:56:29.523 INFO:journalctl@ceph.mon.trial104.trial104.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-17T20:56:29.523 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: starting mon.trial104 rank 0 at public addrs [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] at bind addrs [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] mon_data /var/lib/ceph/mon/ceph-trial104 fsid 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T20:56:29.523 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: mon.trial104@-1(???) e1 preinit fsid 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T20:56:29.524 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: mon.trial104@-1(???).mds e1 new map 2026-02-17T20:56:29.524 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: mon.trial104@-1(???).mds e1 print_map 2026-02-17T20:56:29.524 INFO:journalctl@ceph.mon.trial104.trial104.stdout: e1 2026-02-17T20:56:29.524 INFO:journalctl@ceph.mon.trial104.trial104.stdout: btime 2026-02-17T20:56:28:383114+0000 2026-02-17T20:56:29.524 INFO:journalctl@ceph.mon.trial104.trial104.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-17T20:56:29.524 INFO:journalctl@ceph.mon.trial104.trial104.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-17T20:56:29.524 INFO:journalctl@ceph.mon.trial104.trial104.stdout: legacy client fscid: -1 2026-02-17T20:56:29.524 INFO:journalctl@ceph.mon.trial104.trial104.stdout: 2026-02-17T20:56:29.524 INFO:journalctl@ceph.mon.trial104.trial104.stdout: No filesystems configured 2026-02-17T20:56:29.524 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: mon.trial104@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-17T20:56:29.524 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: mon.trial104@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T20:56:29.524 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: mon.trial104@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T20:56:29.524 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: mon.trial104@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-17T20:56:29.525 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: mon.trial104@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-17T20:56:29.525 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: mon.trial104 is new leader, mons trial104 in quorum (ranks 0) 2026-02-17T20:56:29.525 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: monmap epoch 1 2026-02-17T20:56:29.525 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: fsid 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T20:56:29.525 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: last_changed 2026-02-17T20:56:27.459417+0000 2026-02-17T20:56:29.525 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: created 2026-02-17T20:56:27.459417+0000 2026-02-17T20:56:29.525 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: min_mon_release 19 (squid) 2026-02-17T20:56:29.525 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: election_strategy: 1 2026-02-17T20:56:29.525 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: 0: [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] mon.trial104 2026-02-17T20:56:29.525 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: fsmap 2026-02-17T20:56:29.526 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: osdmap e1: 0 total, 0 up, 0 in 2026-02-17T20:56:29.526 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:29 trial104 ceph-mon[20612]: mgrmap e1: no daemons active 2026-02-17T20:56:29.600 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-19072504-0c43-11f1-93a3-d404e6e7d460.target.wants/ceph-19072504-0c43-11f1-93a3-d404e6e7d460@mgr.trial104.irrhmt.service → /etc/systemd/system/ceph-19072504-0c43-11f1-93a3-d404e6e7d460@.service. 2026-02-17T20:56:29.746 INFO:teuthology.orchestra.run.trial104.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T20:56:29.746 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stdout disabled 2026-02-17T20:56:29.752 INFO:teuthology.orchestra.run.trial104.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T20:56:29.753 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stdout inactive 2026-02-17T20:56:29.753 INFO:teuthology.orchestra.run.trial104.stdout:firewalld.service is not enabled 2026-02-17T20:56:29.753 INFO:teuthology.orchestra.run.trial104.stdout:Not possible to enable service . firewalld.service is not available 2026-02-17T20:56:29.760 INFO:teuthology.orchestra.run.trial104.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T20:56:29.760 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stdout disabled 2026-02-17T20:56:29.766 INFO:teuthology.orchestra.run.trial104.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T20:56:29.766 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stdout inactive 2026-02-17T20:56:29.766 INFO:teuthology.orchestra.run.trial104.stdout:firewalld.service is not enabled 2026-02-17T20:56:29.766 INFO:teuthology.orchestra.run.trial104.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2026-02-17T20:56:29.767 INFO:teuthology.orchestra.run.trial104.stdout:Waiting for mgr to start... 2026-02-17T20:56:29.767 INFO:teuthology.orchestra.run.trial104.stdout:Waiting for mgr... 2026-02-17T20:56:29.938 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout 2026-02-17T20:56:29.938 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout { 2026-02-17T20:56:29.938 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "fsid": "19072504-0c43-11f1-93a3-d404e6e7d460", 2026-02-17T20:56:29.938 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T20:56:29.938 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T20:56:29.938 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T20:56:29.938 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T20:56:29.938 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:29.939 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T20:56:29.939 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T20:56:29.939 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout 0 2026-02-17T20:56:29.939 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout ], 2026-02-17T20:56:29.939 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T20:56:29.939 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "trial104" 2026-02-17T20:56:29.939 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout ], 2026-02-17T20:56:29.939 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "quorum_age": 0, 2026-02-17T20:56:29.939 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T20:56:29.940 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T20:56:29.940 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T20:56:29.940 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T20:56:29.940 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:29.940 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T20:56:29.940 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T20:56:29.940 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T20:56:29.940 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T20:56:29.940 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T20:56:29.940 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T20:56:29.940 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T20:56:29.941 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T20:56:29.941 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:29.941 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T20:56:29.941 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T20:56:29.941 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T20:56:29.941 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T20:56:29.941 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T20:56:29.941 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T20:56:29.941 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T20:56:29.941 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T20:56:29.941 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T20:56:29.941 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:29.942 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T20:56:29.942 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T20:56:29.942 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T20:56:28:383114+0000", 2026-02-17T20:56:29.942 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T20:56:29.942 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T20:56:29.942 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:29.942 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T20:56:29.942 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-17T20:56:29.942 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T20:56:29.942 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T20:56:29.942 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T20:56:29.942 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T20:56:29.942 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T20:56:29.943 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout ], 2026-02-17T20:56:29.943 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T20:56:29.943 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:29.943 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T20:56:29.943 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T20:56:29.943 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T20:56:28.383547+0000", 2026-02-17T20:56:29.943 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T20:56:29.943 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:29.943 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T20:56:29.943 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout } 2026-02-17T20:56:29.943 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.874+0000 7fa42c11c640 1 Processor -- start 2026-02-17T20:56:29.943 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.874+0000 7fa42c11c640 1 -- start start 2026-02-17T20:56:29.943 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.874+0000 7fa42c11c640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa42407b370 0x7fa42410c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:29.944 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.874+0000 7fa42c11c640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa42407b800 con 0x7fa42407b370 2026-02-17T20:56:29.944 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.875+0000 7fa429e91640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa42407b370 0x7fa42410c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:29.944 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.875+0000 7fa429e91640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa42407b370 0x7fa42410c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33488/0 (socket says 10.20.193.104:33488) 2026-02-17T20:56:29.944 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.875+0000 7fa429e91640 1 -- 10.20.193.104:0/3572938936 learned_addr learned my addr 10.20.193.104:0/3572938936 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:29.944 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.875+0000 7fa429e91640 1 -- 10.20.193.104:0/3572938936 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42410cb40 con 0x7fa42407b370 2026-02-17T20:56:29.944 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.875+0000 7fa429e91640 1 --2- 10.20.193.104:0/3572938936 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa42407b370 0x7fa42410c600 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa414009920 tx=0x7fa41402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676ab7dc80f0ad90 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:29.944 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.875+0000 7fa428e8f640 1 -- 10.20.193.104:0/3572938936 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa41403c070 con 0x7fa42407b370 2026-02-17T20:56:29.944 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.876+0000 7fa428e8f640 1 -- 10.20.193.104:0/3572938936 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fa41402fe00 con 0x7fa42407b370 2026-02-17T20:56:29.944 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.876+0000 7fa428e8f640 1 -- 10.20.193.104:0/3572938936 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa414035340 con 0x7fa42407b370 2026-02-17T20:56:29.944 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.876+0000 7fa42c11c640 1 -- 10.20.193.104:0/3572938936 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa42407b370 msgr2=0x7fa42410c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:29.944 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.876+0000 7fa42c11c640 1 --2- 10.20.193.104:0/3572938936 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa42407b370 0x7fa42410c600 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa414009920 tx=0x7fa41402ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:29.944 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.876+0000 7fa42c11c640 1 -- 10.20.193.104:0/3572938936 shutdown_connections 2026-02-17T20:56:29.945 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.876+0000 7fa42c11c640 1 --2- 10.20.193.104:0/3572938936 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa42407b370 0x7fa42410c600 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:29.945 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.876+0000 7fa42c11c640 1 -- 10.20.193.104:0/3572938936 >> 10.20.193.104:0/3572938936 conn(0x7fa424101c10 msgr2=0x7fa424104030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:29.945 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.876+0000 7fa42c11c640 1 -- 10.20.193.104:0/3572938936 shutdown_connections 2026-02-17T20:56:29.945 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.876+0000 7fa42c11c640 1 -- 10.20.193.104:0/3572938936 wait complete. 2026-02-17T20:56:29.945 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.876+0000 7fa42c11c640 1 Processor -- start 2026-02-17T20:56:29.945 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.876+0000 7fa42c11c640 1 -- start start 2026-02-17T20:56:29.945 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.877+0000 7fa42c11c640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa42407b370 0x7fa42419f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:29.945 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.877+0000 7fa42c11c640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa42410da80 con 0x7fa42407b370 2026-02-17T20:56:29.945 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.877+0000 7fa429e91640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa42407b370 0x7fa42419f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:29.945 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.877+0000 7fa429e91640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa42407b370 0x7fa42419f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33498/0 (socket says 10.20.193.104:33498) 2026-02-17T20:56:29.945 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.877+0000 7fa429e91640 1 -- 10.20.193.104:0/3815635152 learned_addr learned my addr 10.20.193.104:0/3815635152 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:29.946 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.877+0000 7fa429e91640 1 -- 10.20.193.104:0/3815635152 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42419fc00 con 0x7fa42407b370 2026-02-17T20:56:29.946 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.877+0000 7fa429e91640 1 --2- 10.20.193.104:0/3815635152 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa42407b370 0x7fa42419f6c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa414006fd0 tx=0x7fa4140358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:29.946 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.877+0000 7fa412ffd640 1 -- 10.20.193.104:0/3815635152 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa4140378f0 con 0x7fa42407b370 2026-02-17T20:56:29.946 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.877+0000 7fa412ffd640 1 -- 10.20.193.104:0/3815635152 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fa414035cc0 con 0x7fa42407b370 2026-02-17T20:56:29.946 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.877+0000 7fa42c11c640 1 -- 10.20.193.104:0/3815635152 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa42419fe90 con 0x7fa42407b370 2026-02-17T20:56:29.946 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.877+0000 7fa412ffd640 1 -- 10.20.193.104:0/3815635152 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa414041550 con 0x7fa42407b370 2026-02-17T20:56:29.946 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.877+0000 7fa42c11c640 1 -- 10.20.193.104:0/3815635152 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4241a2b80 con 0x7fa42407b370 2026-02-17T20:56:29.946 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.877+0000 7fa412ffd640 1 -- 10.20.193.104:0/3815635152 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7fa414041800 con 0x7fa42407b370 2026-02-17T20:56:29.946 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.877+0000 7fa412ffd640 1 -- 10.20.193.104:0/3815635152 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa41404b9c0 con 0x7fa42407b370 2026-02-17T20:56:29.946 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.878+0000 7fa42c11c640 1 -- 10.20.193.104:0/3815635152 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa42410c680 con 0x7fa42407b370 2026-02-17T20:56:29.946 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.879+0000 7fa412ffd640 1 -- 10.20.193.104:0/3815635152 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7fa41404b3f0 con 0x7fa42407b370 2026-02-17T20:56:29.946 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.908+0000 7fa42c11c640 1 -- 10.20.193.104:0/3815635152 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fa4241a3170 con 0x7fa42407b370 2026-02-17T20:56:29.946 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.909+0000 7fa412ffd640 1 -- 10.20.193.104:0/3815635152 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1298 (secure 0 0 0) 0x7fa414041c60 con 0x7fa42407b370 2026-02-17T20:56:29.947 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.909+0000 7fa42c11c640 1 -- 10.20.193.104:0/3815635152 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa42407b370 msgr2=0x7fa42419f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:29.947 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.909+0000 7fa42c11c640 1 --2- 10.20.193.104:0/3815635152 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa42407b370 0x7fa42419f6c0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa414006fd0 tx=0x7fa4140358c0 comp rx=0 tx=0).stop 2026-02-17T20:56:29.947 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.909+0000 7fa42c11c640 1 -- 10.20.193.104:0/3815635152 shutdown_connections 2026-02-17T20:56:29.947 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.909+0000 7fa42c11c640 1 --2- 10.20.193.104:0/3815635152 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa42407b370 0x7fa42419f6c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:29.947 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.909+0000 7fa42c11c640 1 -- 10.20.193.104:0/3815635152 >> 10.20.193.104:0/3815635152 conn(0x7fa424101c10 msgr2=0x7fa424102860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:29.947 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.909+0000 7fa42c11c640 1 -- 10.20.193.104:0/3815635152 shutdown_connections 2026-02-17T20:56:29.947 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:29.909+0000 7fa42c11c640 1 -- 10.20.193.104:0/3815635152 wait complete. 2026-02-17T20:56:29.947 INFO:teuthology.orchestra.run.trial104.stdout:mgr not available, waiting (1/15)... 2026-02-17T20:56:30.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:30 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/1518344452' entity='client.admin' 2026-02-17T20:56:30.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:30 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3815635152' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T20:56:32.091 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout 2026-02-17T20:56:32.092 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout { 2026-02-17T20:56:32.092 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "fsid": "19072504-0c43-11f1-93a3-d404e6e7d460", 2026-02-17T20:56:32.092 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T20:56:32.092 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T20:56:32.092 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T20:56:32.092 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T20:56:32.092 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:32.092 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T20:56:32.092 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T20:56:32.092 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout 0 2026-02-17T20:56:32.092 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout ], 2026-02-17T20:56:32.093 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T20:56:32.093 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "trial104" 2026-02-17T20:56:32.093 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout ], 2026-02-17T20:56:32.093 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2026-02-17T20:56:32.093 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T20:56:32.093 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T20:56:32.093 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T20:56:32.093 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T20:56:32.093 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:32.093 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T20:56:32.093 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T20:56:32.093 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T20:56:32.093 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T20:56:32.094 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T20:56:32.094 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T20:56:32.094 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T20:56:32.094 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T20:56:32.094 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:32.094 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T20:56:32.094 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T20:56:32.094 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T20:56:32.094 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T20:56:32.094 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T20:56:32.094 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T20:56:32.094 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T20:56:32.094 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T20:56:32.094 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T20:56:32.095 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:32.095 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T20:56:32.095 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T20:56:32.095 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T20:56:28:383114+0000", 2026-02-17T20:56:32.095 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T20:56:32.095 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T20:56:32.095 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:32.095 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T20:56:32.095 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-17T20:56:32.095 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T20:56:32.095 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T20:56:32.095 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T20:56:32.095 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T20:56:32.095 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T20:56:32.096 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout ], 2026-02-17T20:56:32.096 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T20:56:32.096 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:32.096 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T20:56:32.096 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T20:56:32.096 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T20:56:28.383547+0000", 2026-02-17T20:56:32.096 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T20:56:32.096 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:32.096 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T20:56:32.096 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout } 2026-02-17T20:56:32.096 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.028+0000 7f2b93638640 1 Processor -- start 2026-02-17T20:56:32.096 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.028+0000 7f2b93638640 1 -- start start 2026-02-17T20:56:32.096 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.028+0000 7f2b93638640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2b8c109880 0x7f2b8c109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:32.097 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.028+0000 7f2b93638640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8c10a250 con 0x7f2b8c109880 2026-02-17T20:56:32.097 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.029+0000 7f2b913ad640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2b8c109880 0x7f2b8c109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:32.097 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.029+0000 7f2b913ad640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2b8c109880 0x7f2b8c109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33500/0 (socket says 10.20.193.104:33500) 2026-02-17T20:56:32.097 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.029+0000 7f2b913ad640 1 -- 10.20.193.104:0/3794180072 learned_addr learned my addr 10.20.193.104:0/3794180072 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:32.097 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.029+0000 7f2b913ad640 1 -- 10.20.193.104:0/3794180072 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8c10aa80 con 0x7f2b8c109880 2026-02-17T20:56:32.097 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.030+0000 7f2b913ad640 1 --2- 10.20.193.104:0/3794180072 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2b8c109880 0x7f2b8c109c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009920 tx=0x7f2b7c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2743f82d21a56f95 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:32.097 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.030+0000 7f2b7bfff640 1 -- 10.20.193.104:0/3794180072 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f2b7c03c070 con 0x7f2b8c109880 2026-02-17T20:56:32.097 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.030+0000 7f2b7bfff640 1 -- 10.20.193.104:0/3794180072 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f2b7c02fe00 con 0x7f2b8c109880 2026-02-17T20:56:32.097 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.030+0000 7f2b7bfff640 1 -- 10.20.193.104:0/3794180072 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f2b7c035340 con 0x7f2b8c109880 2026-02-17T20:56:32.097 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.030+0000 7f2b93638640 1 -- 10.20.193.104:0/3794180072 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2b8c109880 msgr2=0x7f2b8c109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:32.097 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.030+0000 7f2b93638640 1 --2- 10.20.193.104:0/3794180072 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2b8c109880 0x7f2b8c109c80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c009920 tx=0x7f2b7c02ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:32.097 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.030+0000 7f2b93638640 1 -- 10.20.193.104:0/3794180072 shutdown_connections 2026-02-17T20:56:32.098 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.030+0000 7f2b93638640 1 --2- 10.20.193.104:0/3794180072 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2b8c109880 0x7f2b8c109c80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:32.098 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.030+0000 7f2b93638640 1 -- 10.20.193.104:0/3794180072 >> 10.20.193.104:0/3794180072 conn(0x7f2b8c07cf00 msgr2=0x7f2b8c07d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:32.098 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.030+0000 7f2b93638640 1 -- 10.20.193.104:0/3794180072 shutdown_connections 2026-02-17T20:56:32.098 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.030+0000 7f2b93638640 1 -- 10.20.193.104:0/3794180072 wait complete. 2026-02-17T20:56:32.098 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.030+0000 7f2b93638640 1 Processor -- start 2026-02-17T20:56:32.098 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.030+0000 7f2b93638640 1 -- start start 2026-02-17T20:56:32.098 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.031+0000 7f2b93638640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2b8c109880 0x7f2b8c19f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:32.098 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.031+0000 7f2b93638640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2b8c10dcb0 con 0x7f2b8c109880 2026-02-17T20:56:32.098 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.031+0000 7f2b913ad640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2b8c109880 0x7f2b8c19f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:32.098 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.031+0000 7f2b913ad640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2b8c109880 0x7f2b8c19f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33504/0 (socket says 10.20.193.104:33504) 2026-02-17T20:56:32.098 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.031+0000 7f2b913ad640 1 -- 10.20.193.104:0/3130764493 learned_addr learned my addr 10.20.193.104:0/3130764493 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:32.099 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.031+0000 7f2b913ad640 1 -- 10.20.193.104:0/3130764493 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8c19fce0 con 0x7f2b8c109880 2026-02-17T20:56:32.099 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.031+0000 7f2b913ad640 1 --2- 10.20.193.104:0/3130764493 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2b8c109880 0x7f2b8c19f7a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c037b20 tx=0x7f2b7c0358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:32.099 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.031+0000 7f2b7a7fc640 1 -- 10.20.193.104:0/3130764493 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f2b7c035c10 con 0x7f2b8c109880 2026-02-17T20:56:32.099 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.031+0000 7f2b7a7fc640 1 -- 10.20.193.104:0/3130764493 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f2b7c035db0 con 0x7f2b8c109880 2026-02-17T20:56:32.099 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.031+0000 7f2b7a7fc640 1 -- 10.20.193.104:0/3130764493 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f2b7c0413a0 con 0x7f2b8c109880 2026-02-17T20:56:32.099 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.031+0000 7f2b93638640 1 -- 10.20.193.104:0/3130764493 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8c19ff70 con 0x7f2b8c109880 2026-02-17T20:56:32.099 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.031+0000 7f2b93638640 1 -- 10.20.193.104:0/3130764493 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b8c1a2c60 con 0x7f2b8c109880 2026-02-17T20:56:32.099 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.031+0000 7f2b7a7fc640 1 -- 10.20.193.104:0/3130764493 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 1) ==== 811+0+0 (secure 0 0 0) 0x7f2b7c041650 con 0x7f2b8c109880 2026-02-17T20:56:32.099 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.031+0000 7f2b7a7fc640 1 -- 10.20.193.104:0/3130764493 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2b7c04b920 con 0x7f2b8c109880 2026-02-17T20:56:32.099 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.031+0000 7f2b93638640 1 -- 10.20.193.104:0/3130764493 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b8c109d00 con 0x7f2b8c109880 2026-02-17T20:56:32.099 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.033+0000 7f2b7a7fc640 1 -- 10.20.193.104:0/3130764493 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75931 (secure 0 0 0) 0x7f2b7c04b3f0 con 0x7f2b8c109880 2026-02-17T20:56:32.099 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.061+0000 7f2b93638640 1 -- 10.20.193.104:0/3130764493 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f2b8c1a2ed0 con 0x7f2b8c109880 2026-02-17T20:56:32.100 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.061+0000 7f2b7a7fc640 1 -- 10.20.193.104:0/3130764493 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1298 (secure 0 0 0) 0x7f2b7c041ab0 con 0x7f2b8c109880 2026-02-17T20:56:32.100 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.062+0000 7f2b93638640 1 -- 10.20.193.104:0/3130764493 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2b8c109880 msgr2=0x7f2b8c19f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:32.100 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.062+0000 7f2b93638640 1 --2- 10.20.193.104:0/3130764493 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2b8c109880 0x7f2b8c19f7a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2b7c037b20 tx=0x7f2b7c0358c0 comp rx=0 tx=0).stop 2026-02-17T20:56:32.100 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.062+0000 7f2b93638640 1 -- 10.20.193.104:0/3130764493 shutdown_connections 2026-02-17T20:56:32.100 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.062+0000 7f2b93638640 1 --2- 10.20.193.104:0/3130764493 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2b8c109880 0x7f2b8c19f7a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:32.100 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.062+0000 7f2b93638640 1 -- 10.20.193.104:0/3130764493 >> 10.20.193.104:0/3130764493 conn(0x7f2b8c07cf00 msgr2=0x7f2b8c1070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:32.100 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.062+0000 7f2b93638640 1 -- 10.20.193.104:0/3130764493 shutdown_connections 2026-02-17T20:56:32.100 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:32.062+0000 7f2b93638640 1 -- 10.20.193.104:0/3130764493 wait complete. 2026-02-17T20:56:32.100 INFO:teuthology.orchestra.run.trial104.stdout:mgr not available, waiting (2/15)... 2026-02-17T20:56:32.372 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:32 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3130764493' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T20:56:33.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:33 trial104 ceph-mon[20612]: Activating manager daemon trial104.irrhmt 2026-02-17T20:56:33.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:33 trial104 ceph-mon[20612]: mgrmap e2: trial104.irrhmt(active, starting, since 0.00280176s) 2026-02-17T20:56:33.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:33 trial104 ceph-mon[20612]: from='mgr.14100 10.20.193.104:0/1345150294' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T20:56:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:33 trial104 ceph-mon[20612]: from='mgr.14100 10.20.193.104:0/1345150294' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T20:56:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:33 trial104 ceph-mon[20612]: from='mgr.14100 10.20.193.104:0/1345150294' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T20:56:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:33 trial104 ceph-mon[20612]: from='mgr.14100 10.20.193.104:0/1345150294' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial104"}]: dispatch 2026-02-17T20:56:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:33 trial104 ceph-mon[20612]: from='mgr.14100 10.20.193.104:0/1345150294' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mgr metadata", "who": "trial104.irrhmt", "id": "trial104.irrhmt"}]: dispatch 2026-02-17T20:56:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:33 trial104 ceph-mon[20612]: Manager daemon trial104.irrhmt is now available 2026-02-17T20:56:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:33 trial104 ceph-mon[20612]: from='mgr.14100 10.20.193.104:0/1345150294' entity='mgr.trial104.irrhmt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial104.irrhmt/mirror_snapshot_schedule"}]: dispatch 2026-02-17T20:56:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:33 trial104 ceph-mon[20612]: from='mgr.14100 10.20.193.104:0/1345150294' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:33 trial104 ceph-mon[20612]: from='mgr.14100 10.20.193.104:0/1345150294' entity='mgr.trial104.irrhmt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial104.irrhmt/trash_purge_schedule"}]: dispatch 2026-02-17T20:56:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:33 trial104 ceph-mon[20612]: from='mgr.14100 10.20.193.104:0/1345150294' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:33 trial104 ceph-mon[20612]: from='mgr.14100 10.20.193.104:0/1345150294' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:34.323 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout 2026-02-17T20:56:34.323 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout { 2026-02-17T20:56:34.323 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "fsid": "19072504-0c43-11f1-93a3-d404e6e7d460", 2026-02-17T20:56:34.324 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "health": { 2026-02-17T20:56:34.324 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-17T20:56:34.324 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-17T20:56:34.324 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-17T20:56:34.324 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:34.324 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-17T20:56:34.324 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-17T20:56:34.324 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout 0 2026-02-17T20:56:34.324 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout ], 2026-02-17T20:56:34.324 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-17T20:56:34.325 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "trial104" 2026-02-17T20:56:34.325 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout ], 2026-02-17T20:56:34.325 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2026-02-17T20:56:34.325 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-17T20:56:34.325 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T20:56:34.325 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2026-02-17T20:56:34.325 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-17T20:56:34.325 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:34.325 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-17T20:56:34.325 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T20:56:34.325 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-17T20:56:34.326 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-17T20:56:34.326 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-17T20:56:34.326 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-17T20:56:34.326 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-17T20:56:34.326 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-17T20:56:34.326 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:34.326 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-17T20:56:34.326 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-17T20:56:34.326 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-17T20:56:34.326 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-17T20:56:34.326 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-17T20:56:34.327 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-17T20:56:34.327 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-17T20:56:34.327 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-17T20:56:34.327 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-17T20:56:34.327 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:34.327 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-17T20:56:34.327 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T20:56:34.327 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "btime": "2026-02-17T20:56:28:383114+0000", 2026-02-17T20:56:34.327 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-17T20:56:34.327 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-17T20:56:34.327 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:34.328 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-17T20:56:34.328 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T20:56:34.328 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-17T20:56:34.328 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-17T20:56:34.328 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-17T20:56:34.328 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "nfs", 2026-02-17T20:56:34.328 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "restful" 2026-02-17T20:56:34.328 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout ], 2026-02-17T20:56:34.328 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T20:56:34.328 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:34.328 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-17T20:56:34.328 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-17T20:56:34.328 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "modified": "2026-02-17T20:56:28.383547+0000", 2026-02-17T20:56:34.329 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-17T20:56:34.329 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout }, 2026-02-17T20:56:34.329 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-17T20:56:34.329 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout } 2026-02-17T20:56:34.329 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.174+0000 7faf02af0640 1 Processor -- start 2026-02-17T20:56:34.329 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.174+0000 7faf02af0640 1 -- start start 2026-02-17T20:56:34.329 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.174+0000 7faf02af0640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faefc109880 0x7faefc109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:34.329 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.174+0000 7faf02af0640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7faefc10a250 con 0x7faefc109880 2026-02-17T20:56:34.329 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.174+0000 7faf00865640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faefc109880 0x7faefc109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:34.329 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.174+0000 7faf00865640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faefc109880 0x7faefc109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33564/0 (socket says 10.20.193.104:33564) 2026-02-17T20:56:34.329 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.174+0000 7faf00865640 1 -- 10.20.193.104:0/2179701785 learned_addr learned my addr 10.20.193.104:0/2179701785 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:34.329 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.174+0000 7faf00865640 1 -- 10.20.193.104:0/2179701785 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faefc10aa80 con 0x7faefc109880 2026-02-17T20:56:34.330 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.175+0000 7faf00865640 1 --2- 10.20.193.104:0/2179701785 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faefc109880 0x7faefc109c80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faeec009920 tx=0x7faeec02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5556f2d02cdf61 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:34.330 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.175+0000 7faef37fe640 1 -- 10.20.193.104:0/2179701785 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7faeec03c070 con 0x7faefc109880 2026-02-17T20:56:34.330 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.175+0000 7faef37fe640 1 -- 10.20.193.104:0/2179701785 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7faeec02fe00 con 0x7faefc109880 2026-02-17T20:56:34.330 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.175+0000 7faef37fe640 1 -- 10.20.193.104:0/2179701785 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7faeec035340 con 0x7faefc109880 2026-02-17T20:56:34.330 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.175+0000 7faf02af0640 1 -- 10.20.193.104:0/2179701785 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faefc109880 msgr2=0x7faefc109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:34.330 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.175+0000 7faf02af0640 1 --2- 10.20.193.104:0/2179701785 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faefc109880 0x7faefc109c80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7faeec009920 tx=0x7faeec02ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:34.330 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.175+0000 7faf02af0640 1 -- 10.20.193.104:0/2179701785 shutdown_connections 2026-02-17T20:56:34.330 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.175+0000 7faf02af0640 1 --2- 10.20.193.104:0/2179701785 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faefc109880 0x7faefc109c80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:34.330 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.175+0000 7faf02af0640 1 -- 10.20.193.104:0/2179701785 >> 10.20.193.104:0/2179701785 conn(0x7faefc07cf00 msgr2=0x7faefc07d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:34.330 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.175+0000 7faf02af0640 1 -- 10.20.193.104:0/2179701785 shutdown_connections 2026-02-17T20:56:34.330 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.175+0000 7faf02af0640 1 -- 10.20.193.104:0/2179701785 wait complete. 2026-02-17T20:56:34.330 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.176+0000 7faf02af0640 1 Processor -- start 2026-02-17T20:56:34.330 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.176+0000 7faf02af0640 1 -- start start 2026-02-17T20:56:34.331 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.176+0000 7faf02af0640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faefc109880 0x7faefc19f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:34.331 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.176+0000 7faf02af0640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7faefc10dcb0 con 0x7faefc109880 2026-02-17T20:56:34.331 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.176+0000 7faf00865640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faefc109880 0x7faefc19f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:34.331 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.176+0000 7faf00865640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faefc109880 0x7faefc19f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33580/0 (socket says 10.20.193.104:33580) 2026-02-17T20:56:34.331 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.176+0000 7faf00865640 1 -- 10.20.193.104:0/2694612644 learned_addr learned my addr 10.20.193.104:0/2694612644 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:34.331 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.176+0000 7faf00865640 1 -- 10.20.193.104:0/2694612644 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faefc19fce0 con 0x7faefc109880 2026-02-17T20:56:34.331 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.176+0000 7faf00865640 1 --2- 10.20.193.104:0/2694612644 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faefc109880 0x7faefc19f7a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7faeec037b20 tx=0x7faeec0358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:34.331 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.176+0000 7faef1ffb640 1 -- 10.20.193.104:0/2694612644 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7faeec035c10 con 0x7faefc109880 2026-02-17T20:56:34.331 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.176+0000 7faef1ffb640 1 -- 10.20.193.104:0/2694612644 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7faeec035db0 con 0x7faefc109880 2026-02-17T20:56:34.331 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.176+0000 7faf02af0640 1 -- 10.20.193.104:0/2694612644 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faefc19ff70 con 0x7faefc109880 2026-02-17T20:56:34.331 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.176+0000 7faef1ffb640 1 -- 10.20.193.104:0/2694612644 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7faeec0413a0 con 0x7faefc109880 2026-02-17T20:56:34.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.176+0000 7faf02af0640 1 -- 10.20.193.104:0/2694612644 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faefc1a2c60 con 0x7faefc109880 2026-02-17T20:56:34.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.177+0000 7faf02af0640 1 -- 10.20.193.104:0/2694612644 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faefc109d00 con 0x7faefc109880 2026-02-17T20:56:34.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.177+0000 7faef1ffb640 1 -- 10.20.193.104:0/2694612644 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 3) ==== 50144+0+0 (secure 0 0 0) 0x7faeec0423f0 con 0x7faefc109880 2026-02-17T20:56:34.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.177+0000 7faef1ffb640 1 --2- 10.20.193.104:0/2694612644 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7faed803da80 0x7faed803ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:34.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.177+0000 7faef1ffb640 1 -- 10.20.193.104:0/2694612644 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faeec076120 con 0x7faefc109880 2026-02-17T20:56:34.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.177+0000 7faef3fff640 1 --2- 10.20.193.104:0/2694612644 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7faed803da80 0x7faed803ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:34.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.177+0000 7faef3fff640 1 --2- 10.20.193.104:0/2694612644 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7faed803da80 0x7faed803ff40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faee40099c0 tx=0x7faee4006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:34.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.180+0000 7faef1ffb640 1 -- 10.20.193.104:0/2694612644 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7faeec042710 con 0x7faefc109880 2026-02-17T20:56:34.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.292+0000 7faf02af0640 1 -- 10.20.193.104:0/2694612644 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7faefc1a33c0 con 0x7faefc109880 2026-02-17T20:56:34.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.292+0000 7faef1ffb640 1 -- 10.20.193.104:0/2694612644 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1297 (secure 0 0 0) 0x7faeec0780c0 con 0x7faefc109880 2026-02-17T20:56:34.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.293+0000 7faf02af0640 1 -- 10.20.193.104:0/2694612644 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7faed803da80 msgr2=0x7faed803ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:34.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.293+0000 7faf02af0640 1 --2- 10.20.193.104:0/2694612644 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7faed803da80 0x7faed803ff40 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faee40099c0 tx=0x7faee4006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:34.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.293+0000 7faf02af0640 1 -- 10.20.193.104:0/2694612644 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faefc109880 msgr2=0x7faefc19f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:34.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.293+0000 7faf02af0640 1 --2- 10.20.193.104:0/2694612644 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faefc109880 0x7faefc19f7a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7faeec037b20 tx=0x7faeec0358c0 comp rx=0 tx=0).stop 2026-02-17T20:56:34.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.293+0000 7faf02af0640 1 -- 10.20.193.104:0/2694612644 shutdown_connections 2026-02-17T20:56:34.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.293+0000 7faf02af0640 1 --2- 10.20.193.104:0/2694612644 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7faed803da80 0x7faed803ff40 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:34.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.293+0000 7faf02af0640 1 --2- 10.20.193.104:0/2694612644 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faefc109880 0x7faefc19f7a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:34.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.293+0000 7faf02af0640 1 -- 10.20.193.104:0/2694612644 >> 10.20.193.104:0/2694612644 conn(0x7faefc07cf00 msgr2=0x7faefc1070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:34.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.293+0000 7faf02af0640 1 -- 10.20.193.104:0/2694612644 shutdown_connections 2026-02-17T20:56:34.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.293+0000 7faf02af0640 1 -- 10.20.193.104:0/2694612644 wait complete. 2026-02-17T20:56:34.333 INFO:teuthology.orchestra.run.trial104.stdout:mgr is available 2026-02-17T20:56:34.519 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout 2026-02-17T20:56:34.519 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout [global] 2026-02-17T20:56:34.519 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout fsid = 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T20:56:34.519 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-17T20:56:34.519 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.104:3300,v1:10.20.193.104:6789] 2026-02-17T20:56:34.520 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-17T20:56:34.521 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-17T20:56:34.521 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-17T20:56:34.521 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-17T20:56:34.521 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout 2026-02-17T20:56:34.521 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-17T20:56:34.521 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-17T20:56:34.521 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout 2026-02-17T20:56:34.521 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout [osd] 2026-02-17T20:56:34.521 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-17T20:56:34.522 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-17T20:56:34.522 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.408+0000 7f07c5b86640 1 Processor -- start 2026-02-17T20:56:34.522 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.408+0000 7f07c5b86640 1 -- start start 2026-02-17T20:56:34.522 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.408+0000 7f07c5b86640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07c0105e50 0x7f07c0108260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:34.522 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.408+0000 7f07c5b86640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f07c007b760 con 0x7f07c0105e50 2026-02-17T20:56:34.522 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.409+0000 7f07bf7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07c0105e50 0x7f07c0108260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:34.522 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.409+0000 7f07bf7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07c0105e50 0x7f07c0108260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33594/0 (socket says 10.20.193.104:33594) 2026-02-17T20:56:34.522 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.409+0000 7f07bf7fe640 1 -- 10.20.193.104:0/1890623384 learned_addr learned my addr 10.20.193.104:0/1890623384 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:34.522 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.409+0000 7f07bf7fe640 1 -- 10.20.193.104:0/1890623384 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c01087a0 con 0x7f07c0105e50 2026-02-17T20:56:34.522 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.409+0000 7f07bf7fe640 1 --2- 10.20.193.104:0/1890623384 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07c0105e50 0x7f07c0108260 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f07ac009920 tx=0x7f07ac02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65092dd9671efb9b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:34.522 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.409+0000 7f07be7fc640 1 -- 10.20.193.104:0/1890623384 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f07ac03c070 con 0x7f07c0105e50 2026-02-17T20:56:34.528 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.409+0000 7f07be7fc640 1 -- 10.20.193.104:0/1890623384 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f07ac02fe00 con 0x7f07c0105e50 2026-02-17T20:56:34.528 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.409+0000 7f07be7fc640 1 -- 10.20.193.104:0/1890623384 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f07ac035340 con 0x7f07c0105e50 2026-02-17T20:56:34.528 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.410+0000 7f07c5b86640 1 -- 10.20.193.104:0/1890623384 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07c0105e50 msgr2=0x7f07c0108260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:34.528 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.410+0000 7f07c5b86640 1 --2- 10.20.193.104:0/1890623384 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07c0105e50 0x7f07c0108260 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f07ac009920 tx=0x7f07ac02ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:34.528 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.410+0000 7f07c5b86640 1 -- 10.20.193.104:0/1890623384 shutdown_connections 2026-02-17T20:56:34.528 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.410+0000 7f07c5b86640 1 --2- 10.20.193.104:0/1890623384 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07c0105e50 0x7f07c0108260 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:34.528 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.410+0000 7f07c5b86640 1 -- 10.20.193.104:0/1890623384 >> 10.20.193.104:0/1890623384 conn(0x7f07c0101ce0 msgr2=0x7f07c0104100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:34.528 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.410+0000 7f07c5b86640 1 -- 10.20.193.104:0/1890623384 shutdown_connections 2026-02-17T20:56:34.529 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.410+0000 7f07c5b86640 1 -- 10.20.193.104:0/1890623384 wait complete. 2026-02-17T20:56:34.529 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.410+0000 7f07c5b86640 1 Processor -- start 2026-02-17T20:56:34.529 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.410+0000 7f07c5b86640 1 -- start start 2026-02-17T20:56:34.529 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.410+0000 7f07c5b86640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07c0105e50 0x7f07c01a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:34.529 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.410+0000 7f07c5b86640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f07c01096e0 con 0x7f07c0105e50 2026-02-17T20:56:34.529 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.410+0000 7f07bf7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07c0105e50 0x7f07c01a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:34.529 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.410+0000 7f07bf7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07c0105e50 0x7f07c01a3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33602/0 (socket says 10.20.193.104:33602) 2026-02-17T20:56:34.529 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.410+0000 7f07bf7fe640 1 -- 10.20.193.104:0/2327707671 learned_addr learned my addr 10.20.193.104:0/2327707671 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:34.529 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.410+0000 7f07bf7fe640 1 -- 10.20.193.104:0/2327707671 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07c01a4180 con 0x7f07c0105e50 2026-02-17T20:56:34.529 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.410+0000 7f07bf7fe640 1 --2- 10.20.193.104:0/2327707671 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07c0105e50 0x7f07c01a3c40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f07ac037b20 tx=0x7f07ac0358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:34.529 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.411+0000 7f07bcff9640 1 -- 10.20.193.104:0/2327707671 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f07ac0378f0 con 0x7f07c0105e50 2026-02-17T20:56:34.530 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.411+0000 7f07bcff9640 1 -- 10.20.193.104:0/2327707671 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f07ac035c90 con 0x7f07c0105e50 2026-02-17T20:56:34.530 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.411+0000 7f07c5b86640 1 -- 10.20.193.104:0/2327707671 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07c01a4410 con 0x7f07c0105e50 2026-02-17T20:56:34.530 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.411+0000 7f07bcff9640 1 -- 10.20.193.104:0/2327707671 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f07ac041550 con 0x7f07c0105e50 2026-02-17T20:56:34.530 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.411+0000 7f07c5b86640 1 -- 10.20.193.104:0/2327707671 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07c01a7100 con 0x7f07c0105e50 2026-02-17T20:56:34.530 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.411+0000 7f07c5b86640 1 -- 10.20.193.104:0/2327707671 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07c0106250 con 0x7f07c0105e50 2026-02-17T20:56:34.530 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.411+0000 7f07bcff9640 1 -- 10.20.193.104:0/2327707671 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 4) ==== 50250+0+0 (secure 0 0 0) 0x7f07ac0428d0 con 0x7f07c0105e50 2026-02-17T20:56:34.530 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.411+0000 7f07bcff9640 1 --2- 10.20.193.104:0/2327707671 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7f079403db50 0x7f0794040010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:34.530 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.411+0000 7f07bcff9640 1 -- 10.20.193.104:0/2327707671 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f07ac076330 con 0x7f07c0105e50 2026-02-17T20:56:34.530 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.411+0000 7f07beffd640 1 --2- 10.20.193.104:0/2327707671 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7f079403db50 0x7f0794040010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:34.530 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.412+0000 7f07beffd640 1 --2- 10.20.193.104:0/2327707671 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7f079403db50 0x7f0794040010 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f07b00099c0 tx=0x7f07b0006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:34.530 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.414+0000 7f07bcff9640 1 -- 10.20.193.104:0/2327707671 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f07ac03e200 con 0x7f07c0105e50 2026-02-17T20:56:34.531 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.496+0000 7f07c5b86640 1 -- 10.20.193.104:0/2327707671 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f07c019d360 con 0x7f07c0105e50 2026-02-17T20:56:34.531 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.497+0000 7f07bcff9640 1 -- 10.20.193.104:0/2327707671 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+376 (secure 0 0 0) 0x7f07ac076090 con 0x7f07c0105e50 2026-02-17T20:56:34.531 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.497+0000 7f07c5b86640 1 -- 10.20.193.104:0/2327707671 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7f079403db50 msgr2=0x7f0794040010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:34.531 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.497+0000 7f07c5b86640 1 --2- 10.20.193.104:0/2327707671 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7f079403db50 0x7f0794040010 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f07b00099c0 tx=0x7f07b0006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:34.531 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.497+0000 7f07c5b86640 1 -- 10.20.193.104:0/2327707671 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07c0105e50 msgr2=0x7f07c01a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:34.531 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.497+0000 7f07c5b86640 1 --2- 10.20.193.104:0/2327707671 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07c0105e50 0x7f07c01a3c40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f07ac037b20 tx=0x7f07ac0358c0 comp rx=0 tx=0).stop 2026-02-17T20:56:34.531 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.497+0000 7f07c5b86640 1 -- 10.20.193.104:0/2327707671 shutdown_connections 2026-02-17T20:56:34.531 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.497+0000 7f07c5b86640 1 --2- 10.20.193.104:0/2327707671 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7f079403db50 0x7f0794040010 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:34.531 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.497+0000 7f07c5b86640 1 --2- 10.20.193.104:0/2327707671 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07c0105e50 0x7f07c01a3c40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:34.531 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.497+0000 7f07c5b86640 1 -- 10.20.193.104:0/2327707671 >> 10.20.193.104:0/2327707671 conn(0x7f07c0101ce0 msgr2=0x7f07c010be20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:34.531 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.497+0000 7f07c5b86640 1 -- 10.20.193.104:0/2327707671 shutdown_connections 2026-02-17T20:56:34.532 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.497+0000 7f07c5b86640 1 -- 10.20.193.104:0/2327707671 wait complete. 2026-02-17T20:56:34.532 INFO:teuthology.orchestra.run.trial104.stdout:Enabling cephadm module... 2026-02-17T20:56:34.619 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:34 trial104 ceph-mon[20612]: mgrmap e3: trial104.irrhmt(active, since 1.00513s) 2026-02-17T20:56:34.619 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:34 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/2694612644' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2026-02-17T20:56:35.408 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.616+0000 7fee4fa49640 1 Processor -- start 2026-02-17T20:56:35.409 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.616+0000 7fee4fa49640 1 -- start start 2026-02-17T20:56:35.409 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.617+0000 7fee4fa49640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fee48109880 0x7fee48109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:35.409 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.617+0000 7fee4fa49640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fee4810a250 con 0x7fee48109880 2026-02-17T20:56:35.409 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.617+0000 7fee4d7be640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fee48109880 0x7fee48109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:35.409 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.617+0000 7fee4d7be640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fee48109880 0x7fee48109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33606/0 (socket says 10.20.193.104:33606) 2026-02-17T20:56:35.409 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.617+0000 7fee4d7be640 1 -- 10.20.193.104:0/3687391076 learned_addr learned my addr 10.20.193.104:0/3687391076 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:35.409 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.617+0000 7fee4d7be640 1 -- 10.20.193.104:0/3687391076 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4810aa80 con 0x7fee48109880 2026-02-17T20:56:35.409 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.617+0000 7fee4d7be640 1 --2- 10.20.193.104:0/3687391076 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fee48109880 0x7fee48109c80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fee38009920 tx=0x7fee3802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c5f8dea794060d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:35.409 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.617+0000 7fee37fff640 1 -- 10.20.193.104:0/3687391076 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fee3803c070 con 0x7fee48109880 2026-02-17T20:56:35.409 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.618+0000 7fee37fff640 1 -- 10.20.193.104:0/3687391076 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fee3802fe00 con 0x7fee48109880 2026-02-17T20:56:35.409 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.618+0000 7fee37fff640 1 -- 10.20.193.104:0/3687391076 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fee38035340 con 0x7fee48109880 2026-02-17T20:56:35.409 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.618+0000 7fee4fa49640 1 -- 10.20.193.104:0/3687391076 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fee48109880 msgr2=0x7fee48109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:35.410 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.618+0000 7fee4fa49640 1 --2- 10.20.193.104:0/3687391076 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fee48109880 0x7fee48109c80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fee38009920 tx=0x7fee3802ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:35.410 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.618+0000 7fee4fa49640 1 -- 10.20.193.104:0/3687391076 shutdown_connections 2026-02-17T20:56:35.410 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.618+0000 7fee4fa49640 1 --2- 10.20.193.104:0/3687391076 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fee48109880 0x7fee48109c80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:35.410 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.618+0000 7fee4fa49640 1 -- 10.20.193.104:0/3687391076 >> 10.20.193.104:0/3687391076 conn(0x7fee4807cf00 msgr2=0x7fee4807d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:35.410 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.618+0000 7fee4fa49640 1 -- 10.20.193.104:0/3687391076 shutdown_connections 2026-02-17T20:56:35.410 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.618+0000 7fee4fa49640 1 -- 10.20.193.104:0/3687391076 wait complete. 2026-02-17T20:56:35.410 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.618+0000 7fee4fa49640 1 Processor -- start 2026-02-17T20:56:35.410 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.618+0000 7fee4fa49640 1 -- start start 2026-02-17T20:56:35.410 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.618+0000 7fee4fa49640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fee48109880 0x7fee4819f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:35.410 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.618+0000 7fee4fa49640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fee4810dcb0 con 0x7fee48109880 2026-02-17T20:56:35.410 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.618+0000 7fee4d7be640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fee48109880 0x7fee4819f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:35.410 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.618+0000 7fee4d7be640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fee48109880 0x7fee4819f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33612/0 (socket says 10.20.193.104:33612) 2026-02-17T20:56:35.410 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.618+0000 7fee4d7be640 1 -- 10.20.193.104:0/3759885240 learned_addr learned my addr 10.20.193.104:0/3759885240 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:35.411 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.619+0000 7fee4d7be640 1 -- 10.20.193.104:0/3759885240 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4819fce0 con 0x7fee48109880 2026-02-17T20:56:35.411 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.619+0000 7fee4d7be640 1 --2- 10.20.193.104:0/3759885240 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fee48109880 0x7fee4819f7a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fee38037b20 tx=0x7fee380358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:35.411 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.619+0000 7fee367fc640 1 -- 10.20.193.104:0/3759885240 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fee38035c10 con 0x7fee48109880 2026-02-17T20:56:35.411 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.619+0000 7fee367fc640 1 -- 10.20.193.104:0/3759885240 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fee38035db0 con 0x7fee48109880 2026-02-17T20:56:35.411 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.619+0000 7fee367fc640 1 -- 10.20.193.104:0/3759885240 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fee380413a0 con 0x7fee48109880 2026-02-17T20:56:35.411 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.619+0000 7fee4fa49640 1 -- 10.20.193.104:0/3759885240 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee4819ff70 con 0x7fee48109880 2026-02-17T20:56:35.411 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.619+0000 7fee4fa49640 1 -- 10.20.193.104:0/3759885240 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee481a2c60 con 0x7fee48109880 2026-02-17T20:56:35.411 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.619+0000 7fee4fa49640 1 -- 10.20.193.104:0/3759885240 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee48109d00 con 0x7fee48109880 2026-02-17T20:56:35.411 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.619+0000 7fee367fc640 1 -- 10.20.193.104:0/3759885240 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 4) ==== 50250+0+0 (secure 0 0 0) 0x7fee380423f0 con 0x7fee48109880 2026-02-17T20:56:35.411 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.619+0000 7fee367fc640 1 --2- 10.20.193.104:0/3759885240 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fee2403dba0 0x7fee24040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:35.411 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.619+0000 7fee367fc640 1 -- 10.20.193.104:0/3759885240 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fee38076320 con 0x7fee48109880 2026-02-17T20:56:35.411 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.620+0000 7fee4cfbd640 1 --2- 10.20.193.104:0/3759885240 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fee2403dba0 0x7fee24040060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:35.411 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.620+0000 7fee4cfbd640 1 --2- 10.20.193.104:0/3759885240 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fee2403dba0 0x7fee24040060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0099c0 tx=0x7fee3c006eb0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:35.412 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.622+0000 7fee367fc640 1 -- 10.20.193.104:0/3759885240 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fee38076080 con 0x7fee48109880 2026-02-17T20:56:35.412 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:34.725+0000 7fee4fa49640 1 -- 10.20.193.104:0/3759885240 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fee481a33c0 con 0x7fee48109880 2026-02-17T20:56:35.412 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.379+0000 7fee367fc640 1 -- 10.20.193.104:0/3759885240 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fee38042710 con 0x7fee48109880 2026-02-17T20:56:35.412 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.380+0000 7fee367fc640 1 -- 10.20.193.104:0/3759885240 <== mon.0 v2:10.20.193.104:3300/0 8 ==== mgrmap(e 5) ==== 50261+0+0 (secure 0 0 0) 0x7fee38041600 con 0x7fee48109880 2026-02-17T20:56:35.412 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.381+0000 7fee4fa49640 1 -- 10.20.193.104:0/3759885240 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fee2403dba0 msgr2=0x7fee24040060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:35.412 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.381+0000 7fee4fa49640 1 --2- 10.20.193.104:0/3759885240 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fee2403dba0 0x7fee24040060 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fee3c0099c0 tx=0x7fee3c006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:35.412 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.381+0000 7fee4fa49640 1 -- 10.20.193.104:0/3759885240 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fee48109880 msgr2=0x7fee4819f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:35.412 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.381+0000 7fee4fa49640 1 --2- 10.20.193.104:0/3759885240 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fee48109880 0x7fee4819f7a0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fee38037b20 tx=0x7fee380358c0 comp rx=0 tx=0).stop 2026-02-17T20:56:35.412 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.382+0000 7fee4fa49640 1 -- 10.20.193.104:0/3759885240 shutdown_connections 2026-02-17T20:56:35.412 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.382+0000 7fee4fa49640 1 --2- 10.20.193.104:0/3759885240 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fee2403dba0 0x7fee24040060 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:35.412 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.382+0000 7fee4fa49640 1 --2- 10.20.193.104:0/3759885240 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fee48109880 0x7fee4819f7a0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:35.412 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.382+0000 7fee4fa49640 1 -- 10.20.193.104:0/3759885240 >> 10.20.193.104:0/3759885240 conn(0x7fee4807cf00 msgr2=0x7fee481070c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:35.412 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.382+0000 7fee4fa49640 1 -- 10.20.193.104:0/3759885240 shutdown_connections 2026-02-17T20:56:35.413 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.382+0000 7fee4fa49640 1 -- 10.20.193.104:0/3759885240 wait complete. 2026-02-17T20:56:35.635 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:35 trial104 ceph-mon[20612]: mgrmap e4: trial104.irrhmt(active, since 2s) 2026-02-17T20:56:35.635 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:35 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/2327707671' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2026-02-17T20:56:35.635 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:35 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3759885240' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2026-02-17T20:56:35.648 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout { 2026-02-17T20:56:35.648 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-17T20:56:35.648 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T20:56:35.649 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "active_name": "trial104.irrhmt", 2026-02-17T20:56:35.649 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-17T20:56:35.649 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout } 2026-02-17T20:56:35.649 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.506+0000 7fd3d914f640 1 Processor -- start 2026-02-17T20:56:35.649 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.506+0000 7fd3d914f640 1 -- start start 2026-02-17T20:56:35.649 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.506+0000 7fd3d914f640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd3d41124c0 0x7fd3d41128c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:35.650 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.506+0000 7fd3d914f640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d4112e90 con 0x7fd3d41124c0 2026-02-17T20:56:35.650 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.506+0000 7fd3d2d76640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd3d41124c0 0x7fd3d41128c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:35.650 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.506+0000 7fd3d2d76640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd3d41124c0 0x7fd3d41128c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33626/0 (socket says 10.20.193.104:33626) 2026-02-17T20:56:35.650 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.506+0000 7fd3d2d76640 1 -- 10.20.193.104:0/748455942 learned_addr learned my addr 10.20.193.104:0/748455942 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:35.650 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.506+0000 7fd3d2d76640 1 -- 10.20.193.104:0/748455942 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d4113420 con 0x7fd3d41124c0 2026-02-17T20:56:35.650 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.507+0000 7fd3d2d76640 1 --2- 10.20.193.104:0/748455942 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd3d41124c0 0x7fd3d41128c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009920 tx=0x7fd3c802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1645c772256628c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:35.651 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.507+0000 7fd3d1d74640 1 -- 10.20.193.104:0/748455942 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fd3c803c070 con 0x7fd3d41124c0 2026-02-17T20:56:35.651 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.507+0000 7fd3d1d74640 1 -- 10.20.193.104:0/748455942 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fd3c802fe00 con 0x7fd3d41124c0 2026-02-17T20:56:35.651 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.507+0000 7fd3d1d74640 1 -- 10.20.193.104:0/748455942 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fd3c8035340 con 0x7fd3d41124c0 2026-02-17T20:56:35.651 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.507+0000 7fd3d914f640 1 -- 10.20.193.104:0/748455942 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd3d41124c0 msgr2=0x7fd3d41128c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:35.651 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.507+0000 7fd3d914f640 1 --2- 10.20.193.104:0/748455942 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd3d41124c0 0x7fd3d41128c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8009920 tx=0x7fd3c802ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:35.651 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.507+0000 7fd3d914f640 1 -- 10.20.193.104:0/748455942 shutdown_connections 2026-02-17T20:56:35.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.507+0000 7fd3d914f640 1 --2- 10.20.193.104:0/748455942 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd3d41124c0 0x7fd3d41128c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:35.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.507+0000 7fd3d914f640 1 -- 10.20.193.104:0/748455942 >> 10.20.193.104:0/748455942 conn(0x7fd3d406efa0 msgr2=0x7fd3d406f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:35.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.507+0000 7fd3d914f640 1 -- 10.20.193.104:0/748455942 shutdown_connections 2026-02-17T20:56:35.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.507+0000 7fd3d914f640 1 -- 10.20.193.104:0/748455942 wait complete. 2026-02-17T20:56:35.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.507+0000 7fd3d914f640 1 Processor -- start 2026-02-17T20:56:35.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.508+0000 7fd3d914f640 1 -- start start 2026-02-17T20:56:35.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.508+0000 7fd3d914f640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd3d41124c0 0x7fd3d41a8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:35.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.508+0000 7fd3d914f640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd3d4113010 con 0x7fd3d41124c0 2026-02-17T20:56:35.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.508+0000 7fd3d2d76640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd3d41124c0 0x7fd3d41a8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:35.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.508+0000 7fd3d2d76640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd3d41124c0 0x7fd3d41a8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33634/0 (socket says 10.20.193.104:33634) 2026-02-17T20:56:35.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.508+0000 7fd3d2d76640 1 -- 10.20.193.104:0/3586437650 learned_addr learned my addr 10.20.193.104:0/3586437650 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:35.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.508+0000 7fd3d2d76640 1 -- 10.20.193.104:0/3586437650 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d41a8690 con 0x7fd3d41124c0 2026-02-17T20:56:35.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.508+0000 7fd3d2d76640 1 --2- 10.20.193.104:0/3586437650 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd3d41124c0 0x7fd3d41a8150 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8037c30 tx=0x7fd3c8035640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:35.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.508+0000 7fd3b3fff640 1 -- 10.20.193.104:0/3586437650 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fd3c8035ad0 con 0x7fd3d41124c0 2026-02-17T20:56:35.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.508+0000 7fd3b3fff640 1 -- 10.20.193.104:0/3586437650 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fd3c8035c70 con 0x7fd3d41124c0 2026-02-17T20:56:35.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.508+0000 7fd3d914f640 1 -- 10.20.193.104:0/3586437650 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3d41a8920 con 0x7fd3d41124c0 2026-02-17T20:56:35.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.508+0000 7fd3b3fff640 1 -- 10.20.193.104:0/3586437650 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fd3c80363a0 con 0x7fd3d41124c0 2026-02-17T20:56:35.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.508+0000 7fd3d914f640 1 -- 10.20.193.104:0/3586437650 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3d41ab610 con 0x7fd3d41124c0 2026-02-17T20:56:35.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.509+0000 7fd3d914f640 1 -- 10.20.193.104:0/3586437650 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3d4112940 con 0x7fd3d41124c0 2026-02-17T20:56:35.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.509+0000 7fd3b3fff640 1 -- 10.20.193.104:0/3586437650 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 5) ==== 50261+0+0 (secure 0 0 0) 0x7fd3c8041880 con 0x7fd3d41124c0 2026-02-17T20:56:35.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.509+0000 7fd3b3fff640 1 --2- 10.20.193.104:0/3586437650 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fd3a803dba0 0x7fd3a8040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:35.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.509+0000 7fd3d2575640 1 -- 10.20.193.104:0/3586437650 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fd3a803dba0 msgr2=0x7fd3a8040060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.104:6800/3247908774 2026-02-17T20:56:35.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.509+0000 7fd3b3fff640 1 -- 10.20.193.104:0/3586437650 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd3c80765b0 con 0x7fd3d41124c0 2026-02-17T20:56:35.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.509+0000 7fd3d2575640 1 --2- 10.20.193.104:0/3586437650 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fd3a803dba0 0x7fd3a8040060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T20:56:35.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.511+0000 7fd3b3fff640 1 -- 10.20.193.104:0/3586437650 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd3c803d160 con 0x7fd3d41124c0 2026-02-17T20:56:35.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.617+0000 7fd3d914f640 1 -- 10.20.193.104:0/3586437650 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7fd3d41abd70 con 0x7fd3d41124c0 2026-02-17T20:56:35.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.617+0000 7fd3b3fff640 1 -- 10.20.193.104:0/3586437650 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+102 (secure 0 0 0) 0x7fd3c8075fd0 con 0x7fd3d41124c0 2026-02-17T20:56:35.656 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.618+0000 7fd3d914f640 1 -- 10.20.193.104:0/3586437650 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fd3a803dba0 msgr2=0x7fd3a8040060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T20:56:35.656 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.618+0000 7fd3d914f640 1 --2- 10.20.193.104:0/3586437650 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fd3a803dba0 0x7fd3a8040060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:35.656 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.619+0000 7fd3d914f640 1 -- 10.20.193.104:0/3586437650 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd3d41124c0 msgr2=0x7fd3d41a8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:35.656 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.619+0000 7fd3d914f640 1 --2- 10.20.193.104:0/3586437650 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd3d41124c0 0x7fd3d41a8150 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8037c30 tx=0x7fd3c8035640 comp rx=0 tx=0).stop 2026-02-17T20:56:35.656 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.619+0000 7fd3d914f640 1 -- 10.20.193.104:0/3586437650 shutdown_connections 2026-02-17T20:56:35.656 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.619+0000 7fd3d914f640 1 --2- 10.20.193.104:0/3586437650 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fd3a803dba0 0x7fd3a8040060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:35.656 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.619+0000 7fd3d914f640 1 --2- 10.20.193.104:0/3586437650 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd3d41124c0 0x7fd3d41a8150 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:35.657 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.619+0000 7fd3d914f640 1 -- 10.20.193.104:0/3586437650 >> 10.20.193.104:0/3586437650 conn(0x7fd3d406efa0 msgr2=0x7fd3d41102d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:35.657 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.619+0000 7fd3d914f640 1 -- 10.20.193.104:0/3586437650 shutdown_connections 2026-02-17T20:56:35.657 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.619+0000 7fd3d914f640 1 -- 10.20.193.104:0/3586437650 wait complete. 2026-02-17T20:56:35.657 INFO:teuthology.orchestra.run.trial104.stdout:Waiting for the mgr to restart... 2026-02-17T20:56:35.657 INFO:teuthology.orchestra.run.trial104.stdout:Waiting for mgr epoch 5... 2026-02-17T20:56:36.468 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:36 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3759885240' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-17T20:56:36.469 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:36 trial104 ceph-mon[20612]: mgrmap e5: trial104.irrhmt(active, since 3s) 2026-02-17T20:56:36.469 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:36 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3586437650' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-17T20:56:38.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:38 trial104 ceph-mon[20612]: Active manager daemon trial104.irrhmt restarted 2026-02-17T20:56:38.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:38 trial104 ceph-mon[20612]: Activating manager daemon trial104.irrhmt 2026-02-17T20:56:38.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:38 trial104 ceph-mon[20612]: osdmap e2: 0 total, 0 up, 0 in 2026-02-17T20:56:38.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:38 trial104 ceph-mon[20612]: mgrmap e6: trial104.irrhmt(active, starting, since 0.00265514s) 2026-02-17T20:56:38.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:38 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial104"}]: dispatch 2026-02-17T20:56:38.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:38 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mgr metadata", "who": "trial104.irrhmt", "id": "trial104.irrhmt"}]: dispatch 2026-02-17T20:56:38.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:38 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T20:56:38.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:38 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T20:56:38.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:38 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T20:56:38.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:38 trial104 ceph-mon[20612]: Manager daemon trial104.irrhmt is now available 2026-02-17T20:56:38.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:38 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:38.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:38 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:38.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:38 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:56:38.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:38 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:56:38.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:38 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial104.irrhmt/mirror_snapshot_schedule"}]: dispatch 2026-02-17T20:56:38.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:38 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial104.irrhmt/trash_purge_schedule"}]: dispatch 2026-02-17T20:56:39.063 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout { 2026-02-17T20:56:39.063 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-17T20:56:39.064 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-17T20:56:39.064 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout } 2026-02-17T20:56:39.064 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.747+0000 7fceecdd6640 1 Processor -- start 2026-02-17T20:56:39.064 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.747+0000 7fceecdd6640 1 -- start start 2026-02-17T20:56:39.064 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.747+0000 7fceecdd6640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcee8109880 0x7fcee8109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:39.064 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.747+0000 7fceecdd6640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcee810a250 con 0x7fcee8109880 2026-02-17T20:56:39.064 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.747+0000 7fcee6575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcee8109880 0x7fcee8109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:39.064 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.747+0000 7fcee6575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcee8109880 0x7fcee8109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33644/0 (socket says 10.20.193.104:33644) 2026-02-17T20:56:39.064 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.747+0000 7fcee6575640 1 -- 10.20.193.104:0/263170807 learned_addr learned my addr 10.20.193.104:0/263170807 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:39.065 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.747+0000 7fcee6575640 1 -- 10.20.193.104:0/263170807 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee810aa80 con 0x7fcee8109880 2026-02-17T20:56:39.065 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.748+0000 7fcee6575640 1 --2- 10.20.193.104:0/263170807 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcee8109880 0x7fcee8109c80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009920 tx=0x7fcedc02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f113529c12df7e83 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:39.065 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.748+0000 7fcee5573640 1 -- 10.20.193.104:0/263170807 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fcedc03c070 con 0x7fcee8109880 2026-02-17T20:56:39.065 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.748+0000 7fcee5573640 1 -- 10.20.193.104:0/263170807 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fcedc02fe00 con 0x7fcee8109880 2026-02-17T20:56:39.065 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.748+0000 7fcee5573640 1 -- 10.20.193.104:0/263170807 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fcedc035340 con 0x7fcee8109880 2026-02-17T20:56:39.065 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.748+0000 7fceecdd6640 1 -- 10.20.193.104:0/263170807 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcee8109880 msgr2=0x7fcee8109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:39.065 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.748+0000 7fceecdd6640 1 --2- 10.20.193.104:0/263170807 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcee8109880 0x7fcee8109c80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcedc009920 tx=0x7fcedc02ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:39.065 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.748+0000 7fceecdd6640 1 -- 10.20.193.104:0/263170807 shutdown_connections 2026-02-17T20:56:39.065 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.748+0000 7fceecdd6640 1 --2- 10.20.193.104:0/263170807 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcee8109880 0x7fcee8109c80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.065 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.748+0000 7fceecdd6640 1 -- 10.20.193.104:0/263170807 >> 10.20.193.104:0/263170807 conn(0x7fcee807cf00 msgr2=0x7fcee807d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:39.065 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.748+0000 7fceecdd6640 1 -- 10.20.193.104:0/263170807 shutdown_connections 2026-02-17T20:56:39.065 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.748+0000 7fceecdd6640 1 -- 10.20.193.104:0/263170807 wait complete. 2026-02-17T20:56:39.066 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.748+0000 7fceecdd6640 1 Processor -- start 2026-02-17T20:56:39.066 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.748+0000 7fceecdd6640 1 -- start start 2026-02-17T20:56:39.066 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.748+0000 7fceecdd6640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcee8109880 0x7fcee819f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:39.066 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.748+0000 7fceecdd6640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcee810dcb0 con 0x7fcee8109880 2026-02-17T20:56:39.066 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.749+0000 7fcee6575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcee8109880 0x7fcee819f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:39.066 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.749+0000 7fcee6575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcee8109880 0x7fcee819f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:33652/0 (socket says 10.20.193.104:33652) 2026-02-17T20:56:39.066 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.749+0000 7fcee6575640 1 -- 10.20.193.104:0/1320947283 learned_addr learned my addr 10.20.193.104:0/1320947283 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:39.066 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.749+0000 7fcee6575640 1 -- 10.20.193.104:0/1320947283 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcee819fcd0 con 0x7fcee8109880 2026-02-17T20:56:39.066 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.749+0000 7fcee6575640 1 --2- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcee8109880 0x7fcee819f790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcedc037b20 tx=0x7fcedc0358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:39.066 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.749+0000 7fcecf7fe640 1 -- 10.20.193.104:0/1320947283 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fcedc035c10 con 0x7fcee8109880 2026-02-17T20:56:39.066 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.749+0000 7fcecf7fe640 1 -- 10.20.193.104:0/1320947283 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fcedc035db0 con 0x7fcee8109880 2026-02-17T20:56:39.066 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.749+0000 7fcecf7fe640 1 -- 10.20.193.104:0/1320947283 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fcedc0413a0 con 0x7fcee8109880 2026-02-17T20:56:39.066 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.749+0000 7fceecdd6640 1 -- 10.20.193.104:0/1320947283 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcee819ff60 con 0x7fcee8109880 2026-02-17T20:56:39.067 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.749+0000 7fceecdd6640 1 -- 10.20.193.104:0/1320947283 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcee81a2c50 con 0x7fcee8109880 2026-02-17T20:56:39.067 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.749+0000 7fcecf7fe640 1 -- 10.20.193.104:0/1320947283 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 5) ==== 50261+0+0 (secure 0 0 0) 0x7fcedc0423f0 con 0x7fcee8109880 2026-02-17T20:56:39.067 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.750+0000 7fcecf7fe640 1 --2- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fcec003dbf0 0x7fcec00400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:39.067 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.750+0000 7fcecf7fe640 1 -- 10.20.193.104:0/1320947283 --> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fcec00407c0 con 0x7fcec003dbf0 2026-02-17T20:56:39.067 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.750+0000 7fcee5d74640 1 -- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fcec003dbf0 msgr2=0x7fcec00400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.104:6800/3247908774 2026-02-17T20:56:39.067 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.750+0000 7fcecf7fe640 1 -- 10.20.193.104:0/1320947283 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcedc0763c0 con 0x7fcee8109880 2026-02-17T20:56:39.067 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.750+0000 7fcee5d74640 1 --2- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fcec003dbf0 0x7fcec00400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T20:56:39.067 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.951+0000 7fcee5d74640 1 -- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fcec003dbf0 msgr2=0x7fcec00400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.104:6800/3247908774 2026-02-17T20:56:39.067 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:35.951+0000 7fcee5d74640 1 --2- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fcec003dbf0 0x7fcec00400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T20:56:39.067 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:36.352+0000 7fcee5d74640 1 -- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fcec003dbf0 msgr2=0x7fcec00400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.104:6800/3247908774 2026-02-17T20:56:39.067 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:36.352+0000 7fcee5d74640 1 --2- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fcec003dbf0 0x7fcec00400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T20:56:39.067 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:37.153+0000 7fcee5d74640 1 -- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fcec003dbf0 msgr2=0x7fcec00400b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.104:6800/3247908774 2026-02-17T20:56:39.068 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:37.153+0000 7fcee5d74640 1 --2- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fcec003dbf0 0x7fcec00400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T20:56:39.068 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:38.014+0000 7fcecf7fe640 1 -- 10.20.193.104:0/1320947283 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mgrmap(e 6) ==== 50028+0+0 (secure 0 0 0) 0x7fcedc0751c0 con 0x7fcee8109880 2026-02-17T20:56:39.068 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:38.014+0000 7fcecf7fe640 1 -- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fcec003dbf0 msgr2=0x7fcec00400b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T20:56:39.068 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:38.014+0000 7fcecf7fe640 1 --2- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fcec003dbf0 0x7fcec00400b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.068 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.015+0000 7fcecf7fe640 1 -- 10.20.193.104:0/1320947283 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mgrmap(e 7) ==== 50155+0+0 (secure 0 0 0) 0x7fcedc0758c0 con 0x7fcee8109880 2026-02-17T20:56:39.068 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.015+0000 7fcecf7fe640 1 --2- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fcec0041540 0x7fcec0043930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:39.068 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.015+0000 7fcecf7fe640 1 -- 10.20.193.104:0/1320947283 --> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fcedc040ad0 con 0x7fcec0041540 2026-02-17T20:56:39.068 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.015+0000 7fcee5d74640 1 --2- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fcec0041540 0x7fcec0043930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:39.068 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.015+0000 7fcee5d74640 1 --2- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fcec0041540 0x7fcec0043930 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fced0003a80 tx=0x7fced00092b0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:39.068 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.016+0000 7fcecf7fe640 1 -- 10.20.193.104:0/1320947283 <== mgr.14118 v2:10.20.193.104:6800/95322277 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8901 (secure 0 0 0) 0x7fcedc040ad0 con 0x7fcec0041540 2026-02-17T20:56:39.068 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.019+0000 7fceecdd6640 1 -- 10.20.193.104:0/1320947283 --> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fcee8109d00 con 0x7fcec0041540 2026-02-17T20:56:39.069 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.019+0000 7fcecf7fe640 1 -- 10.20.193.104:0/1320947283 <== mgr.14118 v2:10.20.193.104:6800/95322277 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fcee8109d00 con 0x7fcec0041540 2026-02-17T20:56:39.069 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.019+0000 7fceecdd6640 1 -- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fcec0041540 msgr2=0x7fcec0043930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:39.069 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.019+0000 7fceecdd6640 1 --2- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fcec0041540 0x7fcec0043930 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fced0003a80 tx=0x7fced00092b0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.069 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.019+0000 7fceecdd6640 1 -- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcee8109880 msgr2=0x7fcee819f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:39.069 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.019+0000 7fceecdd6640 1 --2- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcee8109880 0x7fcee819f790 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fcedc037b20 tx=0x7fcedc0358c0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.069 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.019+0000 7fceecdd6640 1 -- 10.20.193.104:0/1320947283 shutdown_connections 2026-02-17T20:56:39.069 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.019+0000 7fceecdd6640 1 --2- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fcec0041540 0x7fcec0043930 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.069 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.019+0000 7fceecdd6640 1 --2- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:6800/3247908774,v1:10.20.193.104:6801/3247908774] conn(0x7fcec003dbf0 0x7fcec00400b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.069 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.019+0000 7fceecdd6640 1 --2- 10.20.193.104:0/1320947283 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcee8109880 0x7fcee819f790 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.069 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.019+0000 7fceecdd6640 1 -- 10.20.193.104:0/1320947283 >> 10.20.193.104:0/1320947283 conn(0x7fcee807cf00 msgr2=0x7fcee81070a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:39.069 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.019+0000 7fceecdd6640 1 -- 10.20.193.104:0/1320947283 shutdown_connections 2026-02-17T20:56:39.069 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.019+0000 7fceecdd6640 1 -- 10.20.193.104:0/1320947283 wait complete. 2026-02-17T20:56:39.070 INFO:teuthology.orchestra.run.trial104.stdout:mgr epoch 5 is available 2026-02-17T20:56:39.070 INFO:teuthology.orchestra.run.trial104.stdout:Setting orchestrator backend to cephadm... 2026-02-17T20:56:39.270 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:39 trial104 ceph-mon[20612]: Found migration_current of "None". Setting to last migration. 2026-02-17T20:56:39.271 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:39 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:39.271 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:39 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:39.271 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:39 trial104 ceph-mon[20612]: mgrmap e7: trial104.irrhmt(active, since 1.00357s) 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.156+0000 7f3711e0c640 1 Processor -- start 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.156+0000 7f3711e0c640 1 -- start start 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.156+0000 7f3711e0c640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f370c107600 0x7f370c107a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.156+0000 7f3711e0c640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f370c107fd0 con 0x7f370c107600 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.156+0000 7f370b7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f370c107600 0x7f370c107a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.156+0000 7f370b7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f370c107600 0x7f370c107a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40532/0 (socket says 10.20.193.104:40532) 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.156+0000 7f370b7fe640 1 -- 10.20.193.104:0/4140365321 learned_addr learned my addr 10.20.193.104:0/4140365321 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.156+0000 7f370b7fe640 1 -- 10.20.193.104:0/4140365321 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f370c108800 con 0x7f370c107600 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.157+0000 7f370b7fe640 1 --2- 10.20.193.104:0/4140365321 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f370c107600 0x7f370c107a00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009920 tx=0x7f36f802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a682efc5228dd5ef server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.157+0000 7f370a7fc640 1 -- 10.20.193.104:0/4140365321 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f36f803c070 con 0x7f370c107600 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.157+0000 7f370a7fc640 1 -- 10.20.193.104:0/4140365321 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f36f802fe00 con 0x7f370c107600 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.157+0000 7f370a7fc640 1 -- 10.20.193.104:0/4140365321 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f36f8035340 con 0x7f370c107600 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.157+0000 7f3711e0c640 1 -- 10.20.193.104:0/4140365321 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f370c107600 msgr2=0x7f370c107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.157+0000 7f3711e0c640 1 --2- 10.20.193.104:0/4140365321 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f370c107600 0x7f370c107a00 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f36f8009920 tx=0x7f36f802ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.157+0000 7f3711e0c640 1 -- 10.20.193.104:0/4140365321 shutdown_connections 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.157+0000 7f3711e0c640 1 --2- 10.20.193.104:0/4140365321 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f370c107600 0x7f370c107a00 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.157+0000 7f3711e0c640 1 -- 10.20.193.104:0/4140365321 >> 10.20.193.104:0/4140365321 conn(0x7f370c102dd0 msgr2=0x7f370c1051f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.157+0000 7f3711e0c640 1 -- 10.20.193.104:0/4140365321 shutdown_connections 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.157+0000 7f3711e0c640 1 -- 10.20.193.104:0/4140365321 wait complete. 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.157+0000 7f3711e0c640 1 Processor -- start 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.157+0000 7f3711e0c640 1 -- start start 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.158+0000 7f3711e0c640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f370c107600 0x7f370c19f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.158+0000 7f3711e0c640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f370c10ba30 con 0x7f370c107600 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.158+0000 7f370b7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f370c107600 0x7f370c19f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:39.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.158+0000 7f370b7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f370c107600 0x7f370c19f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40546/0 (socket says 10.20.193.104:40546) 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.158+0000 7f370b7fe640 1 -- 10.20.193.104:0/2389142573 learned_addr learned my addr 10.20.193.104:0/2389142573 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.158+0000 7f370b7fe640 1 -- 10.20.193.104:0/2389142573 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f370c19fcd0 con 0x7f370c107600 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.158+0000 7f370b7fe640 1 --2- 10.20.193.104:0/2389142573 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f370c107600 0x7f370c19f790 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f36f8037b20 tx=0x7f36f80358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.158+0000 7f3708ff9640 1 -- 10.20.193.104:0/2389142573 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f36f8035c10 con 0x7f370c107600 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.158+0000 7f3708ff9640 1 -- 10.20.193.104:0/2389142573 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f36f8035db0 con 0x7f370c107600 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.158+0000 7f3711e0c640 1 -- 10.20.193.104:0/2389142573 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f370c19ff60 con 0x7f370c107600 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.158+0000 7f3708ff9640 1 -- 10.20.193.104:0/2389142573 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f36f80413a0 con 0x7f370c107600 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.158+0000 7f3711e0c640 1 -- 10.20.193.104:0/2389142573 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f370c1a2c50 con 0x7f370c107600 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.158+0000 7f3711e0c640 1 -- 10.20.193.104:0/2389142573 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f370c107a80 con 0x7f370c107600 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.159+0000 7f3708ff9640 1 -- 10.20.193.104:0/2389142573 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 7) ==== 50155+0+0 (secure 0 0 0) 0x7f36f80423f0 con 0x7f370c107600 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.159+0000 7f3708ff9640 1 --2- 10.20.193.104:0/2389142573 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f36e003da80 0x7f36e003ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.159+0000 7f3708ff9640 1 -- 10.20.193.104:0/2389142573 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f36f8076560 con 0x7f370c107600 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.159+0000 7f370affd640 1 --2- 10.20.193.104:0/2389142573 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f36e003da80 0x7f36e003ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.159+0000 7f370affd640 1 --2- 10.20.193.104:0/2389142573 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f36e003da80 0x7f36e003ff40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0099c0 tx=0x7f36fc006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.162+0000 7f3708ff9640 1 -- 10.20.193.104:0/2389142573 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f36f803e200 con 0x7f370c107600 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.252+0000 7f3711e0c640 1 -- 10.20.193.104:0/2389142573 --> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f370c104010 con 0x7f36e003da80 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.255+0000 7f3708ff9640 1 -- 10.20.193.104:0/2389142573 <== mgr.14118 v2:10.20.193.104:6800/95322277 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f370c104010 con 0x7f36e003da80 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.256+0000 7f3711e0c640 1 -- 10.20.193.104:0/2389142573 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f36e003da80 msgr2=0x7f36e003ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.256+0000 7f3711e0c640 1 --2- 10.20.193.104:0/2389142573 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f36e003da80 0x7f36e003ff40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0099c0 tx=0x7f36fc006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.256+0000 7f3711e0c640 1 -- 10.20.193.104:0/2389142573 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f370c107600 msgr2=0x7f370c19f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.256+0000 7f3711e0c640 1 --2- 10.20.193.104:0/2389142573 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f370c107600 0x7f370c19f790 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f36f8037b20 tx=0x7f36f80358c0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.256+0000 7f3711e0c640 1 -- 10.20.193.104:0/2389142573 shutdown_connections 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.256+0000 7f3711e0c640 1 --2- 10.20.193.104:0/2389142573 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f36e003da80 0x7f36e003ff40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.256+0000 7f3711e0c640 1 --2- 10.20.193.104:0/2389142573 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f370c107600 0x7f370c19f790 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.256+0000 7f3711e0c640 1 -- 10.20.193.104:0/2389142573 >> 10.20.193.104:0/2389142573 conn(0x7f370c102dd0 msgr2=0x7f370c103900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.256+0000 7f3711e0c640 1 -- 10.20.193.104:0/2389142573 shutdown_connections 2026-02-17T20:56:39.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.256+0000 7f3711e0c640 1 -- 10.20.193.104:0/2389142573 wait complete. 2026-02-17T20:56:39.489 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-17T20:56:39.489 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.370+0000 7fa7dcbb5640 1 Processor -- start 2026-02-17T20:56:39.489 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.370+0000 7fa7dcbb5640 1 -- start start 2026-02-17T20:56:39.490 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.371+0000 7fa7dcbb5640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa7d81075f0 0x7fa7d81079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:39.490 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.371+0000 7fa7dcbb5640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d8107fc0 con 0x7fa7d81075f0 2026-02-17T20:56:39.490 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.371+0000 7fa7d6575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa7d81075f0 0x7fa7d81079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:39.490 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.371+0000 7fa7d6575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa7d81075f0 0x7fa7d81079f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40550/0 (socket says 10.20.193.104:40550) 2026-02-17T20:56:39.490 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.371+0000 7fa7d6575640 1 -- 10.20.193.104:0/2535822479 learned_addr learned my addr 10.20.193.104:0/2535822479 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:39.490 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.371+0000 7fa7d6575640 1 -- 10.20.193.104:0/2535822479 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d81087f0 con 0x7fa7d81075f0 2026-02-17T20:56:39.490 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.371+0000 7fa7d6575640 1 --2- 10.20.193.104:0/2535822479 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa7d81075f0 0x7fa7d81079f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009920 tx=0x7fa7cc02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e69bfe4a7c46a84 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:39.490 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.371+0000 7fa7d5573640 1 -- 10.20.193.104:0/2535822479 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa7cc03c070 con 0x7fa7d81075f0 2026-02-17T20:56:39.490 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.371+0000 7fa7d5573640 1 -- 10.20.193.104:0/2535822479 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fa7cc02fe00 con 0x7fa7d81075f0 2026-02-17T20:56:39.490 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.371+0000 7fa7d5573640 1 -- 10.20.193.104:0/2535822479 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa7cc035340 con 0x7fa7d81075f0 2026-02-17T20:56:39.490 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.372+0000 7fa7dcbb5640 1 -- 10.20.193.104:0/2535822479 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa7d81075f0 msgr2=0x7fa7d81079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:39.490 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.372+0000 7fa7dcbb5640 1 --2- 10.20.193.104:0/2535822479 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa7d81075f0 0x7fa7d81079f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc009920 tx=0x7fa7cc02ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:39.491 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.372+0000 7fa7dcbb5640 1 -- 10.20.193.104:0/2535822479 shutdown_connections 2026-02-17T20:56:39.491 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.372+0000 7fa7dcbb5640 1 --2- 10.20.193.104:0/2535822479 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa7d81075f0 0x7fa7d81079f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.491 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.372+0000 7fa7dcbb5640 1 -- 10.20.193.104:0/2535822479 >> 10.20.193.104:0/2535822479 conn(0x7fa7d8102da0 msgr2=0x7fa7d81051c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:39.491 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.372+0000 7fa7dcbb5640 1 -- 10.20.193.104:0/2535822479 shutdown_connections 2026-02-17T20:56:39.491 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.372+0000 7fa7dcbb5640 1 -- 10.20.193.104:0/2535822479 wait complete. 2026-02-17T20:56:39.491 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.372+0000 7fa7dcbb5640 1 Processor -- start 2026-02-17T20:56:39.491 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.372+0000 7fa7dcbb5640 1 -- start start 2026-02-17T20:56:39.491 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.372+0000 7fa7dcbb5640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa7d81075f0 0x7fa7d819d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:39.491 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.372+0000 7fa7dcbb5640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d810ba20 con 0x7fa7d81075f0 2026-02-17T20:56:39.491 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.372+0000 7fa7d6575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa7d81075f0 0x7fa7d819d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:39.491 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.372+0000 7fa7d6575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa7d81075f0 0x7fa7d819d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40558/0 (socket says 10.20.193.104:40558) 2026-02-17T20:56:39.491 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.372+0000 7fa7d6575640 1 -- 10.20.193.104:0/4166382524 learned_addr learned my addr 10.20.193.104:0/4166382524 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:39.492 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.372+0000 7fa7d6575640 1 -- 10.20.193.104:0/4166382524 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d819da40 con 0x7fa7d81075f0 2026-02-17T20:56:39.492 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.373+0000 7fa7d6575640 1 --2- 10.20.193.104:0/4166382524 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa7d81075f0 0x7fa7d819d500 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc037b20 tx=0x7fa7cc0358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:39.492 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.373+0000 7fa7bf7fe640 1 -- 10.20.193.104:0/4166382524 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa7cc035c10 con 0x7fa7d81075f0 2026-02-17T20:56:39.492 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.373+0000 7fa7bf7fe640 1 -- 10.20.193.104:0/4166382524 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fa7cc035db0 con 0x7fa7d81075f0 2026-02-17T20:56:39.492 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.373+0000 7fa7dcbb5640 1 -- 10.20.193.104:0/4166382524 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d819dcd0 con 0x7fa7d81075f0 2026-02-17T20:56:39.492 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.373+0000 7fa7bf7fe640 1 -- 10.20.193.104:0/4166382524 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa7cc0413a0 con 0x7fa7d81075f0 2026-02-17T20:56:39.492 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.373+0000 7fa7dcbb5640 1 -- 10.20.193.104:0/4166382524 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d81a09c0 con 0x7fa7d81075f0 2026-02-17T20:56:39.492 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.373+0000 7fa7dcbb5640 1 -- 10.20.193.104:0/4166382524 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d8107a70 con 0x7fa7d81075f0 2026-02-17T20:56:39.492 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.373+0000 7fa7bf7fe640 1 -- 10.20.193.104:0/4166382524 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 7) ==== 50155+0+0 (secure 0 0 0) 0x7fa7cc0423f0 con 0x7fa7d81075f0 2026-02-17T20:56:39.492 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.373+0000 7fa7bf7fe640 1 --2- 10.20.193.104:0/4166382524 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fa7b003dad0 0x7fa7b003ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:39.492 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.374+0000 7fa7bf7fe640 1 -- 10.20.193.104:0/4166382524 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa7cc076590 con 0x7fa7d81075f0 2026-02-17T20:56:39.493 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.374+0000 7fa7d5d74640 1 --2- 10.20.193.104:0/4166382524 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fa7b003dad0 0x7fa7b003ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:39.493 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.374+0000 7fa7d5d74640 1 --2- 10.20.193.104:0/4166382524 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fa7b003dad0 0x7fa7b003ff90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00099c0 tx=0x7fa7c0006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:39.493 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.376+0000 7fa7bf7fe640 1 -- 10.20.193.104:0/4166382524 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa7cc041600 con 0x7fa7d81075f0 2026-02-17T20:56:39.493 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.460+0000 7fa7dcbb5640 1 -- 10.20.193.104:0/4166382524 --> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fa7d81040b0 con 0x7fa7b003dad0 2026-02-17T20:56:39.493 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.463+0000 7fa7bf7fe640 1 -- 10.20.193.104:0/4166382524 <== mgr.14118 v2:10.20.193.104:6800/95322277 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fa7d81040b0 con 0x7fa7b003dad0 2026-02-17T20:56:39.493 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.464+0000 7fa7dcbb5640 1 -- 10.20.193.104:0/4166382524 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fa7b003dad0 msgr2=0x7fa7b003ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:39.493 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.464+0000 7fa7dcbb5640 1 --2- 10.20.193.104:0/4166382524 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fa7b003dad0 0x7fa7b003ff90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00099c0 tx=0x7fa7c0006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.493 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.464+0000 7fa7dcbb5640 1 -- 10.20.193.104:0/4166382524 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa7d81075f0 msgr2=0x7fa7d819d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:39.493 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.464+0000 7fa7dcbb5640 1 --2- 10.20.193.104:0/4166382524 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa7d81075f0 0x7fa7d819d500 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc037b20 tx=0x7fa7cc0358c0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.493 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.464+0000 7fa7dcbb5640 1 -- 10.20.193.104:0/4166382524 shutdown_connections 2026-02-17T20:56:39.493 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.464+0000 7fa7dcbb5640 1 --2- 10.20.193.104:0/4166382524 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fa7b003dad0 0x7fa7b003ff90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.494 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.464+0000 7fa7dcbb5640 1 --2- 10.20.193.104:0/4166382524 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa7d81075f0 0x7fa7d819d500 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.494 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.464+0000 7fa7dcbb5640 1 -- 10.20.193.104:0/4166382524 >> 10.20.193.104:0/4166382524 conn(0x7fa7d8102da0 msgr2=0x7fa7d81039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:39.494 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.464+0000 7fa7dcbb5640 1 -- 10.20.193.104:0/4166382524 shutdown_connections 2026-02-17T20:56:39.494 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.464+0000 7fa7dcbb5640 1 -- 10.20.193.104:0/4166382524 wait complete. 2026-02-17T20:56:39.494 INFO:teuthology.orchestra.run.trial104.stdout:Generating ssh key... 2026-02-17T20:56:39.718 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.583+0000 7faba47b9640 1 Processor -- start 2026-02-17T20:56:39.718 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.583+0000 7faba47b9640 1 -- start start 2026-02-17T20:56:39.718 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.584+0000 7faba47b9640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fab9c109880 0x7fab9c109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:39.718 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.584+0000 7faba47b9640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fab9c10a250 con 0x7fab9c109880 2026-02-17T20:56:39.719 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.584+0000 7faba252e640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fab9c109880 0x7fab9c109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:39.719 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.584+0000 7faba252e640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fab9c109880 0x7fab9c109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40568/0 (socket says 10.20.193.104:40568) 2026-02-17T20:56:39.719 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.584+0000 7faba252e640 1 -- 10.20.193.104:0/3543707699 learned_addr learned my addr 10.20.193.104:0/3543707699 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:39.719 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.584+0000 7faba252e640 1 -- 10.20.193.104:0/3543707699 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab9c10aa80 con 0x7fab9c109880 2026-02-17T20:56:39.719 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.584+0000 7faba252e640 1 --2- 10.20.193.104:0/3543707699 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fab9c109880 0x7fab9c109c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009920 tx=0x7fab8c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac6b9202e2ff1ac server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:39.719 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.584+0000 7faba152c640 1 -- 10.20.193.104:0/3543707699 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fab8c03c070 con 0x7fab9c109880 2026-02-17T20:56:39.719 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.584+0000 7faba152c640 1 -- 10.20.193.104:0/3543707699 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fab8c02fe00 con 0x7fab9c109880 2026-02-17T20:56:39.719 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.584+0000 7faba152c640 1 -- 10.20.193.104:0/3543707699 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fab8c035340 con 0x7fab9c109880 2026-02-17T20:56:39.719 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.585+0000 7faba47b9640 1 -- 10.20.193.104:0/3543707699 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fab9c109880 msgr2=0x7fab9c109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:39.719 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.585+0000 7faba47b9640 1 --2- 10.20.193.104:0/3543707699 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fab9c109880 0x7fab9c109c80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fab8c009920 tx=0x7fab8c02ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:39.719 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.585+0000 7faba47b9640 1 -- 10.20.193.104:0/3543707699 shutdown_connections 2026-02-17T20:56:39.720 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.585+0000 7faba47b9640 1 --2- 10.20.193.104:0/3543707699 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fab9c109880 0x7fab9c109c80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.720 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.585+0000 7faba47b9640 1 -- 10.20.193.104:0/3543707699 >> 10.20.193.104:0/3543707699 conn(0x7fab9c07ce10 msgr2=0x7fab9c07d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:39.720 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.585+0000 7faba47b9640 1 -- 10.20.193.104:0/3543707699 shutdown_connections 2026-02-17T20:56:39.720 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.585+0000 7faba47b9640 1 -- 10.20.193.104:0/3543707699 wait complete. 2026-02-17T20:56:39.720 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.585+0000 7faba47b9640 1 Processor -- start 2026-02-17T20:56:39.720 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.585+0000 7faba47b9640 1 -- start start 2026-02-17T20:56:39.720 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.585+0000 7faba47b9640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fab9c109880 0x7fab9c19f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:39.720 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.585+0000 7faba47b9640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fab9c10dcb0 con 0x7fab9c109880 2026-02-17T20:56:39.720 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.585+0000 7faba252e640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fab9c109880 0x7fab9c19f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:39.720 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.585+0000 7faba252e640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fab9c109880 0x7fab9c19f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40584/0 (socket says 10.20.193.104:40584) 2026-02-17T20:56:39.721 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.585+0000 7faba252e640 1 -- 10.20.193.104:0/3856583168 learned_addr learned my addr 10.20.193.104:0/3856583168 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:39.721 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.585+0000 7faba252e640 1 -- 10.20.193.104:0/3856583168 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab9c19fc70 con 0x7fab9c109880 2026-02-17T20:56:39.721 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.585+0000 7faba252e640 1 --2- 10.20.193.104:0/3856583168 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fab9c109880 0x7fab9c19f730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fab8c037b20 tx=0x7fab8c0358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:39.721 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.586+0000 7fab837fe640 1 -- 10.20.193.104:0/3856583168 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fab8c035c10 con 0x7fab9c109880 2026-02-17T20:56:39.721 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.586+0000 7fab837fe640 1 -- 10.20.193.104:0/3856583168 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7fab8c035db0 con 0x7fab9c109880 2026-02-17T20:56:39.721 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.586+0000 7fab837fe640 1 -- 10.20.193.104:0/3856583168 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fab8c0413a0 con 0x7fab9c109880 2026-02-17T20:56:39.721 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.586+0000 7faba47b9640 1 -- 10.20.193.104:0/3856583168 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab9c19ff00 con 0x7fab9c109880 2026-02-17T20:56:39.721 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.586+0000 7faba47b9640 1 -- 10.20.193.104:0/3856583168 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab9c1a2bf0 con 0x7fab9c109880 2026-02-17T20:56:39.721 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.586+0000 7faba47b9640 1 -- 10.20.193.104:0/3856583168 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab9c109d00 con 0x7fab9c109880 2026-02-17T20:56:39.721 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.586+0000 7fab837fe640 1 -- 10.20.193.104:0/3856583168 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 7) ==== 50155+0+0 (secure 0 0 0) 0x7fab8c041650 con 0x7fab9c109880 2026-02-17T20:56:39.721 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.586+0000 7fab837fe640 1 --2- 10.20.193.104:0/3856583168 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fab7803dad0 0x7fab7803ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:39.722 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.586+0000 7fab837fe640 1 -- 10.20.193.104:0/3856583168 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fab8c076500 con 0x7fab9c109880 2026-02-17T20:56:39.722 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.586+0000 7faba1d2d640 1 --2- 10.20.193.104:0/3856583168 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fab7803dad0 0x7fab7803ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:39.722 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.587+0000 7faba1d2d640 1 --2- 10.20.193.104:0/3856583168 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fab7803dad0 0x7fab7803ff90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fab900099c0 tx=0x7fab90006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:39.722 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.589+0000 7fab837fe640 1 -- 10.20.193.104:0/3856583168 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fab8c03fbc0 con 0x7fab9c109880 2026-02-17T20:56:39.722 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.671+0000 7faba47b9640 1 -- 10.20.193.104:0/3856583168 --> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fab9c1077a0 con 0x7fab7803dad0 2026-02-17T20:56:39.722 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.692+0000 7fab837fe640 1 -- 10.20.193.104:0/3856583168 <== mgr.14118 v2:10.20.193.104:6800/95322277 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fab9c1077a0 con 0x7fab7803dad0 2026-02-17T20:56:39.722 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.692+0000 7faba47b9640 1 -- 10.20.193.104:0/3856583168 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fab7803dad0 msgr2=0x7fab7803ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:39.722 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.692+0000 7faba47b9640 1 --2- 10.20.193.104:0/3856583168 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fab7803dad0 0x7fab7803ff90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fab900099c0 tx=0x7fab90006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.722 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.692+0000 7faba47b9640 1 -- 10.20.193.104:0/3856583168 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fab9c109880 msgr2=0x7fab9c19f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:39.722 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.692+0000 7faba47b9640 1 --2- 10.20.193.104:0/3856583168 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fab9c109880 0x7fab9c19f730 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fab8c037b20 tx=0x7fab8c0358c0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.722 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.692+0000 7faba47b9640 1 -- 10.20.193.104:0/3856583168 shutdown_connections 2026-02-17T20:56:39.723 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.692+0000 7faba47b9640 1 --2- 10.20.193.104:0/3856583168 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fab7803dad0 0x7fab7803ff90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.723 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.692+0000 7faba47b9640 1 --2- 10.20.193.104:0/3856583168 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fab9c109880 0x7fab9c19f730 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.723 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.692+0000 7faba47b9640 1 -- 10.20.193.104:0/3856583168 >> 10.20.193.104:0/3856583168 conn(0x7fab9c07ce10 msgr2=0x7fab9c107090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:39.723 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.692+0000 7faba47b9640 1 -- 10.20.193.104:0/3856583168 shutdown_connections 2026-02-17T20:56:39.723 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.692+0000 7faba47b9640 1 -- 10.20.193.104:0/3856583168 wait complete. 2026-02-17T20:56:39.922 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIImI2L+o0ji8Im7mc2JR6VgNQuU9fY1v/gM8drT4CXLP ceph-19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T20:56:39.923 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.807+0000 7f55ec0c4640 1 Processor -- start 2026-02-17T20:56:39.923 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.807+0000 7f55ec0c4640 1 -- start start 2026-02-17T20:56:39.923 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.807+0000 7f55ec0c4640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55e4109880 0x7f55e4109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:39.923 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.807+0000 7f55ec0c4640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f55e410a250 con 0x7f55e4109880 2026-02-17T20:56:39.923 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.807+0000 7f55e9e39640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55e4109880 0x7f55e4109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:39.923 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.807+0000 7f55e9e39640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55e4109880 0x7f55e4109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40590/0 (socket says 10.20.193.104:40590) 2026-02-17T20:56:39.923 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.807+0000 7f55e9e39640 1 -- 10.20.193.104:0/1353291131 learned_addr learned my addr 10.20.193.104:0/1353291131 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:39.923 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.807+0000 7f55e9e39640 1 -- 10.20.193.104:0/1353291131 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e410aa80 con 0x7f55e4109880 2026-02-17T20:56:39.924 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.808+0000 7f55e9e39640 1 --2- 10.20.193.104:0/1353291131 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55e4109880 0x7f55e4109c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009920 tx=0x7f55d402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46938aece6bebe80 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:39.924 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.808+0000 7f55e8e37640 1 -- 10.20.193.104:0/1353291131 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f55d403c070 con 0x7f55e4109880 2026-02-17T20:56:39.924 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.808+0000 7f55e8e37640 1 -- 10.20.193.104:0/1353291131 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f55d402fe00 con 0x7f55e4109880 2026-02-17T20:56:39.924 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.808+0000 7f55e8e37640 1 -- 10.20.193.104:0/1353291131 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f55d4035340 con 0x7f55e4109880 2026-02-17T20:56:39.924 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.808+0000 7f55ec0c4640 1 -- 10.20.193.104:0/1353291131 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55e4109880 msgr2=0x7f55e4109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:39.924 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.808+0000 7f55ec0c4640 1 --2- 10.20.193.104:0/1353291131 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55e4109880 0x7f55e4109c80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009920 tx=0x7f55d402ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:39.924 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.808+0000 7f55ec0c4640 1 -- 10.20.193.104:0/1353291131 shutdown_connections 2026-02-17T20:56:39.924 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.808+0000 7f55ec0c4640 1 --2- 10.20.193.104:0/1353291131 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55e4109880 0x7f55e4109c80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.924 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.808+0000 7f55ec0c4640 1 -- 10.20.193.104:0/1353291131 >> 10.20.193.104:0/1353291131 conn(0x7f55e407ce10 msgr2=0x7f55e407d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:39.924 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.808+0000 7f55ec0c4640 1 -- 10.20.193.104:0/1353291131 shutdown_connections 2026-02-17T20:56:39.924 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.808+0000 7f55ec0c4640 1 -- 10.20.193.104:0/1353291131 wait complete. 2026-02-17T20:56:39.925 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.808+0000 7f55ec0c4640 1 Processor -- start 2026-02-17T20:56:39.925 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.809+0000 7f55ec0c4640 1 -- start start 2026-02-17T20:56:39.925 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.809+0000 7f55ec0c4640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55e4109880 0x7f55e419f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:39.925 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.809+0000 7f55ec0c4640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f55e410dcb0 con 0x7f55e4109880 2026-02-17T20:56:39.925 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.809+0000 7f55e9e39640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55e4109880 0x7f55e419f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:39.925 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.809+0000 7f55e9e39640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55e4109880 0x7f55e419f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40598/0 (socket says 10.20.193.104:40598) 2026-02-17T20:56:39.925 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.809+0000 7f55e9e39640 1 -- 10.20.193.104:0/515539379 learned_addr learned my addr 10.20.193.104:0/515539379 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:39.925 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.809+0000 7f55e9e39640 1 -- 10.20.193.104:0/515539379 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e419fc70 con 0x7f55e4109880 2026-02-17T20:56:39.925 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.809+0000 7f55e9e39640 1 --2- 10.20.193.104:0/515539379 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55e4109880 0x7f55e419f730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f55d4002410 tx=0x7f55d4037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:39.925 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.809+0000 7f55d2ffd640 1 -- 10.20.193.104:0/515539379 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f55d4035970 con 0x7f55e4109880 2026-02-17T20:56:39.925 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.809+0000 7f55d2ffd640 1 -- 10.20.193.104:0/515539379 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f55d40423f0 con 0x7f55e4109880 2026-02-17T20:56:39.926 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.809+0000 7f55ec0c4640 1 -- 10.20.193.104:0/515539379 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e419ff00 con 0x7f55e4109880 2026-02-17T20:56:39.926 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.809+0000 7f55d2ffd640 1 -- 10.20.193.104:0/515539379 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f55d40413a0 con 0x7f55e4109880 2026-02-17T20:56:39.926 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.809+0000 7f55ec0c4640 1 -- 10.20.193.104:0/515539379 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e41a2bf0 con 0x7f55e4109880 2026-02-17T20:56:39.926 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.810+0000 7f55ec0c4640 1 -- 10.20.193.104:0/515539379 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e4109d00 con 0x7f55e4109880 2026-02-17T20:56:39.926 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.810+0000 7f55d2ffd640 1 -- 10.20.193.104:0/515539379 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 7) ==== 50155+0+0 (secure 0 0 0) 0x7f55d40428a0 con 0x7f55e4109880 2026-02-17T20:56:39.926 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.810+0000 7f55d2ffd640 1 --2- 10.20.193.104:0/515539379 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f55c003dad0 0x7f55c003ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:39.926 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.810+0000 7f55d2ffd640 1 -- 10.20.193.104:0/515539379 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f55d4076310 con 0x7f55e4109880 2026-02-17T20:56:39.926 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.810+0000 7f55e9638640 1 --2- 10.20.193.104:0/515539379 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f55c003dad0 0x7f55c003ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:39.926 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.810+0000 7f55e9638640 1 --2- 10.20.193.104:0/515539379 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f55c003dad0 0x7f55c003ff90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f55d80099c0 tx=0x7f55d8006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:39.927 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.812+0000 7f55d2ffd640 1 -- 10.20.193.104:0/515539379 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f55d403e200 con 0x7f55e4109880 2026-02-17T20:56:39.927 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.897+0000 7f55ec0c4640 1 -- 10.20.193.104:0/515539379 --> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f55e41077a0 con 0x7f55c003dad0 2026-02-17T20:56:39.927 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.897+0000 7f55d2ffd640 1 -- 10.20.193.104:0/515539379 <== mgr.14118 v2:10.20.193.104:6800/95322277 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+123 (secure 0 0 0) 0x7f55e41077a0 con 0x7f55c003dad0 2026-02-17T20:56:39.927 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.898+0000 7f55ec0c4640 1 -- 10.20.193.104:0/515539379 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f55c003dad0 msgr2=0x7f55c003ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:39.927 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.898+0000 7f55ec0c4640 1 --2- 10.20.193.104:0/515539379 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f55c003dad0 0x7f55c003ff90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f55d80099c0 tx=0x7f55d8006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.927 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.898+0000 7f55ec0c4640 1 -- 10.20.193.104:0/515539379 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55e4109880 msgr2=0x7f55e419f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:39.927 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.898+0000 7f55ec0c4640 1 --2- 10.20.193.104:0/515539379 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55e4109880 0x7f55e419f730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f55d4002410 tx=0x7f55d4037a50 comp rx=0 tx=0).stop 2026-02-17T20:56:39.927 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.898+0000 7f55ec0c4640 1 -- 10.20.193.104:0/515539379 shutdown_connections 2026-02-17T20:56:39.927 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.898+0000 7f55ec0c4640 1 --2- 10.20.193.104:0/515539379 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f55c003dad0 0x7f55c003ff90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.927 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.898+0000 7f55ec0c4640 1 --2- 10.20.193.104:0/515539379 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55e4109880 0x7f55e419f730 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:39.927 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.898+0000 7f55ec0c4640 1 -- 10.20.193.104:0/515539379 >> 10.20.193.104:0/515539379 conn(0x7f55e407ce10 msgr2=0x7f55e4107090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:39.928 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.898+0000 7f55ec0c4640 1 -- 10.20.193.104:0/515539379 shutdown_connections 2026-02-17T20:56:39.928 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:39.898+0000 7f55ec0c4640 1 -- 10.20.193.104:0/515539379 wait complete. 2026-02-17T20:56:39.928 INFO:teuthology.orchestra.run.trial104.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-17T20:56:39.928 INFO:teuthology.orchestra.run.trial104.stdout:Adding key to root@localhost authorized_keys... 2026-02-17T20:56:39.928 INFO:teuthology.orchestra.run.trial104.stdout:Adding host trial104... 2026-02-17T20:56:40.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:40 trial104 ceph-mon[20612]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-17T20:56:40.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:40 trial104 ceph-mon[20612]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-17T20:56:40.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:40 trial104 ceph-mon[20612]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:40.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:40 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:40.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:40 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:56:40.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:40 trial104 ceph-mon[20612]: [17/Feb/2026:20:56:39] ENGINE Bus STARTING 2026-02-17T20:56:40.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:40 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:56:40.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:40 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:40.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:40 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:41.624 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:41 trial104 ceph-mon[20612]: [17/Feb/2026:20:56:39] ENGINE Serving on http://10.20.193.104:8765 2026-02-17T20:56:41.624 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:41 trial104 ceph-mon[20612]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:41.625 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:41 trial104 ceph-mon[20612]: [17/Feb/2026:20:56:39] ENGINE Serving on https://10.20.193.104:7150 2026-02-17T20:56:41.625 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:41 trial104 ceph-mon[20612]: [17/Feb/2026:20:56:39] ENGINE Bus STARTED 2026-02-17T20:56:41.625 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:41 trial104 ceph-mon[20612]: [17/Feb/2026:20:56:39] ENGINE Client ('10.20.193.104', 54512) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-17T20:56:41.625 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:41 trial104 ceph-mon[20612]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:41.625 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:41 trial104 ceph-mon[20612]: Generating ssh key... 2026-02-17T20:56:41.625 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:41 trial104 ceph-mon[20612]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:41.625 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:41 trial104 ceph-mon[20612]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial104", "addr": "10.20.193.104", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:41.625 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:41 trial104 ceph-mon[20612]: mgrmap e8: trial104.irrhmt(active, since 2s) 2026-02-17T20:56:41.664 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout Added host 'trial104' with addr '10.20.193.104' 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.020+0000 7f897f3d9640 1 Processor -- start 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.020+0000 7f897f3d9640 1 -- start start 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.020+0000 7f897f3d9640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8978109880 0x7f8978109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.020+0000 7f897f3d9640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f897810a250 con 0x7f8978109880 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.020+0000 7f897d14e640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8978109880 0x7f8978109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.020+0000 7f897d14e640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8978109880 0x7f8978109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40612/0 (socket says 10.20.193.104:40612) 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.020+0000 7f897d14e640 1 -- 10.20.193.104:0/2663450181 learned_addr learned my addr 10.20.193.104:0/2663450181 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.020+0000 7f897d14e640 1 -- 10.20.193.104:0/2663450181 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897810aa80 con 0x7f8978109880 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.021+0000 7f897d14e640 1 --2- 10.20.193.104:0/2663450181 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8978109880 0x7f8978109c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8968009920 tx=0x7f896802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67cf13bcf8f71e5c server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.021+0000 7f8967fff640 1 -- 10.20.193.104:0/2663450181 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f896803c070 con 0x7f8978109880 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.021+0000 7f8967fff640 1 -- 10.20.193.104:0/2663450181 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f896802fe00 con 0x7f8978109880 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.021+0000 7f8967fff640 1 -- 10.20.193.104:0/2663450181 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f8968035340 con 0x7f8978109880 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.021+0000 7f897f3d9640 1 -- 10.20.193.104:0/2663450181 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8978109880 msgr2=0x7f8978109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.021+0000 7f897f3d9640 1 --2- 10.20.193.104:0/2663450181 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8978109880 0x7f8978109c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8968009920 tx=0x7f896802ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.021+0000 7f897f3d9640 1 -- 10.20.193.104:0/2663450181 shutdown_connections 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.021+0000 7f897f3d9640 1 --2- 10.20.193.104:0/2663450181 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8978109880 0x7f8978109c80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.021+0000 7f897f3d9640 1 -- 10.20.193.104:0/2663450181 >> 10.20.193.104:0/2663450181 conn(0x7f897807ce10 msgr2=0x7f897807d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.021+0000 7f897f3d9640 1 -- 10.20.193.104:0/2663450181 shutdown_connections 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.021+0000 7f897f3d9640 1 -- 10.20.193.104:0/2663450181 wait complete. 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.021+0000 7f897f3d9640 1 Processor -- start 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.021+0000 7f897f3d9640 1 -- start start 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.022+0000 7f897f3d9640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8978109880 0x7f897819f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.022+0000 7f897f3d9640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f897810dcb0 con 0x7f8978109880 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.022+0000 7f897d14e640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8978109880 0x7f897819f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.022+0000 7f897d14e640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8978109880 0x7f897819f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40628/0 (socket says 10.20.193.104:40628) 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.022+0000 7f897d14e640 1 -- 10.20.193.104:0/3931709141 learned_addr learned my addr 10.20.193.104:0/3931709141 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.022+0000 7f897d14e640 1 -- 10.20.193.104:0/3931709141 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897819fc70 con 0x7f8978109880 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.022+0000 7f897d14e640 1 --2- 10.20.193.104:0/3931709141 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8978109880 0x7f897819f730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8968002410 tx=0x7f8968037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.022+0000 7f89667fc640 1 -- 10.20.193.104:0/3931709141 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f8968035970 con 0x7f8978109880 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.022+0000 7f89667fc640 1 -- 10.20.193.104:0/3931709141 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f89680423f0 con 0x7f8978109880 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.022+0000 7f897f3d9640 1 -- 10.20.193.104:0/3931709141 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f897819ff00 con 0x7f8978109880 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.022+0000 7f89667fc640 1 -- 10.20.193.104:0/3931709141 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f89680413a0 con 0x7f8978109880 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.022+0000 7f897f3d9640 1 -- 10.20.193.104:0/3931709141 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89781a2bf0 con 0x7f8978109880 2026-02-17T20:56:41.666 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.022+0000 7f897f3d9640 1 -- 10.20.193.104:0/3931709141 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8978109d00 con 0x7f8978109880 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.023+0000 7f89667fc640 1 -- 10.20.193.104:0/3931709141 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 7) ==== 50155+0+0 (secure 0 0 0) 0x7f89680428a0 con 0x7f8978109880 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.023+0000 7f89667fc640 1 --2- 10.20.193.104:0/3931709141 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f895403da80 0x7f895403ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.023+0000 7f89667fc640 1 -- 10.20.193.104:0/3931709141 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8968076390 con 0x7f8978109880 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.023+0000 7f897c94d640 1 --2- 10.20.193.104:0/3931709141 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f895403da80 0x7f895403ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.023+0000 7f897c94d640 1 --2- 10.20.193.104:0/3931709141 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f895403da80 0x7f895403ff40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f896c0099c0 tx=0x7f896c006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.025+0000 7f89667fc640 1 -- 10.20.193.104:0/3931709141 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f896803ad80 con 0x7f8978109880 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.110+0000 7f897f3d9640 1 -- 10.20.193.104:0/3931709141 --> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "trial104", "addr": "10.20.193.104", "target": ["mon-mgr", ""]}) -- 0x7f89781077a0 con 0x7f895403da80 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:40.692+0000 7f89667fc640 1 -- 10.20.193.104:0/3931709141 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7f8968036c80 con 0x7f8978109880 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.623+0000 7f89667fc640 1 -- 10.20.193.104:0/3931709141 <== mgr.14118 v2:10.20.193.104:6800/95322277 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f89781077a0 con 0x7f895403da80 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.625+0000 7f897f3d9640 1 -- 10.20.193.104:0/3931709141 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f895403da80 msgr2=0x7f895403ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.625+0000 7f897f3d9640 1 --2- 10.20.193.104:0/3931709141 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f895403da80 0x7f895403ff40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f896c0099c0 tx=0x7f896c006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.625+0000 7f897f3d9640 1 -- 10.20.193.104:0/3931709141 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8978109880 msgr2=0x7f897819f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.625+0000 7f897f3d9640 1 --2- 10.20.193.104:0/3931709141 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8978109880 0x7f897819f730 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8968002410 tx=0x7f8968037a50 comp rx=0 tx=0).stop 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.625+0000 7f897f3d9640 1 -- 10.20.193.104:0/3931709141 shutdown_connections 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.625+0000 7f897f3d9640 1 --2- 10.20.193.104:0/3931709141 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f895403da80 0x7f895403ff40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.625+0000 7f897f3d9640 1 --2- 10.20.193.104:0/3931709141 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8978109880 0x7f897819f730 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.625+0000 7f897f3d9640 1 -- 10.20.193.104:0/3931709141 >> 10.20.193.104:0/3931709141 conn(0x7f897807ce10 msgr2=0x7f8978107090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.625+0000 7f897f3d9640 1 -- 10.20.193.104:0/3931709141 shutdown_connections 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.625+0000 7f897f3d9640 1 -- 10.20.193.104:0/3931709141 wait complete. 2026-02-17T20:56:41.667 INFO:teuthology.orchestra.run.trial104.stdout:Deploying mon service with default placement... 2026-02-17T20:56:41.890 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-17T20:56:41.891 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.772+0000 7f0b5988f640 1 Processor -- start 2026-02-17T20:56:41.891 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.772+0000 7f0b5988f640 1 -- start start 2026-02-17T20:56:41.891 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.772+0000 7f0b5988f640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0b54109880 0x7f0b54109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:41.891 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.772+0000 7f0b5988f640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5410a250 con 0x7f0b54109880 2026-02-17T20:56:41.891 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.772+0000 7f0b52ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0b54109880 0x7f0b54109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:41.891 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.772+0000 7f0b52ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0b54109880 0x7f0b54109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40640/0 (socket says 10.20.193.104:40640) 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.772+0000 7f0b52ffd640 1 -- 10.20.193.104:0/688579294 learned_addr learned my addr 10.20.193.104:0/688579294 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.772+0000 7f0b52ffd640 1 -- 10.20.193.104:0/688579294 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5410aa80 con 0x7f0b54109880 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.773+0000 7f0b52ffd640 1 --2- 10.20.193.104:0/688579294 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0b54109880 0x7f0b54109c80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009920 tx=0x7f0b4802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6af6ca493505da1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.773+0000 7f0b51ffb640 1 -- 10.20.193.104:0/688579294 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f0b4803c070 con 0x7f0b54109880 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.773+0000 7f0b51ffb640 1 -- 10.20.193.104:0/688579294 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f0b4802fe00 con 0x7f0b54109880 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.773+0000 7f0b51ffb640 1 -- 10.20.193.104:0/688579294 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f0b48035340 con 0x7f0b54109880 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.773+0000 7f0b5988f640 1 -- 10.20.193.104:0/688579294 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0b54109880 msgr2=0x7f0b54109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.773+0000 7f0b5988f640 1 --2- 10.20.193.104:0/688579294 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0b54109880 0x7f0b54109c80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009920 tx=0x7f0b4802ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.773+0000 7f0b5988f640 1 -- 10.20.193.104:0/688579294 shutdown_connections 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.773+0000 7f0b5988f640 1 --2- 10.20.193.104:0/688579294 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0b54109880 0x7f0b54109c80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.773+0000 7f0b5988f640 1 -- 10.20.193.104:0/688579294 >> 10.20.193.104:0/688579294 conn(0x7f0b5407ce10 msgr2=0x7f0b5407d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.773+0000 7f0b5988f640 1 -- 10.20.193.104:0/688579294 shutdown_connections 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.773+0000 7f0b5988f640 1 -- 10.20.193.104:0/688579294 wait complete. 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.774+0000 7f0b5988f640 1 Processor -- start 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.774+0000 7f0b5988f640 1 -- start start 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.774+0000 7f0b5988f640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0b54109880 0x7f0b5419f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.774+0000 7f0b5988f640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5410dcb0 con 0x7f0b54109880 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.774+0000 7f0b52ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0b54109880 0x7f0b5419f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.774+0000 7f0b52ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0b54109880 0x7f0b5419f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40650/0 (socket says 10.20.193.104:40650) 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.774+0000 7f0b52ffd640 1 -- 10.20.193.104:0/3696300397 learned_addr learned my addr 10.20.193.104:0/3696300397 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.774+0000 7f0b52ffd640 1 -- 10.20.193.104:0/3696300397 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b5419fc70 con 0x7f0b54109880 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.774+0000 7f0b52ffd640 1 --2- 10.20.193.104:0/3696300397 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0b54109880 0x7f0b5419f730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b48037b20 tx=0x7f0b480358c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.774+0000 7f0b5888d640 1 -- 10.20.193.104:0/3696300397 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f0b48035c10 con 0x7f0b54109880 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.774+0000 7f0b5988f640 1 -- 10.20.193.104:0/3696300397 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b5419ff00 con 0x7f0b54109880 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.774+0000 7f0b5888d640 1 -- 10.20.193.104:0/3696300397 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f0b48035db0 con 0x7f0b54109880 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.774+0000 7f0b5888d640 1 -- 10.20.193.104:0/3696300397 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f0b480413a0 con 0x7f0b54109880 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.774+0000 7f0b5988f640 1 -- 10.20.193.104:0/3696300397 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b541a2bf0 con 0x7f0b54109880 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.775+0000 7f0b5988f640 1 -- 10.20.193.104:0/3696300397 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b54109d00 con 0x7f0b54109880 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.775+0000 7f0b5888d640 1 -- 10.20.193.104:0/3696300397 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7f0b480423f0 con 0x7f0b54109880 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.775+0000 7f0b5888d640 1 --2- 10.20.193.104:0/3696300397 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f0b2803dba0 0x7f0b28040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.775+0000 7f0b5888d640 1 -- 10.20.193.104:0/3696300397 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0b480766f0 con 0x7f0b54109880 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.775+0000 7f0b527fc640 1 --2- 10.20.193.104:0/3696300397 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f0b2803dba0 0x7f0b28040060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.775+0000 7f0b527fc640 1 --2- 10.20.193.104:0/3696300397 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f0b2803dba0 0x7f0b28040060 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c0099c0 tx=0x7f0b3c006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.778+0000 7f0b5888d640 1 -- 10.20.193.104:0/3696300397 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0b4803ad80 con 0x7f0b54109880 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.865+0000 7f0b5988f640 1 -- 10.20.193.104:0/3696300397 --> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) -- 0x7f0b541077a0 con 0x7f0b2803dba0 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.869+0000 7f0b5888d640 1 -- 10.20.193.104:0/3696300397 <== mgr.14118 v2:10.20.193.104:6800/95322277 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f0b541077a0 con 0x7f0b2803dba0 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.870+0000 7f0b5988f640 1 -- 10.20.193.104:0/3696300397 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f0b2803dba0 msgr2=0x7f0b28040060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.870+0000 7f0b5988f640 1 --2- 10.20.193.104:0/3696300397 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f0b2803dba0 0x7f0b28040060 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c0099c0 tx=0x7f0b3c006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.870+0000 7f0b5988f640 1 -- 10.20.193.104:0/3696300397 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0b54109880 msgr2=0x7f0b5419f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.870+0000 7f0b5988f640 1 --2- 10.20.193.104:0/3696300397 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0b54109880 0x7f0b5419f730 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b48037b20 tx=0x7f0b480358c0 comp rx=0 tx=0).stop 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.870+0000 7f0b5988f640 1 -- 10.20.193.104:0/3696300397 shutdown_connections 2026-02-17T20:56:41.892 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.870+0000 7f0b5988f640 1 --2- 10.20.193.104:0/3696300397 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f0b2803dba0 0x7f0b28040060 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:41.893 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.870+0000 7f0b5988f640 1 --2- 10.20.193.104:0/3696300397 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0b54109880 0x7f0b5419f730 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:41.893 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.870+0000 7f0b5988f640 1 -- 10.20.193.104:0/3696300397 >> 10.20.193.104:0/3696300397 conn(0x7f0b5407ce10 msgr2=0x7f0b54107090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:41.893 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.870+0000 7f0b5988f640 1 -- 10.20.193.104:0/3696300397 shutdown_connections 2026-02-17T20:56:41.893 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.870+0000 7f0b5988f640 1 -- 10.20.193.104:0/3696300397 wait complete. 2026-02-17T20:56:41.893 INFO:teuthology.orchestra.run.trial104.stdout:Deploying mgr service with default placement... 2026-02-17T20:56:42.113 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-17T20:56:42.114 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.988+0000 7f0551fdf640 1 Processor -- start 2026-02-17T20:56:42.114 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.989+0000 7f0551fdf640 1 -- start start 2026-02-17T20:56:42.114 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.989+0000 7f0551fdf640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f054c109880 0x7f054c109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:42.114 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.989+0000 7f0551fdf640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f054c10a250 con 0x7f054c109880 2026-02-17T20:56:42.114 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.989+0000 7f054b7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f054c109880 0x7f054c109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:42.114 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.989+0000 7f054b7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f054c109880 0x7f054c109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40656/0 (socket says 10.20.193.104:40656) 2026-02-17T20:56:42.114 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.989+0000 7f054b7fe640 1 -- 10.20.193.104:0/2508289589 learned_addr learned my addr 10.20.193.104:0/2508289589 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:42.114 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.989+0000 7f054b7fe640 1 -- 10.20.193.104:0/2508289589 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c10aa80 con 0x7f054c109880 2026-02-17T20:56:42.114 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.989+0000 7f054b7fe640 1 --2- 10.20.193.104:0/2508289589 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f054c109880 0x7f054c109c80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0538009920 tx=0x7f053802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2eb473cbd94d28 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:42.115 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.989+0000 7f054a7fc640 1 -- 10.20.193.104:0/2508289589 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f053803c070 con 0x7f054c109880 2026-02-17T20:56:42.115 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.989+0000 7f054a7fc640 1 -- 10.20.193.104:0/2508289589 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f053802fe00 con 0x7f054c109880 2026-02-17T20:56:42.115 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.989+0000 7f054a7fc640 1 -- 10.20.193.104:0/2508289589 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f0538035340 con 0x7f054c109880 2026-02-17T20:56:42.115 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.990+0000 7f0551fdf640 1 -- 10.20.193.104:0/2508289589 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f054c109880 msgr2=0x7f054c109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:42.115 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.990+0000 7f0551fdf640 1 --2- 10.20.193.104:0/2508289589 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f054c109880 0x7f054c109c80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0538009920 tx=0x7f053802ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:42.115 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.990+0000 7f0551fdf640 1 -- 10.20.193.104:0/2508289589 shutdown_connections 2026-02-17T20:56:42.115 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.990+0000 7f0551fdf640 1 --2- 10.20.193.104:0/2508289589 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f054c109880 0x7f054c109c80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.115 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.990+0000 7f0551fdf640 1 -- 10.20.193.104:0/2508289589 >> 10.20.193.104:0/2508289589 conn(0x7f054c07cf00 msgr2=0x7f054c07d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:42.115 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.990+0000 7f0551fdf640 1 -- 10.20.193.104:0/2508289589 shutdown_connections 2026-02-17T20:56:42.115 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.990+0000 7f0551fdf640 1 -- 10.20.193.104:0/2508289589 wait complete. 2026-02-17T20:56:42.116 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.990+0000 7f0551fdf640 1 Processor -- start 2026-02-17T20:56:42.116 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.990+0000 7f0551fdf640 1 -- start start 2026-02-17T20:56:42.116 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.990+0000 7f0551fdf640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f054c109880 0x7f054c19f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:42.116 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.990+0000 7f0551fdf640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f054c10dcb0 con 0x7f054c109880 2026-02-17T20:56:42.116 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.990+0000 7f054b7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f054c109880 0x7f054c19f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:42.116 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.990+0000 7f054b7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f054c109880 0x7f054c19f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40668/0 (socket says 10.20.193.104:40668) 2026-02-17T20:56:42.116 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.990+0000 7f054b7fe640 1 -- 10.20.193.104:0/1071034397 learned_addr learned my addr 10.20.193.104:0/1071034397 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:42.116 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.990+0000 7f054b7fe640 1 -- 10.20.193.104:0/1071034397 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c19fcd0 con 0x7f054c109880 2026-02-17T20:56:42.116 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.991+0000 7f054b7fe640 1 --2- 10.20.193.104:0/1071034397 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f054c109880 0x7f054c19f790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0538002410 tx=0x7f0538037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:42.116 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.991+0000 7f0548ff9640 1 -- 10.20.193.104:0/1071034397 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f0538035970 con 0x7f054c109880 2026-02-17T20:56:42.116 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.991+0000 7f0548ff9640 1 -- 10.20.193.104:0/1071034397 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1007+0+0 (secure 0 0 0) 0x7f05380423f0 con 0x7f054c109880 2026-02-17T20:56:42.116 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.991+0000 7f0551fdf640 1 -- 10.20.193.104:0/1071034397 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054c19ff60 con 0x7f054c109880 2026-02-17T20:56:42.117 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.991+0000 7f0548ff9640 1 -- 10.20.193.104:0/1071034397 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f05380413a0 con 0x7f054c109880 2026-02-17T20:56:42.117 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.991+0000 7f0551fdf640 1 -- 10.20.193.104:0/1071034397 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054c1a2c50 con 0x7f054c109880 2026-02-17T20:56:42.117 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.991+0000 7f0551fdf640 1 -- 10.20.193.104:0/1071034397 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f054c109d00 con 0x7f054c109880 2026-02-17T20:56:42.117 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.991+0000 7f0548ff9640 1 -- 10.20.193.104:0/1071034397 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7f05380415d0 con 0x7f054c109880 2026-02-17T20:56:42.117 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.991+0000 7f0548ff9640 1 --2- 10.20.193.104:0/1071034397 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f052003dbf0 0x7f05200400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:42.117 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.991+0000 7f0548ff9640 1 -- 10.20.193.104:0/1071034397 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0538076670 con 0x7f054c109880 2026-02-17T20:56:42.117 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.992+0000 7f054affd640 1 --2- 10.20.193.104:0/1071034397 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f052003dbf0 0x7f05200400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:42.117 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.992+0000 7f054affd640 1 --2- 10.20.193.104:0/1071034397 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f052003dbf0 0x7f05200400b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f053c0099c0 tx=0x7f053c006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:42.117 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:41.994+0000 7f0548ff9640 1 -- 10.20.193.104:0/1071034397 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0538075fc0 con 0x7f054c109880 2026-02-17T20:56:42.117 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.083+0000 7f0551fdf640 1 -- 10.20.193.104:0/1071034397 --> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) -- 0x7f054c1077b0 con 0x7f052003dbf0 2026-02-17T20:56:42.117 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.086+0000 7f0548ff9640 1 -- 10.20.193.104:0/1071034397 <== mgr.14118 v2:10.20.193.104:6800/95322277 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f054c1077b0 con 0x7f052003dbf0 2026-02-17T20:56:42.118 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.088+0000 7f0551fdf640 1 -- 10.20.193.104:0/1071034397 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f052003dbf0 msgr2=0x7f05200400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:42.118 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.088+0000 7f0551fdf640 1 --2- 10.20.193.104:0/1071034397 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f052003dbf0 0x7f05200400b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f053c0099c0 tx=0x7f053c006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.118 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.088+0000 7f0551fdf640 1 -- 10.20.193.104:0/1071034397 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f054c109880 msgr2=0x7f054c19f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:42.118 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.088+0000 7f0551fdf640 1 --2- 10.20.193.104:0/1071034397 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f054c109880 0x7f054c19f790 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0538002410 tx=0x7f0538037a50 comp rx=0 tx=0).stop 2026-02-17T20:56:42.118 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.088+0000 7f0551fdf640 1 -- 10.20.193.104:0/1071034397 shutdown_connections 2026-02-17T20:56:42.118 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.088+0000 7f0551fdf640 1 --2- 10.20.193.104:0/1071034397 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f052003dbf0 0x7f05200400b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.118 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.088+0000 7f0551fdf640 1 --2- 10.20.193.104:0/1071034397 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f054c109880 0x7f054c19f790 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.118 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.088+0000 7f0551fdf640 1 -- 10.20.193.104:0/1071034397 >> 10.20.193.104:0/1071034397 conn(0x7f054c07cf00 msgr2=0x7f054c1070a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:42.118 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.088+0000 7f0551fdf640 1 -- 10.20.193.104:0/1071034397 shutdown_connections 2026-02-17T20:56:42.118 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.088+0000 7f0551fdf640 1 -- 10.20.193.104:0/1071034397 wait complete. 2026-02-17T20:56:42.118 INFO:teuthology.orchestra.run.trial104.stdout:Deploying crash service with default placement... 2026-02-17T20:56:42.331 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2026-02-17T20:56:42.331 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.206+0000 7fa8133ec640 1 Processor -- start 2026-02-17T20:56:42.331 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.206+0000 7fa8133ec640 1 -- start start 2026-02-17T20:56:42.331 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.206+0000 7fa8133ec640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa80c07d770 0x7fa80c07bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:42.331 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.206+0000 7fa8133ec640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa80c07c110 con 0x7fa80c07d770 2026-02-17T20:56:42.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.207+0000 7fa811161640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa80c07d770 0x7fa80c07bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:42.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.207+0000 7fa811161640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa80c07d770 0x7fa80c07bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40678/0 (socket says 10.20.193.104:40678) 2026-02-17T20:56:42.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.207+0000 7fa811161640 1 -- 10.20.193.104:0/961844615 learned_addr learned my addr 10.20.193.104:0/961844615 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:42.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.207+0000 7fa811161640 1 -- 10.20.193.104:0/961844615 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa80c07c290 con 0x7fa80c07d770 2026-02-17T20:56:42.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.207+0000 7fa811161640 1 --2- 10.20.193.104:0/961844615 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa80c07d770 0x7fa80c07bbd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009920 tx=0x7fa7fc02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9938e5aa68282da server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:42.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.207+0000 7fa7fbfff640 1 -- 10.20.193.104:0/961844615 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa7fc03c070 con 0x7fa80c07d770 2026-02-17T20:56:42.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.207+0000 7fa7fbfff640 1 -- 10.20.193.104:0/961844615 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fa7fc02fe20 con 0x7fa80c07d770 2026-02-17T20:56:42.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.207+0000 7fa7fbfff640 1 -- 10.20.193.104:0/961844615 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa7fc035340 con 0x7fa80c07d770 2026-02-17T20:56:42.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.208+0000 7fa8133ec640 1 -- 10.20.193.104:0/961844615 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa80c07d770 msgr2=0x7fa80c07bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:42.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.208+0000 7fa8133ec640 1 --2- 10.20.193.104:0/961844615 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa80c07d770 0x7fa80c07bbd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc009920 tx=0x7fa7fc02ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:42.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.208+0000 7fa8133ec640 1 -- 10.20.193.104:0/961844615 shutdown_connections 2026-02-17T20:56:42.332 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.208+0000 7fa8133ec640 1 --2- 10.20.193.104:0/961844615 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa80c07d770 0x7fa80c07bbd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.208+0000 7fa8133ec640 1 -- 10.20.193.104:0/961844615 >> 10.20.193.104:0/961844615 conn(0x7fa80c102d80 msgr2=0x7fa80c1051a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:42.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.208+0000 7fa8133ec640 1 -- 10.20.193.104:0/961844615 shutdown_connections 2026-02-17T20:56:42.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.208+0000 7fa8133ec640 1 -- 10.20.193.104:0/961844615 wait complete. 2026-02-17T20:56:42.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.208+0000 7fa8133ec640 1 Processor -- start 2026-02-17T20:56:42.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.208+0000 7fa8133ec640 1 -- start start 2026-02-17T20:56:42.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.208+0000 7fa8133ec640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa80c07d770 0x7fa80c19f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:42.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.208+0000 7fa8133ec640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa80c10db70 con 0x7fa80c07d770 2026-02-17T20:56:42.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.208+0000 7fa811161640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa80c07d770 0x7fa80c19f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:42.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.208+0000 7fa811161640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa80c07d770 0x7fa80c19f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40684/0 (socket says 10.20.193.104:40684) 2026-02-17T20:56:42.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.208+0000 7fa811161640 1 -- 10.20.193.104:0/1519177276 learned_addr learned my addr 10.20.193.104:0/1519177276 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:42.333 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.208+0000 7fa811161640 1 -- 10.20.193.104:0/1519177276 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa80c19fc10 con 0x7fa80c07d770 2026-02-17T20:56:42.334 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.208+0000 7fa811161640 1 --2- 10.20.193.104:0/1519177276 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa80c07d770 0x7fa80c19f6d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc0091b0 tx=0x7fa7fc037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:42.334 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.208+0000 7fa7fa7fc640 1 -- 10.20.193.104:0/1519177276 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa7fc0359a0 con 0x7fa80c07d770 2026-02-17T20:56:42.334 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.209+0000 7fa8133ec640 1 -- 10.20.193.104:0/1519177276 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa80c19fea0 con 0x7fa80c07d770 2026-02-17T20:56:42.334 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.209+0000 7fa8133ec640 1 -- 10.20.193.104:0/1519177276 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa80c1a2b90 con 0x7fa80c07d770 2026-02-17T20:56:42.334 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.209+0000 7fa7fa7fc640 1 -- 10.20.193.104:0/1519177276 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fa7fc043430 con 0x7fa80c07d770 2026-02-17T20:56:42.334 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.209+0000 7fa7fa7fc640 1 -- 10.20.193.104:0/1519177276 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa7fc042590 con 0x7fa80c07d770 2026-02-17T20:56:42.334 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.209+0000 7fa8133ec640 1 -- 10.20.193.104:0/1519177276 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa80c07bc50 con 0x7fa80c07d770 2026-02-17T20:56:42.334 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.209+0000 7fa7fa7fc640 1 -- 10.20.193.104:0/1519177276 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7fa7fc035b40 con 0x7fa80c07d770 2026-02-17T20:56:42.334 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.209+0000 7fa7fa7fc640 1 --2- 10.20.193.104:0/1519177276 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fa7e803dbf0 0x7fa7e80400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:42.334 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.209+0000 7fa7fa7fc640 1 -- 10.20.193.104:0/1519177276 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa7fc076400 con 0x7fa80c07d770 2026-02-17T20:56:42.334 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.209+0000 7fa810960640 1 --2- 10.20.193.104:0/1519177276 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fa7e803dbf0 0x7fa7e80400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:42.334 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.210+0000 7fa810960640 1 --2- 10.20.193.104:0/1519177276 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fa7e803dbf0 0x7fa7e80400b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa8000099c0 tx=0x7fa800006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:42.335 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.212+0000 7fa7fa7fc640 1 -- 10.20.193.104:0/1519177276 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa7fc076160 con 0x7fa80c07d770 2026-02-17T20:56:42.335 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.300+0000 7fa8133ec640 1 -- 10.20.193.104:0/1519177276 --> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) -- 0x7fa80c104070 con 0x7fa7e803dbf0 2026-02-17T20:56:42.335 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.303+0000 7fa7fa7fc640 1 -- 10.20.193.104:0/1519177276 <== mgr.14118 v2:10.20.193.104:6800/95322277 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fa80c104070 con 0x7fa7e803dbf0 2026-02-17T20:56:42.335 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.305+0000 7fa8133ec640 1 -- 10.20.193.104:0/1519177276 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fa7e803dbf0 msgr2=0x7fa7e80400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:42.335 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.305+0000 7fa8133ec640 1 --2- 10.20.193.104:0/1519177276 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fa7e803dbf0 0x7fa7e80400b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa8000099c0 tx=0x7fa800006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.335 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.305+0000 7fa8133ec640 1 -- 10.20.193.104:0/1519177276 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa80c07d770 msgr2=0x7fa80c19f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:42.335 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.305+0000 7fa8133ec640 1 --2- 10.20.193.104:0/1519177276 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa80c07d770 0x7fa80c19f6d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa7fc0091b0 tx=0x7fa7fc037a50 comp rx=0 tx=0).stop 2026-02-17T20:56:42.335 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.305+0000 7fa8133ec640 1 -- 10.20.193.104:0/1519177276 shutdown_connections 2026-02-17T20:56:42.335 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.305+0000 7fa8133ec640 1 --2- 10.20.193.104:0/1519177276 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fa7e803dbf0 0x7fa7e80400b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.335 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.305+0000 7fa8133ec640 1 --2- 10.20.193.104:0/1519177276 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa80c07d770 0x7fa80c19f6d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.336 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.305+0000 7fa8133ec640 1 -- 10.20.193.104:0/1519177276 >> 10.20.193.104:0/1519177276 conn(0x7fa80c102d80 msgr2=0x7fa80c103960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:42.336 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.305+0000 7fa8133ec640 1 -- 10.20.193.104:0/1519177276 shutdown_connections 2026-02-17T20:56:42.336 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.305+0000 7fa8133ec640 1 -- 10.20.193.104:0/1519177276 wait complete. 2026-02-17T20:56:42.336 INFO:teuthology.orchestra.run.trial104.stdout:Deploying ceph-exporter service with default placement... 2026-02-17T20:56:42.381 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:42 trial104 ceph-mon[20612]: Deploying cephadm binary to trial104 2026-02-17T20:56:42.381 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:42 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:42.381 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:42 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:56:42.382 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:42 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:42.382 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:42 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:42.382 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:42 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:42.561 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2026-02-17T20:56:42.561 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.431+0000 7f2ffa9b3640 1 Processor -- start 2026-02-17T20:56:42.561 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.431+0000 7f2ffa9b3640 1 -- start start 2026-02-17T20:56:42.561 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.431+0000 7f2ffa9b3640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2ff4109690 0x7f2ff4109a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:42.562 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.431+0000 7f2ffa9b3640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff410a060 con 0x7f2ff4109690 2026-02-17T20:56:42.562 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.431+0000 7f2ff99b1640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2ff4109690 0x7f2ff4109a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:42.562 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.431+0000 7f2ff99b1640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2ff4109690 0x7f2ff4109a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40696/0 (socket says 10.20.193.104:40696) 2026-02-17T20:56:42.562 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.431+0000 7f2ff99b1640 1 -- 10.20.193.104:0/2383114839 learned_addr learned my addr 10.20.193.104:0/2383114839 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:42.562 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.431+0000 7f2ff99b1640 1 -- 10.20.193.104:0/2383114839 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff410a890 con 0x7f2ff4109690 2026-02-17T20:56:42.562 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.432+0000 7f2ff99b1640 1 --2- 10.20.193.104:0/2383114839 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2ff4109690 0x7f2ff4109a90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009920 tx=0x7f2fe402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de703013b5406b server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:42.562 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.432+0000 7f2ff89af640 1 -- 10.20.193.104:0/2383114839 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f2fe403c070 con 0x7f2ff4109690 2026-02-17T20:56:42.562 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.432+0000 7f2ff89af640 1 -- 10.20.193.104:0/2383114839 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f2fe402fe20 con 0x7f2ff4109690 2026-02-17T20:56:42.562 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.432+0000 7f2ff89af640 1 -- 10.20.193.104:0/2383114839 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f2fe4035340 con 0x7f2ff4109690 2026-02-17T20:56:42.562 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.432+0000 7f2ffa9b3640 1 -- 10.20.193.104:0/2383114839 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2ff4109690 msgr2=0x7f2ff4109a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:42.562 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.432+0000 7f2ffa9b3640 1 --2- 10.20.193.104:0/2383114839 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2ff4109690 0x7f2ff4109a90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009920 tx=0x7f2fe402ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:42.563 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.432+0000 7f2ffa9b3640 1 -- 10.20.193.104:0/2383114839 shutdown_connections 2026-02-17T20:56:42.563 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.432+0000 7f2ffa9b3640 1 --2- 10.20.193.104:0/2383114839 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2ff4109690 0x7f2ff4109a90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.563 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.432+0000 7f2ffa9b3640 1 -- 10.20.193.104:0/2383114839 >> 10.20.193.104:0/2383114839 conn(0x7f2ff407cc40 msgr2=0x7f2ff407d050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:42.563 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.432+0000 7f2ffa9b3640 1 -- 10.20.193.104:0/2383114839 shutdown_connections 2026-02-17T20:56:42.563 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.432+0000 7f2ffa9b3640 1 -- 10.20.193.104:0/2383114839 wait complete. 2026-02-17T20:56:42.563 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.433+0000 7f2ffa9b3640 1 Processor -- start 2026-02-17T20:56:42.563 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.433+0000 7f2ffa9b3640 1 -- start start 2026-02-17T20:56:42.563 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.433+0000 7f2ffa9b3640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2ff4109690 0x7f2ff419f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:42.563 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.433+0000 7f2ffa9b3640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff410dac0 con 0x7f2ff4109690 2026-02-17T20:56:42.563 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.433+0000 7f2ff99b1640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2ff4109690 0x7f2ff419f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:42.563 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.433+0000 7f2ff99b1640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2ff4109690 0x7f2ff419f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40706/0 (socket says 10.20.193.104:40706) 2026-02-17T20:56:42.563 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.433+0000 7f2ff99b1640 1 -- 10.20.193.104:0/3137736645 learned_addr learned my addr 10.20.193.104:0/3137736645 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:42.564 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.433+0000 7f2ff99b1640 1 -- 10.20.193.104:0/3137736645 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff419fab0 con 0x7f2ff4109690 2026-02-17T20:56:42.564 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.433+0000 7f2ff99b1640 1 --2- 10.20.193.104:0/3137736645 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2ff4109690 0x7f2ff419f570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4002410 tx=0x7f2fe40379e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:42.564 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.433+0000 7f2fe2ffd640 1 -- 10.20.193.104:0/3137736645 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f2fe40358d0 con 0x7f2ff4109690 2026-02-17T20:56:42.564 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.433+0000 7f2fe2ffd640 1 -- 10.20.193.104:0/3137736645 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f2fe4043430 con 0x7f2ff4109690 2026-02-17T20:56:42.564 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.433+0000 7f2ffa9b3640 1 -- 10.20.193.104:0/3137736645 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff419fd40 con 0x7f2ff4109690 2026-02-17T20:56:42.564 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.433+0000 7f2fe2ffd640 1 -- 10.20.193.104:0/3137736645 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f2fe40423e0 con 0x7f2ff4109690 2026-02-17T20:56:42.564 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.433+0000 7f2ffa9b3640 1 -- 10.20.193.104:0/3137736645 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff41a2a30 con 0x7f2ff4109690 2026-02-17T20:56:42.564 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.434+0000 7f2ffa9b3640 1 -- 10.20.193.104:0/3137736645 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ff4109b10 con 0x7f2ff4109690 2026-02-17T20:56:42.564 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.434+0000 7f2fe2ffd640 1 -- 10.20.193.104:0/3137736645 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7f2fe4043990 con 0x7f2ff4109690 2026-02-17T20:56:42.564 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.434+0000 7f2fe2ffd640 1 --2- 10.20.193.104:0/3137736645 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f2fd003dba0 0x7f2fd0040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:42.564 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.434+0000 7f2fe2ffd640 1 -- 10.20.193.104:0/3137736645 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2fe4076330 con 0x7f2ff4109690 2026-02-17T20:56:42.564 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.434+0000 7f2ff91b0640 1 --2- 10.20.193.104:0/3137736645 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f2fd003dba0 0x7f2fd0040060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:42.565 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.434+0000 7f2ff91b0640 1 --2- 10.20.193.104:0/3137736645 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f2fd003dba0 0x7f2fd0040060 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80099c0 tx=0x7f2fe8006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:42.565 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.438+0000 7f2fe2ffd640 1 -- 10.20.193.104:0/3137736645 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2fe4033200 con 0x7f2ff4109690 2026-02-17T20:56:42.565 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.529+0000 7f2ffa9b3640 1 -- 10.20.193.104:0/3137736645 --> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) -- 0x7f2ff4107820 con 0x7f2fd003dba0 2026-02-17T20:56:42.565 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.532+0000 7f2fe2ffd640 1 -- 10.20.193.104:0/3137736645 <== mgr.14118 v2:10.20.193.104:6800/95322277 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+34 (secure 0 0 0) 0x7f2ff4107820 con 0x7f2fd003dba0 2026-02-17T20:56:42.565 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.534+0000 7f2ffa9b3640 1 -- 10.20.193.104:0/3137736645 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f2fd003dba0 msgr2=0x7f2fd0040060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:42.565 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.534+0000 7f2ffa9b3640 1 --2- 10.20.193.104:0/3137736645 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f2fd003dba0 0x7f2fd0040060 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2fe80099c0 tx=0x7f2fe8006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.565 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.534+0000 7f2ffa9b3640 1 -- 10.20.193.104:0/3137736645 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2ff4109690 msgr2=0x7f2ff419f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:42.565 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.534+0000 7f2ffa9b3640 1 --2- 10.20.193.104:0/3137736645 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2ff4109690 0x7f2ff419f570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4002410 tx=0x7f2fe40379e0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.565 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.534+0000 7f2ffa9b3640 1 -- 10.20.193.104:0/3137736645 shutdown_connections 2026-02-17T20:56:42.565 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.534+0000 7f2ffa9b3640 1 --2- 10.20.193.104:0/3137736645 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f2fd003dba0 0x7f2fd0040060 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.565 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.534+0000 7f2ffa9b3640 1 --2- 10.20.193.104:0/3137736645 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2ff4109690 0x7f2ff419f570 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.565 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.534+0000 7f2ffa9b3640 1 -- 10.20.193.104:0/3137736645 >> 10.20.193.104:0/3137736645 conn(0x7f2ff407cc40 msgr2=0x7f2ff4107110 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:42.566 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.534+0000 7f2ffa9b3640 1 -- 10.20.193.104:0/3137736645 shutdown_connections 2026-02-17T20:56:42.566 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.534+0000 7f2ffa9b3640 1 -- 10.20.193.104:0/3137736645 wait complete. 2026-02-17T20:56:42.566 INFO:teuthology.orchestra.run.trial104.stdout:Deploying prometheus service with default placement... 2026-02-17T20:56:42.816 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2026-02-17T20:56:42.816 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.661+0000 7f07d3591640 1 Processor -- start 2026-02-17T20:56:42.816 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.661+0000 7f07d3591640 1 -- start start 2026-02-17T20:56:42.816 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.661+0000 7f07d3591640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07cc109880 0x7f07cc109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:42.816 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.661+0000 7f07d3591640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc10a250 con 0x7f07cc109880 2026-02-17T20:56:42.816 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.662+0000 7f07d1306640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07cc109880 0x7f07cc109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:42.816 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.662+0000 7f07d1306640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07cc109880 0x7f07cc109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40712/0 (socket says 10.20.193.104:40712) 2026-02-17T20:56:42.816 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.662+0000 7f07d1306640 1 -- 10.20.193.104:0/3111338783 learned_addr learned my addr 10.20.193.104:0/3111338783 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:42.817 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.662+0000 7f07d1306640 1 -- 10.20.193.104:0/3111338783 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07cc10aa80 con 0x7f07cc109880 2026-02-17T20:56:42.817 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.662+0000 7f07d1306640 1 --2- 10.20.193.104:0/3111338783 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07cc109880 0x7f07cc109c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009920 tx=0x7f07bc02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e913e2ab8cc1094a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:42.817 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.662+0000 7f07bbfff640 1 -- 10.20.193.104:0/3111338783 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f07bc03c070 con 0x7f07cc109880 2026-02-17T20:56:42.817 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.662+0000 7f07bbfff640 1 -- 10.20.193.104:0/3111338783 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f07bc02fe20 con 0x7f07cc109880 2026-02-17T20:56:42.817 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.662+0000 7f07bbfff640 1 -- 10.20.193.104:0/3111338783 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f07bc035340 con 0x7f07cc109880 2026-02-17T20:56:42.817 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.663+0000 7f07d3591640 1 -- 10.20.193.104:0/3111338783 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07cc109880 msgr2=0x7f07cc109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:42.817 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.663+0000 7f07d3591640 1 --2- 10.20.193.104:0/3111338783 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07cc109880 0x7f07cc109c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009920 tx=0x7f07bc02ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:42.817 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.663+0000 7f07d3591640 1 -- 10.20.193.104:0/3111338783 shutdown_connections 2026-02-17T20:56:42.817 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.663+0000 7f07d3591640 1 --2- 10.20.193.104:0/3111338783 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07cc109880 0x7f07cc109c80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.817 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.663+0000 7f07d3591640 1 -- 10.20.193.104:0/3111338783 >> 10.20.193.104:0/3111338783 conn(0x7f07cc07ce10 msgr2=0x7f07cc07d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:42.818 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.663+0000 7f07d3591640 1 -- 10.20.193.104:0/3111338783 shutdown_connections 2026-02-17T20:56:42.818 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.663+0000 7f07d3591640 1 -- 10.20.193.104:0/3111338783 wait complete. 2026-02-17T20:56:42.818 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.663+0000 7f07d3591640 1 Processor -- start 2026-02-17T20:56:42.818 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.663+0000 7f07d3591640 1 -- start start 2026-02-17T20:56:42.818 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.663+0000 7f07d3591640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07cc109880 0x7f07cc19f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:42.818 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.663+0000 7f07d3591640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc10dcb0 con 0x7f07cc109880 2026-02-17T20:56:42.818 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.663+0000 7f07d1306640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07cc109880 0x7f07cc19f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:42.818 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.663+0000 7f07d1306640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07cc109880 0x7f07cc19f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40722/0 (socket says 10.20.193.104:40722) 2026-02-17T20:56:42.818 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.663+0000 7f07d1306640 1 -- 10.20.193.104:0/161935144 learned_addr learned my addr 10.20.193.104:0/161935144 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:42.818 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.664+0000 7f07d1306640 1 -- 10.20.193.104:0/161935144 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07cc19fc40 con 0x7f07cc109880 2026-02-17T20:56:42.818 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.664+0000 7f07d1306640 1 --2- 10.20.193.104:0/161935144 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07cc109880 0x7f07cc19f700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f07bc002410 tx=0x7f07bc0379e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:42.818 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.664+0000 7f07ba7fc640 1 -- 10.20.193.104:0/161935144 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f07bc0358d0 con 0x7f07cc109880 2026-02-17T20:56:42.818 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.664+0000 7f07d3591640 1 -- 10.20.193.104:0/161935144 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07cc19fed0 con 0x7f07cc109880 2026-02-17T20:56:42.819 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.664+0000 7f07ba7fc640 1 -- 10.20.193.104:0/161935144 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f07bc043430 con 0x7f07cc109880 2026-02-17T20:56:42.819 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.664+0000 7f07ba7fc640 1 -- 10.20.193.104:0/161935144 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f07bc0423e0 con 0x7f07cc109880 2026-02-17T20:56:42.819 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.664+0000 7f07d3591640 1 -- 10.20.193.104:0/161935144 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07cc1a2bc0 con 0x7f07cc109880 2026-02-17T20:56:42.819 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.664+0000 7f07d3591640 1 -- 10.20.193.104:0/161935144 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07cc109d00 con 0x7f07cc109880 2026-02-17T20:56:42.819 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.666+0000 7f07ba7fc640 1 -- 10.20.193.104:0/161935144 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7f07bc054080 con 0x7f07cc109880 2026-02-17T20:56:42.819 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.666+0000 7f07ba7fc640 1 --2- 10.20.193.104:0/161935144 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f07a803dbf0 0x7f07a80400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:42.819 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.666+0000 7f07ba7fc640 1 -- 10.20.193.104:0/161935144 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f07bc0767d0 con 0x7f07cc109880 2026-02-17T20:56:42.819 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.666+0000 7f07d0b05640 1 --2- 10.20.193.104:0/161935144 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f07a803dbf0 0x7f07a80400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:42.819 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.666+0000 7f07d0b05640 1 --2- 10.20.193.104:0/161935144 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f07a803dbf0 0x7f07a80400b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f07c00099c0 tx=0x7f07c0006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:42.819 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.668+0000 7f07ba7fc640 1 -- 10.20.193.104:0/161935144 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f07bc0363a0 con 0x7f07cc109880 2026-02-17T20:56:42.819 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.761+0000 7f07d3591640 1 -- 10.20.193.104:0/161935144 --> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) -- 0x7f07cc1076e0 con 0x7f07a803dbf0 2026-02-17T20:56:42.820 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.764+0000 7f07ba7fc640 1 -- 10.20.193.104:0/161935144 <== mgr.14118 v2:10.20.193.104:6800/95322277 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+31 (secure 0 0 0) 0x7f07cc1076e0 con 0x7f07a803dbf0 2026-02-17T20:56:42.820 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.766+0000 7f07d3591640 1 -- 10.20.193.104:0/161935144 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f07a803dbf0 msgr2=0x7f07a80400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:42.820 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.766+0000 7f07d3591640 1 --2- 10.20.193.104:0/161935144 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f07a803dbf0 0x7f07a80400b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f07c00099c0 tx=0x7f07c0006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.820 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.766+0000 7f07d3591640 1 -- 10.20.193.104:0/161935144 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07cc109880 msgr2=0x7f07cc19f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:42.820 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.766+0000 7f07d3591640 1 --2- 10.20.193.104:0/161935144 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07cc109880 0x7f07cc19f700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f07bc002410 tx=0x7f07bc0379e0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.820 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.766+0000 7f07d3591640 1 -- 10.20.193.104:0/161935144 shutdown_connections 2026-02-17T20:56:42.820 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.766+0000 7f07d3591640 1 --2- 10.20.193.104:0/161935144 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f07a803dbf0 0x7f07a80400b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.820 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.766+0000 7f07d3591640 1 --2- 10.20.193.104:0/161935144 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f07cc109880 0x7f07cc19f700 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:42.820 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.766+0000 7f07d3591640 1 -- 10.20.193.104:0/161935144 >> 10.20.193.104:0/161935144 conn(0x7f07cc07ce10 msgr2=0x7f07cc106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:42.820 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.766+0000 7f07d3591640 1 -- 10.20.193.104:0/161935144 shutdown_connections 2026-02-17T20:56:42.820 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.766+0000 7f07d3591640 1 -- 10.20.193.104:0/161935144 wait complete. 2026-02-17T20:56:42.820 INFO:teuthology.orchestra.run.trial104.stdout:Deploying grafana service with default placement... 2026-02-17T20:56:43.034 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2026-02-17T20:56:43.035 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.908+0000 7fbf1cc65640 1 Processor -- start 2026-02-17T20:56:43.035 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.908+0000 7fbf1cc65640 1 -- start start 2026-02-17T20:56:43.035 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.908+0000 7fbf1cc65640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fbf18109880 0x7fbf18109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:43.035 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.908+0000 7fbf1cc65640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1810a250 con 0x7fbf18109880 2026-02-17T20:56:43.035 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.908+0000 7fbf16575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fbf18109880 0x7fbf18109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:43.035 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.908+0000 7fbf16575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fbf18109880 0x7fbf18109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40730/0 (socket says 10.20.193.104:40730) 2026-02-17T20:56:43.035 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.908+0000 7fbf16575640 1 -- 10.20.193.104:0/3808526145 learned_addr learned my addr 10.20.193.104:0/3808526145 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:43.035 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.908+0000 7fbf16575640 1 -- 10.20.193.104:0/3808526145 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1810aa80 con 0x7fbf18109880 2026-02-17T20:56:43.036 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.909+0000 7fbf16575640 1 --2- 10.20.193.104:0/3808526145 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fbf18109880 0x7fbf18109c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c009920 tx=0x7fbf0c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be355e884acffd41 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:43.036 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.909+0000 7fbf15573640 1 -- 10.20.193.104:0/3808526145 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fbf0c03c070 con 0x7fbf18109880 2026-02-17T20:56:43.036 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.909+0000 7fbf15573640 1 -- 10.20.193.104:0/3808526145 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fbf0c02fe20 con 0x7fbf18109880 2026-02-17T20:56:43.036 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.909+0000 7fbf15573640 1 -- 10.20.193.104:0/3808526145 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fbf0c035340 con 0x7fbf18109880 2026-02-17T20:56:43.036 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.909+0000 7fbf1cc65640 1 -- 10.20.193.104:0/3808526145 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fbf18109880 msgr2=0x7fbf18109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:43.036 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.909+0000 7fbf1cc65640 1 --2- 10.20.193.104:0/3808526145 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fbf18109880 0x7fbf18109c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c009920 tx=0x7fbf0c02ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:43.036 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.909+0000 7fbf1cc65640 1 -- 10.20.193.104:0/3808526145 shutdown_connections 2026-02-17T20:56:43.036 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.909+0000 7fbf1cc65640 1 --2- 10.20.193.104:0/3808526145 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fbf18109880 0x7fbf18109c80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.036 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.909+0000 7fbf1cc65640 1 -- 10.20.193.104:0/3808526145 >> 10.20.193.104:0/3808526145 conn(0x7fbf1807cf00 msgr2=0x7fbf1807d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:43.036 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.910+0000 7fbf1cc65640 1 -- 10.20.193.104:0/3808526145 shutdown_connections 2026-02-17T20:56:43.036 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.910+0000 7fbf1cc65640 1 -- 10.20.193.104:0/3808526145 wait complete. 2026-02-17T20:56:43.036 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.910+0000 7fbf1cc65640 1 Processor -- start 2026-02-17T20:56:43.037 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.910+0000 7fbf1cc65640 1 -- start start 2026-02-17T20:56:43.037 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.910+0000 7fbf1cc65640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fbf18109880 0x7fbf1819f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:43.037 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.910+0000 7fbf1cc65640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1810dcb0 con 0x7fbf18109880 2026-02-17T20:56:43.037 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.910+0000 7fbf16575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fbf18109880 0x7fbf1819f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:43.037 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.910+0000 7fbf16575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fbf18109880 0x7fbf1819f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40740/0 (socket says 10.20.193.104:40740) 2026-02-17T20:56:43.037 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.910+0000 7fbf16575640 1 -- 10.20.193.104:0/2797007963 learned_addr learned my addr 10.20.193.104:0/2797007963 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:43.037 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.910+0000 7fbf16575640 1 -- 10.20.193.104:0/2797007963 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1819fcb0 con 0x7fbf18109880 2026-02-17T20:56:43.037 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.911+0000 7fbf16575640 1 --2- 10.20.193.104:0/2797007963 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fbf18109880 0x7fbf1819f770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0091b0 tx=0x7fbf0c037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:43.037 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.911+0000 7fbeff7fe640 1 -- 10.20.193.104:0/2797007963 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fbf0c0359a0 con 0x7fbf18109880 2026-02-17T20:56:43.037 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.911+0000 7fbeff7fe640 1 -- 10.20.193.104:0/2797007963 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fbf0c043430 con 0x7fbf18109880 2026-02-17T20:56:43.037 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.911+0000 7fbf1cc65640 1 -- 10.20.193.104:0/2797007963 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf1819ff40 con 0x7fbf18109880 2026-02-17T20:56:43.037 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.911+0000 7fbeff7fe640 1 -- 10.20.193.104:0/2797007963 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fbf0c042590 con 0x7fbf18109880 2026-02-17T20:56:43.037 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.911+0000 7fbf1cc65640 1 -- 10.20.193.104:0/2797007963 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf181a2c30 con 0x7fbf18109880 2026-02-17T20:56:43.038 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.911+0000 7fbf1cc65640 1 -- 10.20.193.104:0/2797007963 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf18109d00 con 0x7fbf18109880 2026-02-17T20:56:43.038 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.911+0000 7fbeff7fe640 1 -- 10.20.193.104:0/2797007963 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7fbf0c035b40 con 0x7fbf18109880 2026-02-17T20:56:43.038 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.911+0000 7fbeff7fe640 1 --2- 10.20.193.104:0/2797007963 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fbef003dbf0 0x7fbef00400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:43.038 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.911+0000 7fbeff7fe640 1 -- 10.20.193.104:0/2797007963 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbf0c076330 con 0x7fbf18109880 2026-02-17T20:56:43.038 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.912+0000 7fbf15d74640 1 --2- 10.20.193.104:0/2797007963 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fbef003dbf0 0x7fbef00400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:43.038 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.914+0000 7fbf15d74640 1 --2- 10.20.193.104:0/2797007963 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fbef003dbf0 0x7fbef00400b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbf000099c0 tx=0x7fbf00006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:43.038 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:42.914+0000 7fbeff7fe640 1 -- 10.20.193.104:0/2797007963 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fbf0c04be10 con 0x7fbf18109880 2026-02-17T20:56:43.038 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.004+0000 7fbf1cc65640 1 -- 10.20.193.104:0/2797007963 --> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) -- 0x7fbf18107750 con 0x7fbef003dbf0 2026-02-17T20:56:43.038 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.007+0000 7fbeff7fe640 1 -- 10.20.193.104:0/2797007963 <== mgr.14118 v2:10.20.193.104:6800/95322277 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fbf18107750 con 0x7fbef003dbf0 2026-02-17T20:56:43.038 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.008+0000 7fbf1cc65640 1 -- 10.20.193.104:0/2797007963 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fbef003dbf0 msgr2=0x7fbef00400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:43.038 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.008+0000 7fbf1cc65640 1 --2- 10.20.193.104:0/2797007963 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fbef003dbf0 0x7fbef00400b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbf000099c0 tx=0x7fbf00006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.038 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.008+0000 7fbf1cc65640 1 -- 10.20.193.104:0/2797007963 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fbf18109880 msgr2=0x7fbf1819f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:43.039 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.008+0000 7fbf1cc65640 1 --2- 10.20.193.104:0/2797007963 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fbf18109880 0x7fbf1819f770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0091b0 tx=0x7fbf0c037a50 comp rx=0 tx=0).stop 2026-02-17T20:56:43.039 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.008+0000 7fbf1cc65640 1 -- 10.20.193.104:0/2797007963 shutdown_connections 2026-02-17T20:56:43.039 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.008+0000 7fbf1cc65640 1 --2- 10.20.193.104:0/2797007963 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fbef003dbf0 0x7fbef00400b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.039 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.008+0000 7fbf1cc65640 1 --2- 10.20.193.104:0/2797007963 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fbf18109880 0x7fbf1819f770 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.039 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.009+0000 7fbf1cc65640 1 -- 10.20.193.104:0/2797007963 >> 10.20.193.104:0/2797007963 conn(0x7fbf1807cf00 msgr2=0x7fbf18107040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:43.039 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.009+0000 7fbf1cc65640 1 -- 10.20.193.104:0/2797007963 shutdown_connections 2026-02-17T20:56:43.039 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.009+0000 7fbf1cc65640 1 -- 10.20.193.104:0/2797007963 wait complete. 2026-02-17T20:56:43.039 INFO:teuthology.orchestra.run.trial104.stdout:Deploying node-exporter service with default placement... 2026-02-17T20:56:43.252 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2026-02-17T20:56:43.253 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.127+0000 7faf2211f640 1 Processor -- start 2026-02-17T20:56:43.253 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.127+0000 7faf2211f640 1 -- start start 2026-02-17T20:56:43.253 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.128+0000 7faf2211f640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faf1c109880 0x7faf1c109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:43.253 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.128+0000 7faf2211f640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c10a250 con 0x7faf1c109880 2026-02-17T20:56:43.253 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.128+0000 7faf1b7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faf1c109880 0x7faf1c109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:43.253 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.128+0000 7faf1b7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faf1c109880 0x7faf1c109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40742/0 (socket says 10.20.193.104:40742) 2026-02-17T20:56:43.253 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.128+0000 7faf1b7fe640 1 -- 10.20.193.104:0/2184001342 learned_addr learned my addr 10.20.193.104:0/2184001342 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:43.253 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.128+0000 7faf1b7fe640 1 -- 10.20.193.104:0/2184001342 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1c10aa80 con 0x7faf1c109880 2026-02-17T20:56:43.253 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.128+0000 7faf1b7fe640 1 --2- 10.20.193.104:0/2184001342 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faf1c109880 0x7faf1c109c80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf08009920 tx=0x7faf0802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f622f5ba89dd4605 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:43.253 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.128+0000 7faf1a7fc640 1 -- 10.20.193.104:0/2184001342 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7faf0803c070 con 0x7faf1c109880 2026-02-17T20:56:43.254 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.128+0000 7faf1a7fc640 1 -- 10.20.193.104:0/2184001342 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7faf0802fe20 con 0x7faf1c109880 2026-02-17T20:56:43.254 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.128+0000 7faf1a7fc640 1 -- 10.20.193.104:0/2184001342 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7faf08035340 con 0x7faf1c109880 2026-02-17T20:56:43.254 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.129+0000 7faf2211f640 1 -- 10.20.193.104:0/2184001342 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faf1c109880 msgr2=0x7faf1c109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:43.254 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.129+0000 7faf2211f640 1 --2- 10.20.193.104:0/2184001342 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faf1c109880 0x7faf1c109c80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7faf08009920 tx=0x7faf0802ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:43.254 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.129+0000 7faf2211f640 1 -- 10.20.193.104:0/2184001342 shutdown_connections 2026-02-17T20:56:43.254 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.129+0000 7faf2211f640 1 --2- 10.20.193.104:0/2184001342 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faf1c109880 0x7faf1c109c80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.254 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.129+0000 7faf2211f640 1 -- 10.20.193.104:0/2184001342 >> 10.20.193.104:0/2184001342 conn(0x7faf1c07ce10 msgr2=0x7faf1c07d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:43.254 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.129+0000 7faf2211f640 1 -- 10.20.193.104:0/2184001342 shutdown_connections 2026-02-17T20:56:43.254 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.129+0000 7faf2211f640 1 -- 10.20.193.104:0/2184001342 wait complete. 2026-02-17T20:56:43.254 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.129+0000 7faf2211f640 1 Processor -- start 2026-02-17T20:56:43.254 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.129+0000 7faf2211f640 1 -- start start 2026-02-17T20:56:43.254 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.129+0000 7faf2211f640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faf1c109880 0x7faf1c19f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:43.255 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.129+0000 7faf2211f640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7faf1c10dcb0 con 0x7faf1c109880 2026-02-17T20:56:43.255 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.129+0000 7faf1b7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faf1c109880 0x7faf1c19f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:43.255 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.129+0000 7faf1b7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faf1c109880 0x7faf1c19f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40750/0 (socket says 10.20.193.104:40750) 2026-02-17T20:56:43.255 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.129+0000 7faf1b7fe640 1 -- 10.20.193.104:0/2925334700 learned_addr learned my addr 10.20.193.104:0/2925334700 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:43.255 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.129+0000 7faf1b7fe640 1 -- 10.20.193.104:0/2925334700 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf1c19fc40 con 0x7faf1c109880 2026-02-17T20:56:43.255 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.130+0000 7faf1b7fe640 1 --2- 10.20.193.104:0/2925334700 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faf1c109880 0x7faf1c19f700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faf08002410 tx=0x7faf080379e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:43.255 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.130+0000 7faf18ff9640 1 -- 10.20.193.104:0/2925334700 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7faf080358d0 con 0x7faf1c109880 2026-02-17T20:56:43.255 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.130+0000 7faf18ff9640 1 -- 10.20.193.104:0/2925334700 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7faf08043430 con 0x7faf1c109880 2026-02-17T20:56:43.255 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.130+0000 7faf2211f640 1 -- 10.20.193.104:0/2925334700 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf1c19fed0 con 0x7faf1c109880 2026-02-17T20:56:43.255 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.130+0000 7faf18ff9640 1 -- 10.20.193.104:0/2925334700 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7faf080423e0 con 0x7faf1c109880 2026-02-17T20:56:43.255 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.130+0000 7faf2211f640 1 -- 10.20.193.104:0/2925334700 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf1c1a2bc0 con 0x7faf1c109880 2026-02-17T20:56:43.255 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.130+0000 7faf2211f640 1 -- 10.20.193.104:0/2925334700 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf1c109d00 con 0x7faf1c109880 2026-02-17T20:56:43.255 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.130+0000 7faf18ff9640 1 -- 10.20.193.104:0/2925334700 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7faf08042580 con 0x7faf1c109880 2026-02-17T20:56:43.256 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.130+0000 7faf18ff9640 1 --2- 10.20.193.104:0/2925334700 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7faef003dbf0 0x7faef00400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:43.256 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.131+0000 7faf18ff9640 1 -- 10.20.193.104:0/2925334700 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7faf08076320 con 0x7faf1c109880 2026-02-17T20:56:43.256 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.131+0000 7faf1affd640 1 --2- 10.20.193.104:0/2925334700 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7faef003dbf0 0x7faef00400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:43.256 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.131+0000 7faf1affd640 1 --2- 10.20.193.104:0/2925334700 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7faef003dbf0 0x7faef00400b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0099c0 tx=0x7faf0c006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:43.256 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.133+0000 7faf18ff9640 1 -- 10.20.193.104:0/2925334700 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7faf08033200 con 0x7faf1c109880 2026-02-17T20:56:43.256 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.221+0000 7faf2211f640 1 -- 10.20.193.104:0/2925334700 --> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) -- 0x7faf1c1076e0 con 0x7faef003dbf0 2026-02-17T20:56:43.256 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.224+0000 7faf18ff9640 1 -- 10.20.193.104:0/2925334700 <== mgr.14118 v2:10.20.193.104:6800/95322277 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+34 (secure 0 0 0) 0x7faf1c1076e0 con 0x7faef003dbf0 2026-02-17T20:56:43.256 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.226+0000 7faf2211f640 1 -- 10.20.193.104:0/2925334700 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7faef003dbf0 msgr2=0x7faef00400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:43.256 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.226+0000 7faf2211f640 1 --2- 10.20.193.104:0/2925334700 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7faef003dbf0 0x7faef00400b0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0099c0 tx=0x7faf0c006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.256 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.226+0000 7faf2211f640 1 -- 10.20.193.104:0/2925334700 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faf1c109880 msgr2=0x7faf1c19f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:43.256 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.226+0000 7faf2211f640 1 --2- 10.20.193.104:0/2925334700 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faf1c109880 0x7faf1c19f700 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faf08002410 tx=0x7faf080379e0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.256 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.226+0000 7faf2211f640 1 -- 10.20.193.104:0/2925334700 shutdown_connections 2026-02-17T20:56:43.257 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.226+0000 7faf2211f640 1 --2- 10.20.193.104:0/2925334700 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7faef003dbf0 0x7faef00400b0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.257 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.226+0000 7faf2211f640 1 --2- 10.20.193.104:0/2925334700 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faf1c109880 0x7faf1c19f700 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.257 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.226+0000 7faf2211f640 1 -- 10.20.193.104:0/2925334700 >> 10.20.193.104:0/2925334700 conn(0x7faf1c07ce10 msgr2=0x7faf1c106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:43.257 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.226+0000 7faf2211f640 1 -- 10.20.193.104:0/2925334700 shutdown_connections 2026-02-17T20:56:43.257 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.226+0000 7faf2211f640 1 -- 10.20.193.104:0/2925334700 wait complete. 2026-02-17T20:56:43.257 INFO:teuthology.orchestra.run.trial104.stdout:Deploying alertmanager service with default placement... 2026-02-17T20:56:43.467 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2026-02-17T20:56:43.467 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.347+0000 7f6839cd1640 1 Processor -- start 2026-02-17T20:56:43.467 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.347+0000 7f6839cd1640 1 -- start start 2026-02-17T20:56:43.467 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.347+0000 7f6839cd1640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6834109880 0x7f6834109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:43.467 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.347+0000 7f6839cd1640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f683410a250 con 0x7f6834109880 2026-02-17T20:56:43.467 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.347+0000 7f68337fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6834109880 0x7f6834109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:43.467 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.347+0000 7f68337fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6834109880 0x7f6834109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40758/0 (socket says 10.20.193.104:40758) 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.347+0000 7f68337fe640 1 -- 10.20.193.104:0/3220770163 learned_addr learned my addr 10.20.193.104:0/3220770163 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.348+0000 7f68337fe640 1 -- 10.20.193.104:0/3220770163 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683410aa80 con 0x7f6834109880 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.348+0000 7f68337fe640 1 --2- 10.20.193.104:0/3220770163 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6834109880 0x7f6834109c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6820009920 tx=0x7f682002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd947066426fc0c8 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.348+0000 7f68327fc640 1 -- 10.20.193.104:0/3220770163 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f682003c070 con 0x7f6834109880 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.348+0000 7f68327fc640 1 -- 10.20.193.104:0/3220770163 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f682002fe20 con 0x7f6834109880 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.348+0000 7f68327fc640 1 -- 10.20.193.104:0/3220770163 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f6820035340 con 0x7f6834109880 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.348+0000 7f6839cd1640 1 -- 10.20.193.104:0/3220770163 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6834109880 msgr2=0x7f6834109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.348+0000 7f6839cd1640 1 --2- 10.20.193.104:0/3220770163 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6834109880 0x7f6834109c80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6820009920 tx=0x7f682002ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.348+0000 7f6839cd1640 1 -- 10.20.193.104:0/3220770163 shutdown_connections 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.348+0000 7f6839cd1640 1 --2- 10.20.193.104:0/3220770163 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6834109880 0x7f6834109c80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.348+0000 7f6839cd1640 1 -- 10.20.193.104:0/3220770163 >> 10.20.193.104:0/3220770163 conn(0x7f683407cf00 msgr2=0x7f683407d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.348+0000 7f6839cd1640 1 -- 10.20.193.104:0/3220770163 shutdown_connections 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.348+0000 7f6839cd1640 1 -- 10.20.193.104:0/3220770163 wait complete. 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.349+0000 7f6839cd1640 1 Processor -- start 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.349+0000 7f6839cd1640 1 -- start start 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.349+0000 7f6839cd1640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6834109880 0x7f683419f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.349+0000 7f6839cd1640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f683410dcb0 con 0x7f6834109880 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.349+0000 7f68337fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6834109880 0x7f683419f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.349+0000 7f68337fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6834109880 0x7f683419f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40766/0 (socket says 10.20.193.104:40766) 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.349+0000 7f68337fe640 1 -- 10.20.193.104:0/324893177 learned_addr learned my addr 10.20.193.104:0/324893177 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.349+0000 7f68337fe640 1 -- 10.20.193.104:0/324893177 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683419fcb0 con 0x7f6834109880 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.349+0000 7f68337fe640 1 --2- 10.20.193.104:0/324893177 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6834109880 0x7f683419f770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f68200091b0 tx=0x7f6820037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.349+0000 7f6830ff9640 1 -- 10.20.193.104:0/324893177 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f68200359a0 con 0x7f6834109880 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.349+0000 7f6830ff9640 1 -- 10.20.193.104:0/324893177 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f6820043430 con 0x7f6834109880 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.349+0000 7f6839cd1640 1 -- 10.20.193.104:0/324893177 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683419ff40 con 0x7f6834109880 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.349+0000 7f6830ff9640 1 -- 10.20.193.104:0/324893177 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f6820042590 con 0x7f6834109880 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.349+0000 7f6839cd1640 1 -- 10.20.193.104:0/324893177 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68341a2c30 con 0x7f6834109880 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.350+0000 7f6839cd1640 1 -- 10.20.193.104:0/324893177 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6834109d00 con 0x7f6834109880 2026-02-17T20:56:43.468 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.350+0000 7f6830ff9640 1 -- 10.20.193.104:0/324893177 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7f6820035b40 con 0x7f6834109880 2026-02-17T20:56:43.469 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.350+0000 7f6830ff9640 1 --2- 10.20.193.104:0/324893177 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f680803dbf0 0x7f68080400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:43.469 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.350+0000 7f6830ff9640 1 -- 10.20.193.104:0/324893177 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6820076320 con 0x7f6834109880 2026-02-17T20:56:43.469 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.350+0000 7f6832ffd640 1 --2- 10.20.193.104:0/324893177 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f680803dbf0 0x7f68080400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:43.469 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.350+0000 7f6832ffd640 1 --2- 10.20.193.104:0/324893177 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f680803dbf0 0x7f68080400b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f68240099c0 tx=0x7f6824006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:43.469 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.353+0000 7f6830ff9640 1 -- 10.20.193.104:0/324893177 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f682002fdf0 con 0x7f6834109880 2026-02-17T20:56:43.469 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.442+0000 7f6839cd1640 1 -- 10.20.193.104:0/324893177 --> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) -- 0x7f6834107750 con 0x7f680803dbf0 2026-02-17T20:56:43.469 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.445+0000 7f6830ff9640 1 -- 10.20.193.104:0/324893177 <== mgr.14118 v2:10.20.193.104:6800/95322277 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+33 (secure 0 0 0) 0x7f6834107750 con 0x7f680803dbf0 2026-02-17T20:56:43.469 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.445+0000 7f6839cd1640 1 -- 10.20.193.104:0/324893177 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f680803dbf0 msgr2=0x7f68080400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:43.469 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.445+0000 7f6839cd1640 1 --2- 10.20.193.104:0/324893177 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f680803dbf0 0x7f68080400b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f68240099c0 tx=0x7f6824006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.469 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.445+0000 7f6839cd1640 1 -- 10.20.193.104:0/324893177 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6834109880 msgr2=0x7f683419f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:43.469 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.445+0000 7f6839cd1640 1 --2- 10.20.193.104:0/324893177 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6834109880 0x7f683419f770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f68200091b0 tx=0x7f6820037a50 comp rx=0 tx=0).stop 2026-02-17T20:56:43.469 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.446+0000 7f6839cd1640 1 -- 10.20.193.104:0/324893177 shutdown_connections 2026-02-17T20:56:43.469 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.446+0000 7f6839cd1640 1 --2- 10.20.193.104:0/324893177 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f680803dbf0 0x7f68080400b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.469 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.446+0000 7f6839cd1640 1 --2- 10.20.193.104:0/324893177 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6834109880 0x7f683419f770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.469 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.446+0000 7f6839cd1640 1 -- 10.20.193.104:0/324893177 >> 10.20.193.104:0/324893177 conn(0x7f683407cf00 msgr2=0x7f6834107040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:43.469 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.446+0000 7f6839cd1640 1 -- 10.20.193.104:0/324893177 shutdown_connections 2026-02-17T20:56:43.469 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.446+0000 7f6839cd1640 1 -- 10.20.193.104:0/324893177 wait complete. 2026-02-17T20:56:43.489 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:43 trial104 ceph-mon[20612]: Added host trial104 2026-02-17T20:56:43.489 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:43 trial104 ceph-mon[20612]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:43.489 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:43 trial104 ceph-mon[20612]: Saving service mon spec with placement count:5 2026-02-17T20:56:43.489 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:43 trial104 ceph-mon[20612]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:43.489 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:43 trial104 ceph-mon[20612]: Saving service mgr spec with placement count:2 2026-02-17T20:56:43.489 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:43 trial104 ceph-mon[20612]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:43.489 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:43 trial104 ceph-mon[20612]: Saving service crash spec with placement * 2026-02-17T20:56:43.489 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:43 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:43.489 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:43 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:43.489 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:43 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:43.489 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:43 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:43.489 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:43 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:43.489 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:43 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:43.489 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:43 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:43.489 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:43 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.558+0000 7f9f9ecd6640 1 Processor -- start 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.558+0000 7f9f9ecd6640 1 -- start start 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.558+0000 7f9f9ecd6640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9f98109880 0x7f9f98109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.558+0000 7f9f9ecd6640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9810a250 con 0x7f9f98109880 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.558+0000 7f9f9ca4b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9f98109880 0x7f9f98109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.558+0000 7f9f9ca4b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9f98109880 0x7f9f98109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40772/0 (socket says 10.20.193.104:40772) 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.558+0000 7f9f9ca4b640 1 -- 10.20.193.104:0/1766647996 learned_addr learned my addr 10.20.193.104:0/1766647996 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.558+0000 7f9f9ca4b640 1 -- 10.20.193.104:0/1766647996 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9810aa80 con 0x7f9f98109880 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.559+0000 7f9f9ca4b640 1 --2- 10.20.193.104:0/1766647996 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9f98109880 0x7f9f98109c80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009920 tx=0x7f9f8802ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3e6ead5ab01e89 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.559+0000 7f9f8f7fe640 1 -- 10.20.193.104:0/1766647996 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f9f8803c070 con 0x7f9f98109880 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.559+0000 7f9f8f7fe640 1 -- 10.20.193.104:0/1766647996 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f9f8802fe20 con 0x7f9f98109880 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.559+0000 7f9f8f7fe640 1 -- 10.20.193.104:0/1766647996 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f9f88035340 con 0x7f9f98109880 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.559+0000 7f9f9ecd6640 1 -- 10.20.193.104:0/1766647996 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9f98109880 msgr2=0x7f9f98109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.559+0000 7f9f9ecd6640 1 --2- 10.20.193.104:0/1766647996 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9f98109880 0x7f9f98109c80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9f88009920 tx=0x7f9f8802ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.559+0000 7f9f9ecd6640 1 -- 10.20.193.104:0/1766647996 shutdown_connections 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.559+0000 7f9f9ecd6640 1 --2- 10.20.193.104:0/1766647996 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9f98109880 0x7f9f98109c80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.559+0000 7f9f9ecd6640 1 -- 10.20.193.104:0/1766647996 >> 10.20.193.104:0/1766647996 conn(0x7f9f9807ce10 msgr2=0x7f9f9807d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.559+0000 7f9f9ecd6640 1 -- 10.20.193.104:0/1766647996 shutdown_connections 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.559+0000 7f9f9ecd6640 1 -- 10.20.193.104:0/1766647996 wait complete. 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.560+0000 7f9f9ecd6640 1 Processor -- start 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.560+0000 7f9f9ecd6640 1 -- start start 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.560+0000 7f9f9ecd6640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9f98109880 0x7f9f9819f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.560+0000 7f9f9ecd6640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9f9810dcb0 con 0x7f9f98109880 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.560+0000 7f9f9ca4b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9f98109880 0x7f9f9819f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.560+0000 7f9f9ca4b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9f98109880 0x7f9f9819f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40774/0 (socket says 10.20.193.104:40774) 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.560+0000 7f9f9ca4b640 1 -- 10.20.193.104:0/1825197161 learned_addr learned my addr 10.20.193.104:0/1825197161 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:43.669 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.560+0000 7f9f9ca4b640 1 -- 10.20.193.104:0/1825197161 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9819fc70 con 0x7f9f98109880 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.560+0000 7f9f9ca4b640 1 --2- 10.20.193.104:0/1825197161 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9f98109880 0x7f9f9819f730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9f880091b0 tx=0x7f9f88037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.560+0000 7f9f8dffb640 1 -- 10.20.193.104:0/1825197161 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f9f880359a0 con 0x7f9f98109880 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.560+0000 7f9f8dffb640 1 -- 10.20.193.104:0/1825197161 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f9f88043430 con 0x7f9f98109880 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.560+0000 7f9f9ecd6640 1 -- 10.20.193.104:0/1825197161 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f9819ff00 con 0x7f9f98109880 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.560+0000 7f9f8dffb640 1 -- 10.20.193.104:0/1825197161 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f9f88042590 con 0x7f9f98109880 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.560+0000 7f9f9ecd6640 1 -- 10.20.193.104:0/1825197161 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f981a2bf0 con 0x7f9f98109880 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.561+0000 7f9f9ecd6640 1 -- 10.20.193.104:0/1825197161 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f98109d00 con 0x7f9f98109880 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.561+0000 7f9f8dffb640 1 -- 10.20.193.104:0/1825197161 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7f9f88035b40 con 0x7f9f98109880 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.561+0000 7f9f8dffb640 1 --2- 10.20.193.104:0/1825197161 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f9f7403dbf0 0x7f9f740400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.561+0000 7f9f8dffb640 1 -- 10.20.193.104:0/1825197161 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9f88076320 con 0x7f9f98109880 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.561+0000 7f9f8ffff640 1 --2- 10.20.193.104:0/1825197161 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f9f7403dbf0 0x7f9f740400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.561+0000 7f9f8ffff640 1 --2- 10.20.193.104:0/1825197161 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f9f7403dbf0 0x7f9f740400b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9f800099c0 tx=0x7f9f80006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.564+0000 7f9f8dffb640 1 -- 10.20.193.104:0/1825197161 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9f8802fdf0 con 0x7f9f98109880 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.645+0000 7f9f9ecd6640 1 -- 10.20.193.104:0/1825197161 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f9f981a3350 con 0x7f9f98109880 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.647+0000 7f9f8dffb640 1 -- 10.20.193.104:0/1825197161 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f9f880471c0 con 0x7f9f98109880 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.647+0000 7f9f9ecd6640 1 -- 10.20.193.104:0/1825197161 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f9f7403dbf0 msgr2=0x7f9f740400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.647+0000 7f9f9ecd6640 1 --2- 10.20.193.104:0/1825197161 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f9f7403dbf0 0x7f9f740400b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9f800099c0 tx=0x7f9f80006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.647+0000 7f9f9ecd6640 1 -- 10.20.193.104:0/1825197161 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9f98109880 msgr2=0x7f9f9819f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.647+0000 7f9f9ecd6640 1 --2- 10.20.193.104:0/1825197161 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9f98109880 0x7f9f9819f730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9f880091b0 tx=0x7f9f88037a50 comp rx=0 tx=0).stop 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.647+0000 7f9f9ecd6640 1 -- 10.20.193.104:0/1825197161 shutdown_connections 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.647+0000 7f9f9ecd6640 1 --2- 10.20.193.104:0/1825197161 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f9f7403dbf0 0x7f9f740400b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.647+0000 7f9f9ecd6640 1 --2- 10.20.193.104:0/1825197161 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9f98109880 0x7f9f9819f730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.647+0000 7f9f9ecd6640 1 -- 10.20.193.104:0/1825197161 >> 10.20.193.104:0/1825197161 conn(0x7f9f9807ce10 msgr2=0x7f9f98106fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.647+0000 7f9f9ecd6640 1 -- 10.20.193.104:0/1825197161 shutdown_connections 2026-02-17T20:56:43.670 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.647+0000 7f9f9ecd6640 1 -- 10.20.193.104:0/1825197161 wait complete. 2026-02-17T20:56:43.876 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.760+0000 7fc0660ee640 1 Processor -- start 2026-02-17T20:56:43.876 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.760+0000 7fc0660ee640 1 -- start start 2026-02-17T20:56:43.876 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.760+0000 7fc0660ee640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc06007b410 0x7fc06010c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:43.876 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.760+0000 7fc0660ee640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc06010cb30 con 0x7fc06007b410 2026-02-17T20:56:43.876 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.760+0000 7fc05f7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc06007b410 0x7fc06010c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:43.876 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.760+0000 7fc05f7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc06007b410 0x7fc06010c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40778/0 (socket says 10.20.193.104:40778) 2026-02-17T20:56:43.877 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.760+0000 7fc05f7fe640 1 -- 10.20.193.104:0/2623683524 learned_addr learned my addr 10.20.193.104:0/2623683524 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:43.877 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.760+0000 7fc05f7fe640 1 -- 10.20.193.104:0/2623683524 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06010ccb0 con 0x7fc06007b410 2026-02-17T20:56:43.877 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.761+0000 7fc05f7fe640 1 --2- 10.20.193.104:0/2623683524 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc06007b410 0x7fc06010c5f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009920 tx=0x7fc04c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf89235feaf56b5 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:43.877 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.761+0000 7fc05e7fc640 1 -- 10.20.193.104:0/2623683524 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fc04c03c070 con 0x7fc06007b410 2026-02-17T20:56:43.877 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.761+0000 7fc05e7fc640 1 -- 10.20.193.104:0/2623683524 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fc04c02fe20 con 0x7fc06007b410 2026-02-17T20:56:43.877 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.761+0000 7fc05e7fc640 1 -- 10.20.193.104:0/2623683524 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fc04c035340 con 0x7fc06007b410 2026-02-17T20:56:43.877 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.761+0000 7fc0660ee640 1 -- 10.20.193.104:0/2623683524 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc06007b410 msgr2=0x7fc06010c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:43.877 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.761+0000 7fc0660ee640 1 --2- 10.20.193.104:0/2623683524 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc06007b410 0x7fc06010c5f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009920 tx=0x7fc04c02ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:43.877 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.761+0000 7fc0660ee640 1 -- 10.20.193.104:0/2623683524 shutdown_connections 2026-02-17T20:56:43.877 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.761+0000 7fc0660ee640 1 --2- 10.20.193.104:0/2623683524 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc06007b410 0x7fc06010c5f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.877 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.761+0000 7fc0660ee640 1 -- 10.20.193.104:0/2623683524 >> 10.20.193.104:0/2623683524 conn(0x7fc060101ce0 msgr2=0x7fc060104100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:43.877 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.761+0000 7fc0660ee640 1 -- 10.20.193.104:0/2623683524 shutdown_connections 2026-02-17T20:56:43.877 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.761+0000 7fc0660ee640 1 -- 10.20.193.104:0/2623683524 wait complete. 2026-02-17T20:56:43.878 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.762+0000 7fc0660ee640 1 Processor -- start 2026-02-17T20:56:43.878 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.762+0000 7fc0660ee640 1 -- start start 2026-02-17T20:56:43.878 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.762+0000 7fc0660ee640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc06007b410 0x7fc06019f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:43.878 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.762+0000 7fc0660ee640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc06010dbb0 con 0x7fc06007b410 2026-02-17T20:56:43.878 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.762+0000 7fc05f7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc06007b410 0x7fc06019f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:43.878 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.762+0000 7fc05f7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc06007b410 0x7fc06019f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40786/0 (socket says 10.20.193.104:40786) 2026-02-17T20:56:43.878 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.762+0000 7fc05f7fe640 1 -- 10.20.193.104:0/478897938 learned_addr learned my addr 10.20.193.104:0/478897938 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:43.878 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.762+0000 7fc05f7fe640 1 -- 10.20.193.104:0/478897938 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc06019fc50 con 0x7fc06007b410 2026-02-17T20:56:43.878 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.762+0000 7fc05f7fe640 1 --2- 10.20.193.104:0/478897938 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc06007b410 0x7fc06019f710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc04c006fd0 tx=0x7fc04c0379e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:43.878 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.762+0000 7fc05cff9640 1 -- 10.20.193.104:0/478897938 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fc04c0358d0 con 0x7fc06007b410 2026-02-17T20:56:43.878 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.762+0000 7fc05cff9640 1 -- 10.20.193.104:0/478897938 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fc04c0423e0 con 0x7fc06007b410 2026-02-17T20:56:43.878 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.762+0000 7fc0660ee640 1 -- 10.20.193.104:0/478897938 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc06019fee0 con 0x7fc06007b410 2026-02-17T20:56:43.878 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.762+0000 7fc05cff9640 1 -- 10.20.193.104:0/478897938 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fc04c0363a0 con 0x7fc06007b410 2026-02-17T20:56:43.878 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.762+0000 7fc0660ee640 1 -- 10.20.193.104:0/478897938 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0601a2bd0 con 0x7fc06007b410 2026-02-17T20:56:43.879 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.763+0000 7fc0660ee640 1 -- 10.20.193.104:0/478897938 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc06010c670 con 0x7fc06007b410 2026-02-17T20:56:43.879 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.763+0000 7fc05cff9640 1 -- 10.20.193.104:0/478897938 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7fc04c042590 con 0x7fc06007b410 2026-02-17T20:56:43.879 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.763+0000 7fc05cff9640 1 --2- 10.20.193.104:0/478897938 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fc03403dba0 0x7fc034040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:43.879 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.763+0000 7fc05cff9640 1 -- 10.20.193.104:0/478897938 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc04c076350 con 0x7fc06007b410 2026-02-17T20:56:43.879 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.763+0000 7fc05effd640 1 --2- 10.20.193.104:0/478897938 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fc03403dba0 0x7fc034040060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:43.879 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.764+0000 7fc05effd640 1 --2- 10.20.193.104:0/478897938 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fc03403dba0 0x7fc034040060 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc0500099c0 tx=0x7fc050006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:43.879 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.766+0000 7fc05cff9640 1 -- 10.20.193.104:0/478897938 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc04c0429d0 con 0x7fc06007b410 2026-02-17T20:56:43.879 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.849+0000 7fc0660ee640 1 -- 10.20.193.104:0/478897938 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fc0601a33a0 con 0x7fc06007b410 2026-02-17T20:56:43.879 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.851+0000 7fc05cff9640 1 -- 10.20.193.104:0/478897938 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fc04c0760b0 con 0x7fc06007b410 2026-02-17T20:56:43.879 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.851+0000 7fc0660ee640 1 -- 10.20.193.104:0/478897938 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fc03403dba0 msgr2=0x7fc034040060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:43.879 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.851+0000 7fc0660ee640 1 --2- 10.20.193.104:0/478897938 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fc03403dba0 0x7fc034040060 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc0500099c0 tx=0x7fc050006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.879 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.851+0000 7fc0660ee640 1 -- 10.20.193.104:0/478897938 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc06007b410 msgr2=0x7fc06019f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:43.879 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.851+0000 7fc0660ee640 1 --2- 10.20.193.104:0/478897938 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc06007b410 0x7fc06019f710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc04c006fd0 tx=0x7fc04c0379e0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.880 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.851+0000 7fc0660ee640 1 -- 10.20.193.104:0/478897938 shutdown_connections 2026-02-17T20:56:43.880 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.851+0000 7fc0660ee640 1 --2- 10.20.193.104:0/478897938 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7fc03403dba0 0x7fc034040060 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.880 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.851+0000 7fc0660ee640 1 --2- 10.20.193.104:0/478897938 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc06007b410 0x7fc06019f710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:43.880 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.851+0000 7fc0660ee640 1 -- 10.20.193.104:0/478897938 >> 10.20.193.104:0/478897938 conn(0x7fc060101ce0 msgr2=0x7fc0601028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:43.880 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.851+0000 7fc0660ee640 1 -- 10.20.193.104:0/478897938 shutdown_connections 2026-02-17T20:56:43.880 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.851+0000 7fc0660ee640 1 -- 10.20.193.104:0/478897938 wait complete. 2026-02-17T20:56:43.880 INFO:teuthology.orchestra.run.trial104.stdout:Enabling the dashboard module... 2026-02-17T20:56:44.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:44 trial104 ceph-mon[20612]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:44.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:44 trial104 ceph-mon[20612]: Saving service ceph-exporter spec with placement * 2026-02-17T20:56:44.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:44 trial104 ceph-mon[20612]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:44.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:44 trial104 ceph-mon[20612]: Saving service prometheus spec with placement count:1 2026-02-17T20:56:44.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:44 trial104 ceph-mon[20612]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:44.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:44 trial104 ceph-mon[20612]: Saving service grafana spec with placement count:1 2026-02-17T20:56:44.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:44 trial104 ceph-mon[20612]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:44.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:44 trial104 ceph-mon[20612]: Saving service node-exporter spec with placement * 2026-02-17T20:56:44.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:44 trial104 ceph-mon[20612]: from='mgr.14118 10.20.193.104:0/378309011' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:44.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:44 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/1825197161' entity='client.admin' 2026-02-17T20:56:44.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:44 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/478897938' entity='client.admin' 2026-02-17T20:56:44.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:44 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/4016297357' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2026-02-17T20:56:44.882 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.966+0000 7f508dd25640 1 Processor -- start 2026-02-17T20:56:44.882 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.966+0000 7f508dd25640 1 -- start start 2026-02-17T20:56:44.882 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.966+0000 7f508dd25640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f5088109880 0x7f5088109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:44.882 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.966+0000 7f508dd25640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f508810a250 con 0x7f5088109880 2026-02-17T20:56:44.882 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.966+0000 7f50877fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f5088109880 0x7f5088109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:44.882 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.966+0000 7f50877fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f5088109880 0x7f5088109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40798/0 (socket says 10.20.193.104:40798) 2026-02-17T20:56:44.882 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.966+0000 7f50877fe640 1 -- 10.20.193.104:0/783813455 learned_addr learned my addr 10.20.193.104:0/783813455 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:44.882 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.967+0000 7f50877fe640 1 -- 10.20.193.104:0/783813455 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508810aa80 con 0x7f5088109880 2026-02-17T20:56:44.883 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.967+0000 7f50877fe640 1 --2- 10.20.193.104:0/783813455 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f5088109880 0x7f5088109c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5074009920 tx=0x7f507402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c1d6c566f0821a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:44.883 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.967+0000 7f50867fc640 1 -- 10.20.193.104:0/783813455 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f507403c070 con 0x7f5088109880 2026-02-17T20:56:44.883 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.967+0000 7f50867fc640 1 -- 10.20.193.104:0/783813455 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f507402fe20 con 0x7f5088109880 2026-02-17T20:56:44.883 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.967+0000 7f50867fc640 1 -- 10.20.193.104:0/783813455 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f5074035340 con 0x7f5088109880 2026-02-17T20:56:44.883 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.967+0000 7f508dd25640 1 -- 10.20.193.104:0/783813455 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f5088109880 msgr2=0x7f5088109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:44.883 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.967+0000 7f508dd25640 1 --2- 10.20.193.104:0/783813455 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f5088109880 0x7f5088109c80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5074009920 tx=0x7f507402ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:44.883 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.967+0000 7f508dd25640 1 -- 10.20.193.104:0/783813455 shutdown_connections 2026-02-17T20:56:44.883 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.967+0000 7f508dd25640 1 --2- 10.20.193.104:0/783813455 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f5088109880 0x7f5088109c80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:44.883 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.967+0000 7f508dd25640 1 -- 10.20.193.104:0/783813455 >> 10.20.193.104:0/783813455 conn(0x7f508807cf00 msgr2=0x7f508807d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:44.883 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.967+0000 7f508dd25640 1 -- 10.20.193.104:0/783813455 shutdown_connections 2026-02-17T20:56:44.883 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.968+0000 7f508dd25640 1 -- 10.20.193.104:0/783813455 wait complete. 2026-02-17T20:56:44.884 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.968+0000 7f508dd25640 1 Processor -- start 2026-02-17T20:56:44.884 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.968+0000 7f508dd25640 1 -- start start 2026-02-17T20:56:44.884 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.968+0000 7f508dd25640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f5088109880 0x7f508819f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:44.884 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.968+0000 7f508dd25640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f508810dcb0 con 0x7f5088109880 2026-02-17T20:56:44.884 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.968+0000 7f50877fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f5088109880 0x7f508819f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:44.884 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.968+0000 7f50877fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f5088109880 0x7f508819f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40802/0 (socket says 10.20.193.104:40802) 2026-02-17T20:56:44.884 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.968+0000 7f50877fe640 1 -- 10.20.193.104:0/4016297357 learned_addr learned my addr 10.20.193.104:0/4016297357 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:44.884 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.968+0000 7f50877fe640 1 -- 10.20.193.104:0/4016297357 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508819fcb0 con 0x7f5088109880 2026-02-17T20:56:44.884 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.968+0000 7f50877fe640 1 --2- 10.20.193.104:0/4016297357 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f5088109880 0x7f508819f770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f50740091b0 tx=0x7f5074037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:44.884 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.968+0000 7f5084ff9640 1 -- 10.20.193.104:0/4016297357 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f50740359a0 con 0x7f5088109880 2026-02-17T20:56:44.884 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.968+0000 7f508dd25640 1 -- 10.20.193.104:0/4016297357 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508819ff40 con 0x7f5088109880 2026-02-17T20:56:44.885 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.968+0000 7f5084ff9640 1 -- 10.20.193.104:0/4016297357 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f5074043430 con 0x7f5088109880 2026-02-17T20:56:44.885 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.968+0000 7f5084ff9640 1 -- 10.20.193.104:0/4016297357 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f5074042590 con 0x7f5088109880 2026-02-17T20:56:44.885 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.968+0000 7f508dd25640 1 -- 10.20.193.104:0/4016297357 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50881a2c30 con 0x7f5088109880 2026-02-17T20:56:44.885 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.969+0000 7f508dd25640 1 -- 10.20.193.104:0/4016297357 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5088109d00 con 0x7f5088109880 2026-02-17T20:56:44.885 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.969+0000 7f5084ff9640 1 -- 10.20.193.104:0/4016297357 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 8) ==== 50261+0+0 (secure 0 0 0) 0x7f5074042840 con 0x7f5088109880 2026-02-17T20:56:44.885 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.969+0000 7f5084ff9640 1 --2- 10.20.193.104:0/4016297357 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f505c03dbf0 0x7f505c0400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:44.885 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.969+0000 7f5084ff9640 1 -- 10.20.193.104:0/4016297357 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f50740762e0 con 0x7f5088109880 2026-02-17T20:56:44.885 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.969+0000 7f5086ffd640 1 --2- 10.20.193.104:0/4016297357 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f505c03dbf0 0x7f505c0400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:44.885 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.970+0000 7f5086ffd640 1 --2- 10.20.193.104:0/4016297357 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f505c03dbf0 0x7f505c0400b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f50780099c0 tx=0x7f5078006eb0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:44.886 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:43.972+0000 7f5084ff9640 1 -- 10.20.193.104:0/4016297357 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5074033200 con 0x7f5088109880 2026-02-17T20:56:44.886 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.075+0000 7f508dd25640 1 -- 10.20.193.104:0/4016297357 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f50881a3320 con 0x7f5088109880 2026-02-17T20:56:44.886 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.851+0000 7f5084ff9640 1 -- 10.20.193.104:0/4016297357 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f5074076040 con 0x7f5088109880 2026-02-17T20:56:44.886 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.852+0000 7f508dd25640 1 -- 10.20.193.104:0/4016297357 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f505c03dbf0 msgr2=0x7f505c0400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:44.886 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.852+0000 7f508dd25640 1 --2- 10.20.193.104:0/4016297357 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f505c03dbf0 0x7f505c0400b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f50780099c0 tx=0x7f5078006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:44.886 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.852+0000 7f508dd25640 1 -- 10.20.193.104:0/4016297357 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f5088109880 msgr2=0x7f508819f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:44.886 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.852+0000 7f5084ff9640 1 -- 10.20.193.104:0/4016297357 <== mon.0 v2:10.20.193.104:3300/0 8 ==== mgrmap(e 9) ==== 50274+0+0 (secure 0 0 0) 0x7f5074042b60 con 0x7f5088109880 2026-02-17T20:56:44.886 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.852+0000 7f508dd25640 1 --2- 10.20.193.104:0/4016297357 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f5088109880 0x7f508819f770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f50740091b0 tx=0x7f5074037a50 comp rx=0 tx=0).stop 2026-02-17T20:56:44.887 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.852+0000 7f508dd25640 1 -- 10.20.193.104:0/4016297357 shutdown_connections 2026-02-17T20:56:44.887 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.852+0000 7f508dd25640 1 --2- 10.20.193.104:0/4016297357 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f505c03dbf0 0x7f505c0400b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:44.887 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.852+0000 7f508dd25640 1 --2- 10.20.193.104:0/4016297357 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f5088109880 0x7f508819f770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:44.887 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.852+0000 7f508dd25640 1 -- 10.20.193.104:0/4016297357 >> 10.20.193.104:0/4016297357 conn(0x7f508807cf00 msgr2=0x7f5088107010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:44.887 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.853+0000 7f508dd25640 1 -- 10.20.193.104:0/4016297357 shutdown_connections 2026-02-17T20:56:44.887 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.854+0000 7f508dd25640 1 -- 10.20.193.104:0/4016297357 wait complete. 2026-02-17T20:56:45.121 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout { 2026-02-17T20:56:45.121 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "epoch": 9, 2026-02-17T20:56:45.121 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-17T20:56:45.121 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "active_name": "trial104.irrhmt", 2026-02-17T20:56:45.121 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-17T20:56:45.121 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout } 2026-02-17T20:56:45.122 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.980+0000 7f57633de640 1 Processor -- start 2026-02-17T20:56:45.122 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.980+0000 7f57633de640 1 -- start start 2026-02-17T20:56:45.122 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.980+0000 7f57633de640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f575c109880 0x7f575c109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:45.122 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.980+0000 7f57633de640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f575c10a250 con 0x7f575c109880 2026-02-17T20:56:45.122 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.980+0000 7f5761153640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f575c109880 0x7f575c109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:45.122 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.980+0000 7f5761153640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f575c109880 0x7f575c109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40832/0 (socket says 10.20.193.104:40832) 2026-02-17T20:56:45.122 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.980+0000 7f5761153640 1 -- 10.20.193.104:0/826747262 learned_addr learned my addr 10.20.193.104:0/826747262 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:45.122 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.980+0000 7f5761153640 1 -- 10.20.193.104:0/826747262 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c10aa80 con 0x7f575c109880 2026-02-17T20:56:45.122 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.981+0000 7f5761153640 1 --2- 10.20.193.104:0/826747262 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f575c109880 0x7f575c109c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f574c009920 tx=0x7f574c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babc517d58259383 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:45.122 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.981+0000 7f574bfff640 1 -- 10.20.193.104:0/826747262 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f574c03c070 con 0x7f575c109880 2026-02-17T20:56:45.122 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.981+0000 7f574bfff640 1 -- 10.20.193.104:0/826747262 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f574c02fe20 con 0x7f575c109880 2026-02-17T20:56:45.123 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.981+0000 7f574bfff640 1 -- 10.20.193.104:0/826747262 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f574c035340 con 0x7f575c109880 2026-02-17T20:56:45.123 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.981+0000 7f57633de640 1 -- 10.20.193.104:0/826747262 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f575c109880 msgr2=0x7f575c109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:45.123 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.981+0000 7f57633de640 1 --2- 10.20.193.104:0/826747262 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f575c109880 0x7f575c109c80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f574c009920 tx=0x7f574c02ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:45.123 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.981+0000 7f57633de640 1 -- 10.20.193.104:0/826747262 shutdown_connections 2026-02-17T20:56:45.123 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.981+0000 7f57633de640 1 --2- 10.20.193.104:0/826747262 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f575c109880 0x7f575c109c80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:45.123 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.981+0000 7f57633de640 1 -- 10.20.193.104:0/826747262 >> 10.20.193.104:0/826747262 conn(0x7f575c07cf00 msgr2=0x7f575c07d310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:45.123 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.981+0000 7f57633de640 1 -- 10.20.193.104:0/826747262 shutdown_connections 2026-02-17T20:56:45.123 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.981+0000 7f57633de640 1 -- 10.20.193.104:0/826747262 wait complete. 2026-02-17T20:56:45.123 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.981+0000 7f57633de640 1 Processor -- start 2026-02-17T20:56:45.123 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.981+0000 7f57633de640 1 -- start start 2026-02-17T20:56:45.123 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.981+0000 7f57633de640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f575c109880 0x7f575c19f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:45.123 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.981+0000 7f57633de640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f575c10dcb0 con 0x7f575c109880 2026-02-17T20:56:45.124 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.982+0000 7f5761153640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f575c109880 0x7f575c19f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:45.124 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.982+0000 7f5761153640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f575c109880 0x7f575c19f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40834/0 (socket says 10.20.193.104:40834) 2026-02-17T20:56:45.124 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.982+0000 7f5761153640 1 -- 10.20.193.104:0/3696502965 learned_addr learned my addr 10.20.193.104:0/3696502965 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:45.124 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.982+0000 7f5761153640 1 -- 10.20.193.104:0/3696502965 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f575c19fcb0 con 0x7f575c109880 2026-02-17T20:56:45.124 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.982+0000 7f5761153640 1 --2- 10.20.193.104:0/3696502965 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f575c109880 0x7f575c19f770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f574c002410 tx=0x7f574c0379e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:45.124 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.982+0000 7f574a7fc640 1 -- 10.20.193.104:0/3696502965 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f574c0358d0 con 0x7f575c109880 2026-02-17T20:56:45.124 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.982+0000 7f574a7fc640 1 -- 10.20.193.104:0/3696502965 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f574c043430 con 0x7f575c109880 2026-02-17T20:56:45.124 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.982+0000 7f574a7fc640 1 -- 10.20.193.104:0/3696502965 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f574c0423e0 con 0x7f575c109880 2026-02-17T20:56:45.124 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.982+0000 7f57633de640 1 -- 10.20.193.104:0/3696502965 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f575c19ff40 con 0x7f575c109880 2026-02-17T20:56:45.124 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.982+0000 7f57633de640 1 -- 10.20.193.104:0/3696502965 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f575c1a2c30 con 0x7f575c109880 2026-02-17T20:56:45.124 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.982+0000 7f57633de640 1 -- 10.20.193.104:0/3696502965 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f575c109d00 con 0x7f575c109880 2026-02-17T20:56:45.125 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.983+0000 7f574a7fc640 1 -- 10.20.193.104:0/3696502965 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 9) ==== 50274+0+0 (secure 0 0 0) 0x7f574c043990 con 0x7f575c109880 2026-02-17T20:56:45.125 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.983+0000 7f574a7fc640 1 --2- 10.20.193.104:0/3696502965 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f573803dc40 0x7f5738040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:45.125 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.983+0000 7f5760952640 1 -- 10.20.193.104:0/3696502965 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f573803dc40 msgr2=0x7f5738040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.104:6800/95322277 2026-02-17T20:56:45.125 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.983+0000 7f574a7fc640 1 -- 10.20.193.104:0/3696502965 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f574c076360 con 0x7f575c109880 2026-02-17T20:56:45.125 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.983+0000 7f5760952640 1 --2- 10.20.193.104:0/3696502965 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f573803dc40 0x7f5738040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T20:56:45.125 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:44.985+0000 7f574a7fc640 1 -- 10.20.193.104:0/3696502965 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f574c033200 con 0x7f575c109880 2026-02-17T20:56:45.125 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.092+0000 7f57633de640 1 -- 10.20.193.104:0/3696502965 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f575c1a3320 con 0x7f575c109880 2026-02-17T20:56:45.125 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.092+0000 7f574a7fc640 1 -- 10.20.193.104:0/3696502965 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+102 (secure 0 0 0) 0x7f574c0760c0 con 0x7f575c109880 2026-02-17T20:56:45.125 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.093+0000 7f57633de640 1 -- 10.20.193.104:0/3696502965 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f573803dc40 msgr2=0x7f5738040100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T20:56:45.125 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.093+0000 7f57633de640 1 --2- 10.20.193.104:0/3696502965 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f573803dc40 0x7f5738040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:45.125 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.093+0000 7f57633de640 1 -- 10.20.193.104:0/3696502965 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f575c109880 msgr2=0x7f575c19f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:45.126 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.093+0000 7f57633de640 1 --2- 10.20.193.104:0/3696502965 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f575c109880 0x7f575c19f770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f574c002410 tx=0x7f574c0379e0 comp rx=0 tx=0).stop 2026-02-17T20:56:45.126 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.093+0000 7f57633de640 1 -- 10.20.193.104:0/3696502965 shutdown_connections 2026-02-17T20:56:45.126 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.093+0000 7f57633de640 1 --2- 10.20.193.104:0/3696502965 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f573803dc40 0x7f5738040100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:45.126 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.093+0000 7f57633de640 1 --2- 10.20.193.104:0/3696502965 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f575c109880 0x7f575c19f770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:45.126 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.093+0000 7f57633de640 1 -- 10.20.193.104:0/3696502965 >> 10.20.193.104:0/3696502965 conn(0x7f575c07cf00 msgr2=0x7f575c107010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:45.126 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.093+0000 7f57633de640 1 -- 10.20.193.104:0/3696502965 shutdown_connections 2026-02-17T20:56:45.126 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.093+0000 7f57633de640 1 -- 10.20.193.104:0/3696502965 wait complete. 2026-02-17T20:56:45.126 INFO:teuthology.orchestra.run.trial104.stdout:Waiting for the mgr to restart... 2026-02-17T20:56:45.126 INFO:teuthology.orchestra.run.trial104.stdout:Waiting for mgr epoch 9... 2026-02-17T20:56:45.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:45 trial104 ceph-mon[20612]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:45.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:45 trial104 ceph-mon[20612]: Saving service alertmanager spec with placement count:1 2026-02-17T20:56:45.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:45 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/4016297357' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2026-02-17T20:56:45.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:45 trial104 ceph-mon[20612]: mgrmap e9: trial104.irrhmt(active, since 6s) 2026-02-17T20:56:45.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:45 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3696502965' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2026-02-17T20:56:47.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:47 trial104 ceph-mon[20612]: Active manager daemon trial104.irrhmt restarted 2026-02-17T20:56:47.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:47 trial104 ceph-mon[20612]: Activating manager daemon trial104.irrhmt 2026-02-17T20:56:47.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:47 trial104 ceph-mon[20612]: osdmap e3: 0 total, 0 up, 0 in 2026-02-17T20:56:47.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:47 trial104 ceph-mon[20612]: mgrmap e10: trial104.irrhmt(active, starting, since 0.00251218s) 2026-02-17T20:56:47.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:47 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial104"}]: dispatch 2026-02-17T20:56:47.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:47 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mgr metadata", "who": "trial104.irrhmt", "id": "trial104.irrhmt"}]: dispatch 2026-02-17T20:56:47.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:47 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T20:56:47.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:47 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T20:56:47.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:47 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T20:56:47.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:47 trial104 ceph-mon[20612]: Manager daemon trial104.irrhmt is now available 2026-02-17T20:56:47.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:47 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:56:47.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:47 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial104.irrhmt/mirror_snapshot_schedule"}]: dispatch 2026-02-17T20:56:47.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:47 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial104.irrhmt/trash_purge_schedule"}]: dispatch 2026-02-17T20:56:48.651 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout { 2026-02-17T20:56:48.651 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2026-02-17T20:56:48.651 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-17T20:56:48.651 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout } 2026-02-17T20:56:48.651 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.219+0000 7f237449b640 1 Processor -- start 2026-02-17T20:56:48.651 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.219+0000 7f237449b640 1 -- start start 2026-02-17T20:56:48.651 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.219+0000 7f237449b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f236c109880 0x7f236c109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:48.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.220+0000 7f237449b640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f236c10a250 con 0x7f236c109880 2026-02-17T20:56:48.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.220+0000 7f2372210640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f236c109880 0x7f236c109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:48.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.220+0000 7f2372210640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f236c109880 0x7f236c109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40838/0 (socket says 10.20.193.104:40838) 2026-02-17T20:56:48.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.220+0000 7f2372210640 1 -- 10.20.193.104:0/709497752 learned_addr learned my addr 10.20.193.104:0/709497752 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:48.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.220+0000 7f2372210640 1 -- 10.20.193.104:0/709497752 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236c10aa80 con 0x7f236c109880 2026-02-17T20:56:48.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.220+0000 7f2372210640 1 --2- 10.20.193.104:0/709497752 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f236c109880 0x7f236c109c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f235c009920 tx=0x7f235c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183bae5c0b79d51a server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:48.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.220+0000 7f237120e640 1 -- 10.20.193.104:0/709497752 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f235c03c070 con 0x7f236c109880 2026-02-17T20:56:48.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.220+0000 7f237120e640 1 -- 10.20.193.104:0/709497752 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f235c02fe20 con 0x7f236c109880 2026-02-17T20:56:48.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.220+0000 7f237120e640 1 -- 10.20.193.104:0/709497752 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f235c035340 con 0x7f236c109880 2026-02-17T20:56:48.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.221+0000 7f237449b640 1 -- 10.20.193.104:0/709497752 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f236c109880 msgr2=0x7f236c109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:48.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.221+0000 7f237449b640 1 --2- 10.20.193.104:0/709497752 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f236c109880 0x7f236c109c80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f235c009920 tx=0x7f235c02ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:48.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.221+0000 7f237449b640 1 -- 10.20.193.104:0/709497752 shutdown_connections 2026-02-17T20:56:48.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.221+0000 7f237449b640 1 --2- 10.20.193.104:0/709497752 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f236c109880 0x7f236c109c80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:48.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.221+0000 7f237449b640 1 -- 10.20.193.104:0/709497752 >> 10.20.193.104:0/709497752 conn(0x7f236c07ce10 msgr2=0x7f236c07d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:48.652 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.221+0000 7f237449b640 1 -- 10.20.193.104:0/709497752 shutdown_connections 2026-02-17T20:56:48.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.221+0000 7f237449b640 1 -- 10.20.193.104:0/709497752 wait complete. 2026-02-17T20:56:48.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.221+0000 7f237449b640 1 Processor -- start 2026-02-17T20:56:48.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.221+0000 7f237449b640 1 -- start start 2026-02-17T20:56:48.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.221+0000 7f237449b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f236c109880 0x7f236c19f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:48.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.221+0000 7f237449b640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f236c10dcb0 con 0x7f236c109880 2026-02-17T20:56:48.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.221+0000 7f2372210640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f236c109880 0x7f236c19f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:48.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.221+0000 7f2372210640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f236c109880 0x7f236c19f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40842/0 (socket says 10.20.193.104:40842) 2026-02-17T20:56:48.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.221+0000 7f2372210640 1 -- 10.20.193.104:0/3690633563 learned_addr learned my addr 10.20.193.104:0/3690633563 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:48.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.222+0000 7f2372210640 1 -- 10.20.193.104:0/3690633563 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f236c19fc40 con 0x7f236c109880 2026-02-17T20:56:48.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.222+0000 7f2372210640 1 --2- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f236c109880 0x7f236c19f700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f235c002410 tx=0x7f235c0379e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:48.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.222+0000 7f23537fe640 1 -- 10.20.193.104:0/3690633563 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f235c0358d0 con 0x7f236c109880 2026-02-17T20:56:48.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.222+0000 7f237449b640 1 -- 10.20.193.104:0/3690633563 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f236c19fed0 con 0x7f236c109880 2026-02-17T20:56:48.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.222+0000 7f23537fe640 1 -- 10.20.193.104:0/3690633563 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f235c043430 con 0x7f236c109880 2026-02-17T20:56:48.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.222+0000 7f23537fe640 1 -- 10.20.193.104:0/3690633563 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f235c0423e0 con 0x7f236c109880 2026-02-17T20:56:48.653 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.222+0000 7f237449b640 1 -- 10.20.193.104:0/3690633563 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f236c1a2bc0 con 0x7f236c109880 2026-02-17T20:56:48.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.222+0000 7f23537fe640 1 -- 10.20.193.104:0/3690633563 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 9) ==== 50274+0+0 (secure 0 0 0) 0x7f235c043990 con 0x7f236c109880 2026-02-17T20:56:48.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.223+0000 7f23537fe640 1 --2- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f234803dc40 0x7f2348040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:48.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.223+0000 7f23537fe640 1 -- 10.20.193.104:0/3690633563 --> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2348040810 con 0x7f234803dc40 2026-02-17T20:56:48.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.223+0000 7f2371a0f640 1 -- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f234803dc40 msgr2=0x7f2348040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.104:6800/95322277 2026-02-17T20:56:48.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.223+0000 7f23537fe640 1 -- 10.20.193.104:0/3690633563 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f235c076360 con 0x7f236c109880 2026-02-17T20:56:48.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.223+0000 7f2371a0f640 1 --2- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f234803dc40 0x7f2348040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T20:56:48.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.424+0000 7f2371a0f640 1 -- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f234803dc40 msgr2=0x7f2348040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.104:6800/95322277 2026-02-17T20:56:48.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.424+0000 7f2371a0f640 1 --2- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f234803dc40 0x7f2348040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-17T20:56:48.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.825+0000 7f2371a0f640 1 -- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f234803dc40 msgr2=0x7f2348040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.104:6800/95322277 2026-02-17T20:56:48.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:45.825+0000 7f2371a0f640 1 --2- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f234803dc40 0x7f2348040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-17T20:56:48.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:46.626+0000 7f2371a0f640 1 -- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f234803dc40 msgr2=0x7f2348040100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.104:6800/95322277 2026-02-17T20:56:48.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:46.626+0000 7f2371a0f640 1 --2- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f234803dc40 0x7f2348040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-17T20:56:48.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:47.531+0000 7f23537fe640 1 -- 10.20.193.104:0/3690633563 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mgrmap(e 10) ==== 50041+0+0 (secure 0 0 0) 0x7f235c075160 con 0x7f236c109880 2026-02-17T20:56:48.654 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:47.531+0000 7f23537fe640 1 -- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f234803dc40 msgr2=0x7f2348040100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T20:56:48.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:47.531+0000 7f23537fe640 1 --2- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f234803dc40 0x7f2348040100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:48.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.532+0000 7f23537fe640 1 -- 10.20.193.104:0/3690633563 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mgrmap(e 11) ==== 50168+0+0 (secure 0 0 0) 0x7f235c0435e0 con 0x7f236c109880 2026-02-17T20:56:48.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.532+0000 7f23537fe640 1 --2- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f2348041720 0x7f2348043b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:48.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.532+0000 7f23537fe640 1 -- 10.20.193.104:0/3690633563 --> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2348040810 con 0x7f2348041720 2026-02-17T20:56:48.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.532+0000 7f2371a0f640 1 --2- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f2348041720 0x7f2348043b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:48.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.533+0000 7f2371a0f640 1 --2- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f2348041720 0x7f2348043b10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2360003a80 tx=0x7f23600092b0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:48.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.533+0000 7f23537fe640 1 -- 10.20.193.104:0/3690633563 <== mgr.14162 v2:10.20.193.104:6800/1034073782 1 ==== command_reply(tid 0: 0 ) ==== 8+0+8901 (secure 0 0 0) 0x7f2348040810 con 0x7f2348041720 2026-02-17T20:56:48.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.537+0000 7f237449b640 1 -- 10.20.193.104:0/3690633563 --> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f236c109d00 con 0x7f2348041720 2026-02-17T20:56:48.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.537+0000 7f23537fe640 1 -- 10.20.193.104:0/3690633563 <== mgr.14162 v2:10.20.193.104:6800/1034073782 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f236c109d00 con 0x7f2348041720 2026-02-17T20:56:48.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.537+0000 7f237449b640 1 -- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f2348041720 msgr2=0x7f2348043b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:48.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.537+0000 7f237449b640 1 --2- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f2348041720 0x7f2348043b10 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2360003a80 tx=0x7f23600092b0 comp rx=0 tx=0).stop 2026-02-17T20:56:48.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.537+0000 7f237449b640 1 -- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f236c109880 msgr2=0x7f236c19f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:48.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.537+0000 7f237449b640 1 --2- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f236c109880 0x7f236c19f700 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f235c002410 tx=0x7f235c0379e0 comp rx=0 tx=0).stop 2026-02-17T20:56:48.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.537+0000 7f237449b640 1 -- 10.20.193.104:0/3690633563 shutdown_connections 2026-02-17T20:56:48.655 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.537+0000 7f237449b640 1 --2- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f2348041720 0x7f2348043b10 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:48.656 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.537+0000 7f237449b640 1 --2- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:6800/95322277,v1:10.20.193.104:6801/95322277] conn(0x7f234803dc40 0x7f2348040100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:48.656 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.537+0000 7f237449b640 1 --2- 10.20.193.104:0/3690633563 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f236c109880 0x7f236c19f700 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:48.656 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.537+0000 7f237449b640 1 -- 10.20.193.104:0/3690633563 >> 10.20.193.104:0/3690633563 conn(0x7f236c07ce10 msgr2=0x7f236c106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:48.656 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.537+0000 7f237449b640 1 -- 10.20.193.104:0/3690633563 shutdown_connections 2026-02-17T20:56:48.656 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.537+0000 7f237449b640 1 -- 10.20.193.104:0/3690633563 wait complete. 2026-02-17T20:56:48.656 INFO:teuthology.orchestra.run.trial104.stdout:mgr epoch 9 is available 2026-02-17T20:56:48.656 INFO:teuthology.orchestra.run.trial104.stdout:Generating a dashboard self-signed certificate... 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.741+0000 7fdb7a8ef640 1 Processor -- start 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.741+0000 7fdb7a8ef640 1 -- start start 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.741+0000 7fdb7a8ef640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdb7407d720 0x7fdb7407bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.741+0000 7fdb7a8ef640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7407c110 con 0x7fdb7407d720 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.742+0000 7fdb798ed640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdb7407d720 0x7fdb7407bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.742+0000 7fdb798ed640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdb7407d720 0x7fdb7407bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:48272/0 (socket says 10.20.193.104:48272) 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.742+0000 7fdb798ed640 1 -- 10.20.193.104:0/450380015 learned_addr learned my addr 10.20.193.104:0/450380015 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.742+0000 7fdb798ed640 1 -- 10.20.193.104:0/450380015 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7407c290 con 0x7fdb7407d720 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.742+0000 7fdb798ed640 1 --2- 10.20.193.104:0/450380015 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdb7407d720 0x7fdb7407bbd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009920 tx=0x7fdb6402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f34408aa24ba58 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.742+0000 7fdb788eb640 1 -- 10.20.193.104:0/450380015 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fdb6403c070 con 0x7fdb7407d720 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.742+0000 7fdb788eb640 1 -- 10.20.193.104:0/450380015 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fdb6402fe20 con 0x7fdb7407d720 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.742+0000 7fdb788eb640 1 -- 10.20.193.104:0/450380015 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fdb64035340 con 0x7fdb7407d720 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.743+0000 7fdb7a8ef640 1 -- 10.20.193.104:0/450380015 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdb7407d720 msgr2=0x7fdb7407bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.743+0000 7fdb7a8ef640 1 --2- 10.20.193.104:0/450380015 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdb7407d720 0x7fdb7407bbd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb64009920 tx=0x7fdb6402ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.743+0000 7fdb7a8ef640 1 -- 10.20.193.104:0/450380015 shutdown_connections 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.743+0000 7fdb7a8ef640 1 --2- 10.20.193.104:0/450380015 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdb7407d720 0x7fdb7407bbd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.743+0000 7fdb7a8ef640 1 -- 10.20.193.104:0/450380015 >> 10.20.193.104:0/450380015 conn(0x7fdb74102c50 msgr2=0x7fdb74105070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.743+0000 7fdb7a8ef640 1 -- 10.20.193.104:0/450380015 shutdown_connections 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.743+0000 7fdb7a8ef640 1 -- 10.20.193.104:0/450380015 wait complete. 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.743+0000 7fdb7a8ef640 1 Processor -- start 2026-02-17T20:56:48.918 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.743+0000 7fdb7a8ef640 1 -- start start 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.743+0000 7fdb7a8ef640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdb7407d720 0x7fdb7419f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.743+0000 7fdb7a8ef640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7410da40 con 0x7fdb7407d720 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.743+0000 7fdb798ed640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdb7407d720 0x7fdb7419f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.743+0000 7fdb798ed640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdb7407d720 0x7fdb7419f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:48276/0 (socket says 10.20.193.104:48276) 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.743+0000 7fdb798ed640 1 -- 10.20.193.104:0/1740851110 learned_addr learned my addr 10.20.193.104:0/1740851110 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.743+0000 7fdb798ed640 1 -- 10.20.193.104:0/1740851110 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7419fa50 con 0x7fdb7407d720 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.744+0000 7fdb798ed640 1 --2- 10.20.193.104:0/1740851110 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdb7407d720 0x7fdb7419f510 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdb640091b0 tx=0x7fdb64037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.744+0000 7fdb62ffd640 1 -- 10.20.193.104:0/1740851110 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fdb640359a0 con 0x7fdb7407d720 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.744+0000 7fdb62ffd640 1 -- 10.20.193.104:0/1740851110 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fdb64043430 con 0x7fdb7407d720 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.744+0000 7fdb7a8ef640 1 -- 10.20.193.104:0/1740851110 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7419fce0 con 0x7fdb7407d720 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.744+0000 7fdb62ffd640 1 -- 10.20.193.104:0/1740851110 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fdb64042590 con 0x7fdb7407d720 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.744+0000 7fdb7a8ef640 1 -- 10.20.193.104:0/1740851110 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb741a29d0 con 0x7fdb7407d720 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.744+0000 7fdb7a8ef640 1 -- 10.20.193.104:0/1740851110 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb7407bc50 con 0x7fdb7407d720 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.744+0000 7fdb62ffd640 1 -- 10.20.193.104:0/1740851110 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 11) ==== 50168+0+0 (secure 0 0 0) 0x7fdb64035b40 con 0x7fdb7407d720 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.744+0000 7fdb62ffd640 1 --2- 10.20.193.104:0/1740851110 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fdb5003db20 0x7fdb5003ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.744+0000 7fdb62ffd640 1 -- 10.20.193.104:0/1740851110 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdb640766f0 con 0x7fdb7407d720 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.745+0000 7fdb790ec640 1 --2- 10.20.193.104:0/1740851110 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fdb5003db20 0x7fdb5003ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.745+0000 7fdb790ec640 1 --2- 10.20.193.104:0/1740851110 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fdb5003db20 0x7fdb5003ffe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdb680099c0 tx=0x7fdb68006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.749+0000 7fdb62ffd640 1 -- 10.20.193.104:0/1740851110 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fdb6404be10 con 0x7fdb7407d720 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.833+0000 7fdb7a8ef640 1 -- 10.20.193.104:0/1740851110 --> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fdb74103eb0 con 0x7fdb5003db20 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.892+0000 7fdb62ffd640 1 -- 10.20.193.104:0/1740851110 <== mgr.14162 v2:10.20.193.104:6800/1034073782 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fdb74103eb0 con 0x7fdb5003db20 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.894+0000 7fdb7a8ef640 1 -- 10.20.193.104:0/1740851110 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fdb5003db20 msgr2=0x7fdb5003ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.894+0000 7fdb7a8ef640 1 --2- 10.20.193.104:0/1740851110 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fdb5003db20 0x7fdb5003ffe0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdb680099c0 tx=0x7fdb68006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.894+0000 7fdb7a8ef640 1 -- 10.20.193.104:0/1740851110 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdb7407d720 msgr2=0x7fdb7419f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.894+0000 7fdb7a8ef640 1 --2- 10.20.193.104:0/1740851110 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdb7407d720 0x7fdb7419f510 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdb640091b0 tx=0x7fdb64037a50 comp rx=0 tx=0).stop 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.894+0000 7fdb7a8ef640 1 -- 10.20.193.104:0/1740851110 shutdown_connections 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.894+0000 7fdb7a8ef640 1 --2- 10.20.193.104:0/1740851110 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fdb5003db20 0x7fdb5003ffe0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.894+0000 7fdb7a8ef640 1 --2- 10.20.193.104:0/1740851110 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdb7407d720 0x7fdb7419f510 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.894+0000 7fdb7a8ef640 1 -- 10.20.193.104:0/1740851110 >> 10.20.193.104:0/1740851110 conn(0x7fdb74102c50 msgr2=0x7fdb741037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.894+0000 7fdb7a8ef640 1 -- 10.20.193.104:0/1740851110 shutdown_connections 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:48.894+0000 7fdb7a8ef640 1 -- 10.20.193.104:0/1740851110 wait complete. 2026-02-17T20:56:48.919 INFO:teuthology.orchestra.run.trial104.stdout:Creating initial admin user... 2026-02-17T20:56:49.274 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$77jbu8L.9oD4/nB83beAd.cEqTfBwJ4otgm11gHhmyGAJOd6Mij9i", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1771361809, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2026-02-17T20:56:49.274 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.009+0000 7f883871b640 1 Processor -- start 2026-02-17T20:56:49.275 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.009+0000 7f883871b640 1 -- start start 2026-02-17T20:56:49.275 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.009+0000 7f883871b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8830109880 0x7f8830109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:49.275 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.009+0000 7f883871b640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f883010a250 con 0x7f8830109880 2026-02-17T20:56:49.275 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.009+0000 7f8836490640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8830109880 0x7f8830109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:49.275 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.009+0000 7f8836490640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8830109880 0x7f8830109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:48284/0 (socket says 10.20.193.104:48284) 2026-02-17T20:56:49.275 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.009+0000 7f8836490640 1 -- 10.20.193.104:0/3300621878 learned_addr learned my addr 10.20.193.104:0/3300621878 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:49.275 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.009+0000 7f8836490640 1 -- 10.20.193.104:0/3300621878 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883010aa80 con 0x7f8830109880 2026-02-17T20:56:49.275 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.010+0000 7f8836490640 1 --2- 10.20.193.104:0/3300621878 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8830109880 0x7f8830109c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8820009920 tx=0x7f882002ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b73f9acf849db7a3 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:49.275 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.010+0000 7f883548e640 1 -- 10.20.193.104:0/3300621878 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f882003c070 con 0x7f8830109880 2026-02-17T20:56:49.275 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.010+0000 7f883548e640 1 -- 10.20.193.104:0/3300621878 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f882002fe20 con 0x7f8830109880 2026-02-17T20:56:49.276 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.010+0000 7f883548e640 1 -- 10.20.193.104:0/3300621878 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f8820035340 con 0x7f8830109880 2026-02-17T20:56:49.276 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.010+0000 7f883871b640 1 -- 10.20.193.104:0/3300621878 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8830109880 msgr2=0x7f8830109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:49.276 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.010+0000 7f883871b640 1 --2- 10.20.193.104:0/3300621878 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8830109880 0x7f8830109c80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8820009920 tx=0x7f882002ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:49.276 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.010+0000 7f883871b640 1 -- 10.20.193.104:0/3300621878 shutdown_connections 2026-02-17T20:56:49.276 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.010+0000 7f883871b640 1 --2- 10.20.193.104:0/3300621878 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8830109880 0x7f8830109c80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:49.276 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.010+0000 7f883871b640 1 -- 10.20.193.104:0/3300621878 >> 10.20.193.104:0/3300621878 conn(0x7f883007ce10 msgr2=0x7f883007d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:49.276 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.010+0000 7f883871b640 1 -- 10.20.193.104:0/3300621878 shutdown_connections 2026-02-17T20:56:49.276 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.010+0000 7f883871b640 1 -- 10.20.193.104:0/3300621878 wait complete. 2026-02-17T20:56:49.276 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.011+0000 7f883871b640 1 Processor -- start 2026-02-17T20:56:49.276 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.011+0000 7f883871b640 1 -- start start 2026-02-17T20:56:49.276 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.011+0000 7f883871b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8830109880 0x7f883019f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:49.276 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.011+0000 7f883871b640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f883010dcb0 con 0x7f8830109880 2026-02-17T20:56:49.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.011+0000 7f8836490640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8830109880 0x7f883019f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:49.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.011+0000 7f8836490640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8830109880 0x7f883019f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:48294/0 (socket says 10.20.193.104:48294) 2026-02-17T20:56:49.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.011+0000 7f8836490640 1 -- 10.20.193.104:0/2798922139 learned_addr learned my addr 10.20.193.104:0/2798922139 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:49.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.011+0000 7f8836490640 1 -- 10.20.193.104:0/2798922139 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f883019fc70 con 0x7f8830109880 2026-02-17T20:56:49.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.011+0000 7f8836490640 1 --2- 10.20.193.104:0/2798922139 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8830109880 0x7f883019f730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f88200091b0 tx=0x7f8820037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:49.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.011+0000 7f88177fe640 1 -- 10.20.193.104:0/2798922139 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f88200359a0 con 0x7f8830109880 2026-02-17T20:56:49.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.011+0000 7f88177fe640 1 -- 10.20.193.104:0/2798922139 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f8820043430 con 0x7f8830109880 2026-02-17T20:56:49.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.011+0000 7f883871b640 1 -- 10.20.193.104:0/2798922139 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f883019ff00 con 0x7f8830109880 2026-02-17T20:56:49.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.011+0000 7f88177fe640 1 -- 10.20.193.104:0/2798922139 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f8820042590 con 0x7f8830109880 2026-02-17T20:56:49.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.011+0000 7f883871b640 1 -- 10.20.193.104:0/2798922139 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88301a2bf0 con 0x7f8830109880 2026-02-17T20:56:49.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.012+0000 7f883871b640 1 -- 10.20.193.104:0/2798922139 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8830109d00 con 0x7f8830109880 2026-02-17T20:56:49.277 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.012+0000 7f88177fe640 1 -- 10.20.193.104:0/2798922139 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 11) ==== 50168+0+0 (secure 0 0 0) 0x7f8820035b40 con 0x7f8830109880 2026-02-17T20:56:49.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.012+0000 7f88177fe640 1 --2- 10.20.193.104:0/2798922139 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f880c03dad0 0x7f880c03ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:49.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.012+0000 7f88177fe640 1 -- 10.20.193.104:0/2798922139 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8820076600 con 0x7f8830109880 2026-02-17T20:56:49.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.012+0000 7f8835c8f640 1 --2- 10.20.193.104:0/2798922139 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f880c03dad0 0x7f880c03ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:49.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.012+0000 7f8835c8f640 1 --2- 10.20.193.104:0/2798922139 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f880c03dad0 0x7f880c03ff90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f88240099c0 tx=0x7f8824006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:49.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.015+0000 7f88177fe640 1 -- 10.20.193.104:0/2798922139 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f882004bde0 con 0x7f8830109880 2026-02-17T20:56:49.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.104+0000 7f883871b640 1 -- 10.20.193.104:0/2798922139 --> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f88301076c0 con 0x7f880c03dad0 2026-02-17T20:56:49.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.246+0000 7f88177fe640 1 -- 10.20.193.104:0/2798922139 <== mgr.14162 v2:10.20.193.104:6800/1034073782 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f88301076c0 con 0x7f880c03dad0 2026-02-17T20:56:49.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.247+0000 7f883871b640 1 -- 10.20.193.104:0/2798922139 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f880c03dad0 msgr2=0x7f880c03ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:49.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.247+0000 7f883871b640 1 --2- 10.20.193.104:0/2798922139 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f880c03dad0 0x7f880c03ff90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f88240099c0 tx=0x7f8824006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:49.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.247+0000 7f883871b640 1 -- 10.20.193.104:0/2798922139 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8830109880 msgr2=0x7f883019f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:49.278 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.247+0000 7f883871b640 1 --2- 10.20.193.104:0/2798922139 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8830109880 0x7f883019f730 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f88200091b0 tx=0x7f8820037a50 comp rx=0 tx=0).stop 2026-02-17T20:56:49.279 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.247+0000 7f883871b640 1 -- 10.20.193.104:0/2798922139 shutdown_connections 2026-02-17T20:56:49.279 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.247+0000 7f883871b640 1 --2- 10.20.193.104:0/2798922139 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f880c03dad0 0x7f880c03ff90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:49.279 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.247+0000 7f883871b640 1 --2- 10.20.193.104:0/2798922139 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8830109880 0x7f883019f730 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:49.279 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.247+0000 7f883871b640 1 -- 10.20.193.104:0/2798922139 >> 10.20.193.104:0/2798922139 conn(0x7f883007ce10 msgr2=0x7f8830106fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:49.279 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.247+0000 7f883871b640 1 -- 10.20.193.104:0/2798922139 shutdown_connections 2026-02-17T20:56:49.279 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.247+0000 7f883871b640 1 -- 10.20.193.104:0/2798922139 wait complete. 2026-02-17T20:56:49.279 INFO:teuthology.orchestra.run.trial104.stdout:Fetching dashboard port number... 2026-02-17T20:56:49.369 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:49 trial104 ceph-mon[20612]: [17/Feb/2026:20:56:48] ENGINE Bus STARTING 2026-02-17T20:56:49.369 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:49 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:49.369 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:49 trial104 ceph-mon[20612]: [17/Feb/2026:20:56:48] ENGINE Serving on http://10.20.193.104:8765 2026-02-17T20:56:49.369 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:49 trial104 ceph-mon[20612]: [17/Feb/2026:20:56:48] ENGINE Serving on https://10.20.193.104:7150 2026-02-17T20:56:49.370 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:49 trial104 ceph-mon[20612]: [17/Feb/2026:20:56:48] ENGINE Bus STARTED 2026-02-17T20:56:49.370 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:49 trial104 ceph-mon[20612]: [17/Feb/2026:20:56:48] ENGINE Client ('10.20.193.104', 44882) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-17T20:56:49.370 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:49 trial104 ceph-mon[20612]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-17T20:56:49.370 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:49 trial104 ceph-mon[20612]: mgrmap e11: trial104.irrhmt(active, since 1.00474s) 2026-02-17T20:56:49.370 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:49 trial104 ceph-mon[20612]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-17T20:56:49.370 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:49 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:49.370 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:49 trial104 ceph-mon[20612]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:49.370 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:49 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:49.370 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:49 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:49.370 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:49 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:49.482 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stdout 8443 2026-02-17T20:56:49.482 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.366+0000 7f227b0e6640 1 Processor -- start 2026-02-17T20:56:49.483 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.366+0000 7f227b0e6640 1 -- start start 2026-02-17T20:56:49.483 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.366+0000 7f227b0e6640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f22741096c0 0x7f2274109ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:49.483 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.366+0000 7f227b0e6640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f227410a090 con 0x7f22741096c0 2026-02-17T20:56:49.483 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.366+0000 7f227a0e4640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f22741096c0 0x7f2274109ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:49.483 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.366+0000 7f227a0e4640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f22741096c0 0x7f2274109ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:48296/0 (socket says 10.20.193.104:48296) 2026-02-17T20:56:49.483 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.366+0000 7f227a0e4640 1 -- 10.20.193.104:0/3072411359 learned_addr learned my addr 10.20.193.104:0/3072411359 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:49.483 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.366+0000 7f227a0e4640 1 -- 10.20.193.104:0/3072411359 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227410a8c0 con 0x7f22741096c0 2026-02-17T20:56:49.483 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.367+0000 7f227a0e4640 1 --2- 10.20.193.104:0/3072411359 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f22741096c0 0x7f2274109ac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2264009920 tx=0x7f226402ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eefba3c4598eab93 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:49.484 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.367+0000 7f22790e2640 1 -- 10.20.193.104:0/3072411359 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f226403c070 con 0x7f22741096c0 2026-02-17T20:56:49.484 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.367+0000 7f22790e2640 1 -- 10.20.193.104:0/3072411359 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f226402fe20 con 0x7f22741096c0 2026-02-17T20:56:49.484 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.367+0000 7f22790e2640 1 -- 10.20.193.104:0/3072411359 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f2264035340 con 0x7f22741096c0 2026-02-17T20:56:49.484 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.367+0000 7f227b0e6640 1 -- 10.20.193.104:0/3072411359 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f22741096c0 msgr2=0x7f2274109ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:49.484 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.367+0000 7f227b0e6640 1 --2- 10.20.193.104:0/3072411359 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f22741096c0 0x7f2274109ac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2264009920 tx=0x7f226402ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:49.484 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.367+0000 7f227b0e6640 1 -- 10.20.193.104:0/3072411359 shutdown_connections 2026-02-17T20:56:49.484 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.367+0000 7f227b0e6640 1 --2- 10.20.193.104:0/3072411359 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f22741096c0 0x7f2274109ac0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:49.484 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.367+0000 7f227b0e6640 1 -- 10.20.193.104:0/3072411359 >> 10.20.193.104:0/3072411359 conn(0x7f227407cbf0 msgr2=0x7f227407d000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:49.484 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.367+0000 7f227b0e6640 1 -- 10.20.193.104:0/3072411359 shutdown_connections 2026-02-17T20:56:49.484 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.367+0000 7f227b0e6640 1 -- 10.20.193.104:0/3072411359 wait complete. 2026-02-17T20:56:49.484 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.368+0000 7f227b0e6640 1 Processor -- start 2026-02-17T20:56:49.485 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.368+0000 7f227b0e6640 1 -- start start 2026-02-17T20:56:49.485 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.368+0000 7f227b0e6640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f22741096c0 0x7f227419f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:49.485 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.368+0000 7f227b0e6640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f227410daf0 con 0x7f22741096c0 2026-02-17T20:56:49.485 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.368+0000 7f227a0e4640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f22741096c0 0x7f227419f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:49.485 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.368+0000 7f227a0e4640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f22741096c0 0x7f227419f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:48304/0 (socket says 10.20.193.104:48304) 2026-02-17T20:56:49.485 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.368+0000 7f227a0e4640 1 -- 10.20.193.104:0/1119303616 learned_addr learned my addr 10.20.193.104:0/1119303616 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:49.485 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.368+0000 7f227a0e4640 1 -- 10.20.193.104:0/1119303616 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227419fac0 con 0x7f22741096c0 2026-02-17T20:56:49.485 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.368+0000 7f227a0e4640 1 --2- 10.20.193.104:0/1119303616 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f22741096c0 0x7f227419f580 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f22640091b0 tx=0x7f2264037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:49.485 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.368+0000 7f225b7fe640 1 -- 10.20.193.104:0/1119303616 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f22640359a0 con 0x7f22741096c0 2026-02-17T20:56:49.485 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.368+0000 7f227b0e6640 1 -- 10.20.193.104:0/1119303616 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227419fd50 con 0x7f22741096c0 2026-02-17T20:56:49.485 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.368+0000 7f225b7fe640 1 -- 10.20.193.104:0/1119303616 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f2264043430 con 0x7f22741096c0 2026-02-17T20:56:49.485 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.368+0000 7f225b7fe640 1 -- 10.20.193.104:0/1119303616 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f2264042590 con 0x7f22741096c0 2026-02-17T20:56:49.485 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.368+0000 7f227b0e6640 1 -- 10.20.193.104:0/1119303616 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22741a2a40 con 0x7f22741096c0 2026-02-17T20:56:49.486 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.369+0000 7f227b0e6640 1 -- 10.20.193.104:0/1119303616 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2274109b40 con 0x7f22741096c0 2026-02-17T20:56:49.486 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.369+0000 7f225b7fe640 1 -- 10.20.193.104:0/1119303616 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 11) ==== 50168+0+0 (secure 0 0 0) 0x7f2264035b40 con 0x7f22741096c0 2026-02-17T20:56:49.486 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.369+0000 7f225b7fe640 1 --2- 10.20.193.104:0/1119303616 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f225003dad0 0x7f225003ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:49.486 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.369+0000 7f225b7fe640 1 -- 10.20.193.104:0/1119303616 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2264076610 con 0x7f22741096c0 2026-02-17T20:56:49.486 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.369+0000 7f22798e3640 1 --2- 10.20.193.104:0/1119303616 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f225003dad0 0x7f225003ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:49.486 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.370+0000 7f22798e3640 1 --2- 10.20.193.104:0/1119303616 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f225003dad0 0x7f225003ff90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f22680099c0 tx=0x7f2268006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:49.486 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.372+0000 7f225b7fe640 1 -- 10.20.193.104:0/1119303616 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f226402fdf0 con 0x7f22741096c0 2026-02-17T20:56:49.486 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.456+0000 7f227b0e6640 1 -- 10.20.193.104:0/1119303616 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f22741a31a0 con 0x7f22741096c0 2026-02-17T20:56:49.486 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.456+0000 7f225b7fe640 1 -- 10.20.193.104:0/1119303616 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f22640471c0 con 0x7f22741096c0 2026-02-17T20:56:49.486 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.457+0000 7f227b0e6640 1 -- 10.20.193.104:0/1119303616 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f225003dad0 msgr2=0x7f225003ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:49.486 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.457+0000 7f227b0e6640 1 --2- 10.20.193.104:0/1119303616 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f225003dad0 0x7f225003ff90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f22680099c0 tx=0x7f2268006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:49.487 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.457+0000 7f227b0e6640 1 -- 10.20.193.104:0/1119303616 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f22741096c0 msgr2=0x7f227419f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:49.487 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.457+0000 7f227b0e6640 1 --2- 10.20.193.104:0/1119303616 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f22741096c0 0x7f227419f580 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f22640091b0 tx=0x7f2264037a50 comp rx=0 tx=0).stop 2026-02-17T20:56:49.487 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.457+0000 7f227b0e6640 1 -- 10.20.193.104:0/1119303616 shutdown_connections 2026-02-17T20:56:49.487 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.457+0000 7f227b0e6640 1 --2- 10.20.193.104:0/1119303616 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f225003dad0 0x7f225003ff90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:49.487 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.457+0000 7f227b0e6640 1 --2- 10.20.193.104:0/1119303616 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f22741096c0 0x7f227419f580 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:49.487 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.457+0000 7f227b0e6640 1 -- 10.20.193.104:0/1119303616 >> 10.20.193.104:0/1119303616 conn(0x7f227407cbf0 msgr2=0x7f22741070e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:49.487 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.457+0000 7f227b0e6640 1 -- 10.20.193.104:0/1119303616 shutdown_connections 2026-02-17T20:56:49.487 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.457+0000 7f227b0e6640 1 -- 10.20.193.104:0/1119303616 wait complete. 2026-02-17T20:56:49.488 INFO:teuthology.orchestra.run.trial104.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-17T20:56:49.488 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stdout disabled 2026-02-17T20:56:49.492 INFO:teuthology.orchestra.run.trial104.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-17T20:56:49.492 INFO:teuthology.orchestra.run.trial104.stdout:systemctl: stdout inactive 2026-02-17T20:56:49.493 INFO:teuthology.orchestra.run.trial104.stdout:firewalld.service is not enabled 2026-02-17T20:56:49.493 INFO:teuthology.orchestra.run.trial104.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2026-02-17T20:56:49.494 INFO:teuthology.orchestra.run.trial104.stdout:Ceph Dashboard is now available at: 2026-02-17T20:56:49.494 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:49.494 INFO:teuthology.orchestra.run.trial104.stdout: URL: https://trial104:8443/ 2026-02-17T20:56:49.494 INFO:teuthology.orchestra.run.trial104.stdout: User: admin 2026-02-17T20:56:49.494 INFO:teuthology.orchestra.run.trial104.stdout: Password: yuyukyksey 2026-02-17T20:56:49.494 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:49.494 INFO:teuthology.orchestra.run.trial104.stdout:Saving cluster configuration to /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/config directory 2026-02-17T20:56:49.745 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.586+0000 7f065da27640 1 Processor -- start 2026-02-17T20:56:49.746 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.587+0000 7f065da27640 1 -- start start 2026-02-17T20:56:49.746 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.587+0000 7f065da27640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0658109880 0x7f0658109c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:49.746 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.587+0000 7f065da27640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f065810a250 con 0x7f0658109880 2026-02-17T20:56:49.746 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.587+0000 7f0656ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0658109880 0x7f0658109c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:49.746 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.587+0000 7f0656ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0658109880 0x7f0658109c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:48318/0 (socket says 10.20.193.104:48318) 2026-02-17T20:56:49.746 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.587+0000 7f0656ffd640 1 -- 10.20.193.104:0/2414972063 learned_addr learned my addr 10.20.193.104:0/2414972063 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:49.746 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.587+0000 7f0656ffd640 1 -- 10.20.193.104:0/2414972063 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065810aa80 con 0x7f0658109880 2026-02-17T20:56:49.746 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.587+0000 7f0656ffd640 1 --2- 10.20.193.104:0/2414972063 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0658109880 0x7f0658109c80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f064c009920 tx=0x7f064c02ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73ca4c09fd66a38 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:49.746 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.588+0000 7f0655ffb640 1 -- 10.20.193.104:0/2414972063 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f064c03c070 con 0x7f0658109880 2026-02-17T20:56:49.747 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.588+0000 7f0655ffb640 1 -- 10.20.193.104:0/2414972063 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f064c02fe20 con 0x7f0658109880 2026-02-17T20:56:49.747 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.588+0000 7f0655ffb640 1 -- 10.20.193.104:0/2414972063 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f064c035340 con 0x7f0658109880 2026-02-17T20:56:49.747 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.588+0000 7f065da27640 1 -- 10.20.193.104:0/2414972063 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0658109880 msgr2=0x7f0658109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:49.747 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.588+0000 7f065da27640 1 --2- 10.20.193.104:0/2414972063 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0658109880 0x7f0658109c80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f064c009920 tx=0x7f064c02ef20 comp rx=0 tx=0).stop 2026-02-17T20:56:49.747 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.588+0000 7f065da27640 1 -- 10.20.193.104:0/2414972063 shutdown_connections 2026-02-17T20:56:49.747 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.588+0000 7f065da27640 1 --2- 10.20.193.104:0/2414972063 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0658109880 0x7f0658109c80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:49.747 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.588+0000 7f065da27640 1 -- 10.20.193.104:0/2414972063 >> 10.20.193.104:0/2414972063 conn(0x7f065807ce10 msgr2=0x7f065807d220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:49.747 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.588+0000 7f065da27640 1 -- 10.20.193.104:0/2414972063 shutdown_connections 2026-02-17T20:56:49.747 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.588+0000 7f065da27640 1 -- 10.20.193.104:0/2414972063 wait complete. 2026-02-17T20:56:49.747 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.588+0000 7f065da27640 1 Processor -- start 2026-02-17T20:56:49.747 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.588+0000 7f065da27640 1 -- start start 2026-02-17T20:56:49.747 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.588+0000 7f065da27640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0658109880 0x7f065819f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:49.748 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.588+0000 7f065da27640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f065810dcb0 con 0x7f0658109880 2026-02-17T20:56:49.748 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.589+0000 7f0656ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0658109880 0x7f065819f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:49.748 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.589+0000 7f0656ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0658109880 0x7f065819f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:48330/0 (socket says 10.20.193.104:48330) 2026-02-17T20:56:49.748 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.589+0000 7f0656ffd640 1 -- 10.20.193.104:0/3938002635 learned_addr learned my addr 10.20.193.104:0/3938002635 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:49.748 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.589+0000 7f0656ffd640 1 -- 10.20.193.104:0/3938002635 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f065819fc40 con 0x7f0658109880 2026-02-17T20:56:49.748 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.589+0000 7f0656ffd640 1 --2- 10.20.193.104:0/3938002635 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0658109880 0x7f065819f700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f064c0091b0 tx=0x7f064c037a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:49.748 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.589+0000 7f065ca25640 1 -- 10.20.193.104:0/3938002635 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f064c0359a0 con 0x7f0658109880 2026-02-17T20:56:49.748 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.589+0000 7f065ca25640 1 -- 10.20.193.104:0/3938002635 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f064c043430 con 0x7f0658109880 2026-02-17T20:56:49.748 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.589+0000 7f065da27640 1 -- 10.20.193.104:0/3938002635 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f065819fed0 con 0x7f0658109880 2026-02-17T20:56:49.748 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.589+0000 7f065ca25640 1 -- 10.20.193.104:0/3938002635 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f064c042590 con 0x7f0658109880 2026-02-17T20:56:49.748 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.589+0000 7f065da27640 1 -- 10.20.193.104:0/3938002635 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06581a2bc0 con 0x7f0658109880 2026-02-17T20:56:49.748 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.589+0000 7f065da27640 1 -- 10.20.193.104:0/3938002635 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0658109d00 con 0x7f0658109880 2026-02-17T20:56:49.749 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.589+0000 7f065ca25640 1 -- 10.20.193.104:0/3938002635 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 11) ==== 50168+0+0 (secure 0 0 0) 0x7f064c035b40 con 0x7f0658109880 2026-02-17T20:56:49.749 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.590+0000 7f065ca25640 1 --2- 10.20.193.104:0/3938002635 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f062c03db20 0x7f062c03ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:49.749 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.590+0000 7f065ca25640 1 -- 10.20.193.104:0/3938002635 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f064c0765c0 con 0x7f0658109880 2026-02-17T20:56:49.749 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.590+0000 7f06567fc640 1 --2- 10.20.193.104:0/3938002635 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f062c03db20 0x7f062c03ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:49.749 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.590+0000 7f06567fc640 1 --2- 10.20.193.104:0/3938002635 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f062c03db20 0x7f062c03ffe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f06400099c0 tx=0x7f0640006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:49.749 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.592+0000 7f065ca25640 1 -- 10.20.193.104:0/3938002635 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f064c02fdf0 con 0x7f0658109880 2026-02-17T20:56:49.749 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.715+0000 7f065da27640 1 -- 10.20.193.104:0/3938002635 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f06581a3320 con 0x7f0658109880 2026-02-17T20:56:49.749 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.717+0000 7f065ca25640 1 -- 10.20.193.104:0/3938002635 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) ==== 153+0+0 (secure 0 0 0) 0x7f064c0471c0 con 0x7f0658109880 2026-02-17T20:56:49.749 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-17T20:56:49.749 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.718+0000 7f065da27640 1 -- 10.20.193.104:0/3938002635 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f062c03db20 msgr2=0x7f062c03ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:49.749 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.718+0000 7f065da27640 1 --2- 10.20.193.104:0/3938002635 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f062c03db20 0x7f062c03ffe0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f06400099c0 tx=0x7f0640006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:49.749 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.718+0000 7f065da27640 1 -- 10.20.193.104:0/3938002635 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0658109880 msgr2=0x7f065819f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:49.750 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.718+0000 7f065da27640 1 --2- 10.20.193.104:0/3938002635 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0658109880 0x7f065819f700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f064c0091b0 tx=0x7f064c037a50 comp rx=0 tx=0).stop 2026-02-17T20:56:49.750 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.718+0000 7f065da27640 1 -- 10.20.193.104:0/3938002635 shutdown_connections 2026-02-17T20:56:49.750 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.718+0000 7f065da27640 1 --2- 10.20.193.104:0/3938002635 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f062c03db20 0x7f062c03ffe0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:49.750 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.718+0000 7f065da27640 1 --2- 10.20.193.104:0/3938002635 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0658109880 0x7f065819f700 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:49.750 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.718+0000 7f065da27640 1 -- 10.20.193.104:0/3938002635 >> 10.20.193.104:0/3938002635 conn(0x7f065807ce10 msgr2=0x7f0658106fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:49.750 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.718+0000 7f065da27640 1 -- 10.20.193.104:0/3938002635 shutdown_connections 2026-02-17T20:56:49.750 INFO:teuthology.orchestra.run.trial104.stdout:/usr/bin/ceph: stderr 2026-02-17T20:56:49.718+0000 7f065da27640 1 -- 10.20.193.104:0/3938002635 wait complete. 2026-02-17T20:56:49.750 INFO:teuthology.orchestra.run.trial104.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-17T20:56:49.750 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:49.750 INFO:teuthology.orchestra.run.trial104.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-17T20:56:49.750 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:49.750 INFO:teuthology.orchestra.run.trial104.stdout:Or, if you are only running a single cluster on this host: 2026-02-17T20:56:49.751 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:49.751 INFO:teuthology.orchestra.run.trial104.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-17T20:56:49.751 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:49.751 INFO:teuthology.orchestra.run.trial104.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-17T20:56:49.751 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:49.751 INFO:teuthology.orchestra.run.trial104.stdout: ceph telemetry on 2026-02-17T20:56:49.751 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:49.751 INFO:teuthology.orchestra.run.trial104.stdout:For more information see: 2026-02-17T20:56:49.751 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:49.751 INFO:teuthology.orchestra.run.trial104.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-17T20:56:49.751 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:49.751 INFO:teuthology.orchestra.run.trial104.stdout:Bootstrap complete. 2026-02-17T20:56:49.769 INFO:tasks.cephadm:Fetching config... 2026-02-17T20:56:49.769 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:56:49.770 DEBUG:teuthology.orchestra.run.trial104:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-17T20:56:49.786 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-17T20:56:49.786 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:56:49.786 DEBUG:teuthology.orchestra.run.trial104:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-17T20:56:49.843 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-17T20:56:49.843 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:56:49.843 DEBUG:teuthology.orchestra.run.trial104:> sudo dd if=/var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/keyring of=/dev/stdout 2026-02-17T20:56:49.908 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-17T20:56:49.909 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:56:49.909 DEBUG:teuthology.orchestra.run.trial104:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-17T20:56:49.966 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-17T20:56:49.967 DEBUG:teuthology.orchestra.run.trial104:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIImI2L+o0ji8Im7mc2JR6VgNQuU9fY1v/gM8drT4CXLP ceph-19072504-0c43-11f1-93a3-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-17T20:56:50.039 INFO:teuthology.orchestra.run.trial104.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIImI2L+o0ji8Im7mc2JR6VgNQuU9fY1v/gM8drT4CXLP ceph-19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T20:56:50.049 DEBUG:teuthology.orchestra.run.trial153:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIImI2L+o0ji8Im7mc2JR6VgNQuU9fY1v/gM8drT4CXLP ceph-19072504-0c43-11f1-93a3-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-17T20:56:50.085 INFO:teuthology.orchestra.run.trial153.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIImI2L+o0ji8Im7mc2JR6VgNQuU9fY1v/gM8drT4CXLP ceph-19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T20:56:50.095 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-17T20:56:50.242 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:56:50.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.348+0000 7f00b9e39640 1 -- 10.20.193.104:0/3037255334 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f00b406b540 msgr2=0x7f00b4107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:50.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.348+0000 7f00b9e39640 1 --2- 10.20.193.104:0/3037255334 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f00b406b540 0x7f00b4107340 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f00a00099b0 tx=0x7f00a002f2b0 comp rx=0 tx=0).stop 2026-02-17T20:56:50.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.348+0000 7f00b9e39640 1 -- 10.20.193.104:0/3037255334 shutdown_connections 2026-02-17T20:56:50.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.348+0000 7f00b9e39640 1 --2- 10.20.193.104:0/3037255334 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f00b406b540 0x7f00b4107340 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:50.353 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.348+0000 7f00b9e39640 1 -- 10.20.193.104:0/3037255334 >> 10.20.193.104:0/3037255334 conn(0x7f00b40fc9d0 msgr2=0x7f00b40fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.348+0000 7f00b9e39640 1 -- 10.20.193.104:0/3037255334 shutdown_connections 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.348+0000 7f00b9e39640 1 -- 10.20.193.104:0/3037255334 wait complete. 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.349+0000 7f00b9e39640 1 Processor -- start 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.349+0000 7f00b9e39640 1 -- start start 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.349+0000 7f00b9e39640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f00b406b540 0x7f00b419ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.349+0000 7f00b9e39640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f00b410a410 con 0x7f00b406b540 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.349+0000 7f00b37fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f00b406b540 0x7f00b419ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.349+0000 7f00b37fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f00b406b540 0x7f00b419ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:48340/0 (socket says 10.20.193.104:48340) 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.349+0000 7f00b37fe640 1 -- 10.20.193.104:0/2614235953 learned_addr learned my addr 10.20.193.104:0/2614235953 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.349+0000 7f00b37fe640 1 -- 10.20.193.104:0/2614235953 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b419bf90 con 0x7f00b406b540 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.349+0000 7f00b37fe640 1 --2- 10.20.193.104:0/2614235953 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f00b406b540 0x7f00b419ba50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f00a0005ec0 tx=0x7f00a0004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.349+0000 7f00b0ff9640 1 -- 10.20.193.104:0/2614235953 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f00a0002820 con 0x7f00b406b540 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.349+0000 7f00b9e39640 1 -- 10.20.193.104:0/2614235953 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b419c220 con 0x7f00b406b540 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.349+0000 7f00b0ff9640 1 -- 10.20.193.104:0/2614235953 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f00a0046070 con 0x7f00b406b540 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.349+0000 7f00b0ff9640 1 -- 10.20.193.104:0/2614235953 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f00a00417b0 con 0x7f00b406b540 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.349+0000 7f00b9e39640 1 -- 10.20.193.104:0/2614235953 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b419ef10 con 0x7f00b406b540 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.350+0000 7f00b9e39640 1 -- 10.20.193.104:0/2614235953 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b410abb0 con 0x7f00b406b540 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.350+0000 7f00b0ff9640 1 -- 10.20.193.104:0/2614235953 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 12) ==== 50274+0+0 (secure 0 0 0) 0x7f00a0038770 con 0x7f00b406b540 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.350+0000 7f00b0ff9640 1 --2- 10.20.193.104:0/2614235953 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f008803dbf0 0x7f00880400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.350+0000 7f00b0ff9640 1 -- 10.20.193.104:0/2614235953 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f00a0077060 con 0x7f00b406b540 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.350+0000 7f00b2ffd640 1 --2- 10.20.193.104:0/2614235953 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f008803dbf0 0x7f00880400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:50.354 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.350+0000 7f00b2ffd640 1 --2- 10.20.193.104:0/2614235953 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f008803dbf0 0x7f00880400b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f00a40099c0 tx=0x7f00a4006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:50.355 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.353+0000 7f00b0ff9640 1 -- 10.20.193.104:0/2614235953 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f00a0040360 con 0x7f00b406b540 2026-02-17T20:56:50.439 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.436+0000 7f00b9e39640 1 -- 10.20.193.104:0/2614235953 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f00b4194ef0 con 0x7f00b406b540 2026-02-17T20:56:50.440 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.438+0000 7f00b0ff9640 1 -- 10.20.193.104:0/2614235953 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f00a0049360 con 0x7f00b406b540 2026-02-17T20:56:50.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.440+0000 7f00b9e39640 1 -- 10.20.193.104:0/2614235953 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f008803dbf0 msgr2=0x7f00880400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:50.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.440+0000 7f00b9e39640 1 --2- 10.20.193.104:0/2614235953 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f008803dbf0 0x7f00880400b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f00a40099c0 tx=0x7f00a4006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:50.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.440+0000 7f00b9e39640 1 -- 10.20.193.104:0/2614235953 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f00b406b540 msgr2=0x7f00b419ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:50.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.440+0000 7f00b9e39640 1 --2- 10.20.193.104:0/2614235953 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f00b406b540 0x7f00b419ba50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f00a0005ec0 tx=0x7f00a0004290 comp rx=0 tx=0).stop 2026-02-17T20:56:50.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.440+0000 7f00b9e39640 1 -- 10.20.193.104:0/2614235953 shutdown_connections 2026-02-17T20:56:50.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.440+0000 7f00b9e39640 1 --2- 10.20.193.104:0/2614235953 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f008803dbf0 0x7f00880400b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:50.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.440+0000 7f00b9e39640 1 --2- 10.20.193.104:0/2614235953 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f00b406b540 0x7f00b419ba50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:50.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.440+0000 7f00b9e39640 1 -- 10.20.193.104:0/2614235953 >> 10.20.193.104:0/2614235953 conn(0x7f00b40fc9d0 msgr2=0x7f00b40fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:50.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.440+0000 7f00b9e39640 1 -- 10.20.193.104:0/2614235953 shutdown_connections 2026-02-17T20:56:50.443 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.440+0000 7f00b9e39640 1 -- 10.20.193.104:0/2614235953 wait complete. 2026-02-17T20:56:50.495 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-17T20:56:50.495 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-17T20:56:50.619 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:50 trial104 ceph-mon[20612]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:50.619 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:50 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/1119303616' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2026-02-17T20:56:50.619 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:50 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3938002635' entity='client.admin' 2026-02-17T20:56:50.644 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.749+0000 7f143482c640 1 -- 10.20.193.104:0/4237280037 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f142c06b740 msgr2=0x7f142c104f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.749+0000 7f143482c640 1 --2- 10.20.193.104:0/4237280037 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f142c06b740 0x7f142c104f00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f14240099b0 tx=0x7f142402f2b0 comp rx=0 tx=0).stop 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.749+0000 7f143482c640 1 -- 10.20.193.104:0/4237280037 shutdown_connections 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.749+0000 7f143482c640 1 --2- 10.20.193.104:0/4237280037 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f142c06b740 0x7f142c104f00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.749+0000 7f143482c640 1 -- 10.20.193.104:0/4237280037 >> 10.20.193.104:0/4237280037 conn(0x7f142c0fc9d0 msgr2=0x7f142c0fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.749+0000 7f143482c640 1 -- 10.20.193.104:0/4237280037 shutdown_connections 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.749+0000 7f143482c640 1 -- 10.20.193.104:0/4237280037 wait complete. 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.749+0000 7f143482c640 1 Processor -- start 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.749+0000 7f143482c640 1 -- start start 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.750+0000 7f143482c640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f142c06b740 0x7f142c1026f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.750+0000 7f143482c640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f142c108180 con 0x7f142c06b740 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.750+0000 7f14325a1640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f142c06b740 0x7f142c1026f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.750+0000 7f14325a1640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f142c06b740 0x7f142c1026f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:48360/0 (socket says 10.20.193.104:48360) 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.750+0000 7f14325a1640 1 -- 10.20.193.104:0/2740852220 learned_addr learned my addr 10.20.193.104:0/2740852220 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.750+0000 7f14325a1640 1 -- 10.20.193.104:0/2740852220 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142c102c30 con 0x7f142c06b740 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.750+0000 7f14325a1640 1 --2- 10.20.193.104:0/2740852220 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f142c06b740 0x7f142c1026f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1424005ec0 tx=0x7f1424004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.750+0000 7f14177fe640 1 -- 10.20.193.104:0/2740852220 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f1424002820 con 0x7f142c06b740 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.750+0000 7f14177fe640 1 -- 10.20.193.104:0/2740852220 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f1424046070 con 0x7f142c06b740 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.750+0000 7f143482c640 1 -- 10.20.193.104:0/2740852220 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f142c100e20 con 0x7f142c06b740 2026-02-17T20:56:50.753 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.750+0000 7f14177fe640 1 -- 10.20.193.104:0/2740852220 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f14240417b0 con 0x7f142c06b740 2026-02-17T20:56:50.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.750+0000 7f143482c640 1 -- 10.20.193.104:0/2740852220 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f142c101300 con 0x7f142c06b740 2026-02-17T20:56:50.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.751+0000 7f14177fe640 1 -- 10.20.193.104:0/2740852220 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 12) ==== 50274+0+0 (secure 0 0 0) 0x7f1424038770 con 0x7f142c06b740 2026-02-17T20:56:50.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.750+0000 7f143482c640 1 -- 10.20.193.104:0/2740852220 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f142c108920 con 0x7f142c06b740 2026-02-17T20:56:50.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.751+0000 7f14177fe640 1 --2- 10.20.193.104:0/2740852220 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f140803dc40 0x7f1408040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:50.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.751+0000 7f14177fe640 1 -- 10.20.193.104:0/2740852220 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1424076fd0 con 0x7f142c06b740 2026-02-17T20:56:50.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.751+0000 7f1431da0640 1 --2- 10.20.193.104:0/2740852220 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f140803dc40 0x7f1408040100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:50.754 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.751+0000 7f1431da0640 1 --2- 10.20.193.104:0/2740852220 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f140803dc40 0x7f1408040100 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f14180099c0 tx=0x7f1418006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:50.755 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.753+0000 7f14177fe640 1 -- 10.20.193.104:0/2740852220 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1424040360 con 0x7f142c06b740 2026-02-17T20:56:50.843 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.840+0000 7f143482c640 1 -- 10.20.193.104:0/2740852220 --> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f142c192c40 con 0x7f140803dc40 2026-02-17T20:56:50.845 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.843+0000 7f14177fe640 1 -- 10.20.193.104:0/2740852220 <== mgr.14162 v2:10.20.193.104:6800/1034073782 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f142c192c40 con 0x7f140803dc40 2026-02-17T20:56:50.847 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.845+0000 7f143482c640 1 -- 10.20.193.104:0/2740852220 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f140803dc40 msgr2=0x7f1408040100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:50.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.845+0000 7f143482c640 1 --2- 10.20.193.104:0/2740852220 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f140803dc40 0x7f1408040100 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f14180099c0 tx=0x7f1418006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:50.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.845+0000 7f143482c640 1 -- 10.20.193.104:0/2740852220 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f142c06b740 msgr2=0x7f142c1026f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:50.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.845+0000 7f143482c640 1 --2- 10.20.193.104:0/2740852220 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f142c06b740 0x7f142c1026f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1424005ec0 tx=0x7f1424004290 comp rx=0 tx=0).stop 2026-02-17T20:56:50.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.845+0000 7f143482c640 1 -- 10.20.193.104:0/2740852220 shutdown_connections 2026-02-17T20:56:50.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.845+0000 7f143482c640 1 --2- 10.20.193.104:0/2740852220 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f140803dc40 0x7f1408040100 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:50.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.845+0000 7f143482c640 1 --2- 10.20.193.104:0/2740852220 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f142c06b740 0x7f142c1026f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:50.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.845+0000 7f143482c640 1 -- 10.20.193.104:0/2740852220 >> 10.20.193.104:0/2740852220 conn(0x7f142c0fc9d0 msgr2=0x7f142c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:50.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.845+0000 7f143482c640 1 -- 10.20.193.104:0/2740852220 shutdown_connections 2026-02-17T20:56:50.848 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:50.845+0000 7f143482c640 1 -- 10.20.193.104:0/2740852220 wait complete. 2026-02-17T20:56:50.883 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial153 2026-02-17T20:56:50.883 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T20:56:50.883 DEBUG:teuthology.orchestra.run.trial153:> dd of=/etc/ceph/ceph.conf 2026-02-17T20:56:50.900 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T20:56:50.900 DEBUG:teuthology.orchestra.run.trial153:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-17T20:56:50.957 INFO:tasks.cephadm:Adding host trial153 to orchestrator... 2026-02-17T20:56:50.957 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph orch host add trial153 2026-02-17T20:56:51.121 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:56:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.238+0000 7f4e4ed89640 1 -- 10.20.193.104:0/3176371463 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4e481045f0 msgr2=0x7f4e481049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.238+0000 7f4e4ed89640 1 --2- 10.20.193.104:0/3176371463 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4e481045f0 0x7f4e481049f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4e380099b0 tx=0x7f4e3802f2b0 comp rx=0 tx=0).stop 2026-02-17T20:56:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.238+0000 7f4e4ed89640 1 -- 10.20.193.104:0/3176371463 shutdown_connections 2026-02-17T20:56:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.238+0000 7f4e4ed89640 1 --2- 10.20.193.104:0/3176371463 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4e481045f0 0x7f4e481049f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.238+0000 7f4e4ed89640 1 -- 10.20.193.104:0/3176371463 >> 10.20.193.104:0/3176371463 conn(0x7f4e480ffda0 msgr2=0x7f4e481021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:51.243 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.238+0000 7f4e4ed89640 1 -- 10.20.193.104:0/3176371463 shutdown_connections 2026-02-17T20:56:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.238+0000 7f4e4ed89640 1 -- 10.20.193.104:0/3176371463 wait complete. 2026-02-17T20:56:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.238+0000 7f4e4ed89640 1 Processor -- start 2026-02-17T20:56:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.238+0000 7f4e4ed89640 1 -- start start 2026-02-17T20:56:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.238+0000 7f4e4ed89640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4e481045f0 0x7f4e4819bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.238+0000 7f4e4ed89640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4e4810a430 con 0x7f4e481045f0 2026-02-17T20:56:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.238+0000 7f4e4cafe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4e481045f0 0x7f4e4819bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.238+0000 7f4e4cafe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4e481045f0 0x7f4e4819bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:48370/0 (socket says 10.20.193.104:48370) 2026-02-17T20:56:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.238+0000 7f4e4cafe640 1 -- 10.20.193.104:0/381376200 learned_addr learned my addr 10.20.193.104:0/381376200 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.238+0000 7f4e4cafe640 1 -- 10.20.193.104:0/381376200 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e4819c040 con 0x7f4e481045f0 2026-02-17T20:56:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.239+0000 7f4e4cafe640 1 --2- 10.20.193.104:0/381376200 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4e481045f0 0x7f4e4819bb00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4e38004290 tx=0x7f4e380042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.239+0000 7f4e3dffb640 1 -- 10.20.193.104:0/381376200 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f4e38002820 con 0x7f4e481045f0 2026-02-17T20:56:51.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.239+0000 7f4e4ed89640 1 -- 10.20.193.104:0/381376200 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e4819c2d0 con 0x7f4e481045f0 2026-02-17T20:56:51.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.239+0000 7f4e3dffb640 1 -- 10.20.193.104:0/381376200 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f4e38046070 con 0x7f4e481045f0 2026-02-17T20:56:51.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.239+0000 7f4e3dffb640 1 -- 10.20.193.104:0/381376200 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f4e380417b0 con 0x7f4e481045f0 2026-02-17T20:56:51.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.239+0000 7f4e4ed89640 1 -- 10.20.193.104:0/381376200 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e4819efc0 con 0x7f4e481045f0 2026-02-17T20:56:51.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.239+0000 7f4e4ed89640 1 -- 10.20.193.104:0/381376200 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e4810abd0 con 0x7f4e481045f0 2026-02-17T20:56:51.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.239+0000 7f4e3dffb640 1 -- 10.20.193.104:0/381376200 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 12) ==== 50274+0+0 (secure 0 0 0) 0x7f4e38038770 con 0x7f4e481045f0 2026-02-17T20:56:51.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.240+0000 7f4e3dffb640 1 --2- 10.20.193.104:0/381376200 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4e2403dbf0 0x7f4e240400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:51.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.240+0000 7f4e3dffb640 1 -- 10.20.193.104:0/381376200 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f4e38077160 con 0x7f4e481045f0 2026-02-17T20:56:51.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.240+0000 7f4e3ffff640 1 --2- 10.20.193.104:0/381376200 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4e2403dbf0 0x7f4e240400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:51.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.240+0000 7f4e3ffff640 1 --2- 10.20.193.104:0/381376200 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4e2403dbf0 0x7f4e240400b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4e300099c0 tx=0x7f4e30006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:51.246 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.242+0000 7f4e3dffb640 1 -- 10.20.193.104:0/381376200 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4e3804ade0 con 0x7f4e481045f0 2026-02-17T20:56:51.333 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:51.330+0000 7f4e4ed89640 1 -- 10.20.193.104:0/381376200 --> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "trial153", "target": ["mon-mgr", ""]}) -- 0x7f4e48194ed0 con 0x7f4e2403dbf0 2026-02-17T20:56:51.399 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:51 trial104 ceph-mon[20612]: mgrmap e12: trial104.irrhmt(active, since 2s) 2026-02-17T20:56:51.399 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:51 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:51.399 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:51 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:51.399 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:51 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd/host:trial104", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:56:51.400 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:51 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:51.400 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:51 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial104", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-17T20:56:51.400 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:51 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial104", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2026-02-17T20:56:51.400 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:51 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:56:51.400 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:51 trial104 ceph-mon[20612]: Deploying daemon ceph-exporter.trial104 on trial104 2026-02-17T20:56:51.400 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:51 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/2614235953' entity='client.admin' 2026-02-17T20:56:51.400 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:51 trial104 ceph-mon[20612]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:51.400 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:51 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:52.602 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:52 trial104 ceph-mon[20612]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial153", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:52.602 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:52 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:52.602 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:52 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:52.602 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:52 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:52.602 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:52 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:52.602 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:52 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial104", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-17T20:56:52.603 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:52 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.trial104", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2026-02-17T20:56:52.603 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:52 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:56:52.603 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:52 trial104 ceph-mon[20612]: Deploying daemon crash.trial104 on trial104 2026-02-17T20:56:52.603 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:52 trial104 ceph-mon[20612]: Deploying cephadm binary to trial153 2026-02-17T20:56:52.603 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:52 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:52.603 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:52 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:52.603 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:52 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:52.603 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:52 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:52.849 INFO:teuthology.orchestra.run.trial104.stdout:Added host 'trial153' with addr '10.20.193.153' 2026-02-17T20:56:52.850 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:52.845+0000 7f4e3dffb640 1 -- 10.20.193.104:0/381376200 <== mgr.14162 v2:10.20.193.104:6800/1034073782 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f4e48194ed0 con 0x7f4e2403dbf0 2026-02-17T20:56:52.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:52.848+0000 7f4e4ed89640 1 -- 10.20.193.104:0/381376200 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4e2403dbf0 msgr2=0x7f4e240400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:52.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:52.848+0000 7f4e4ed89640 1 --2- 10.20.193.104:0/381376200 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4e2403dbf0 0x7f4e240400b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4e300099c0 tx=0x7f4e30006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:52.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:52.848+0000 7f4e4ed89640 1 -- 10.20.193.104:0/381376200 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4e481045f0 msgr2=0x7f4e4819bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:52.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:52.848+0000 7f4e4ed89640 1 --2- 10.20.193.104:0/381376200 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4e481045f0 0x7f4e4819bb00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4e38004290 tx=0x7f4e380042c0 comp rx=0 tx=0).stop 2026-02-17T20:56:52.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:52.848+0000 7f4e4ed89640 1 -- 10.20.193.104:0/381376200 shutdown_connections 2026-02-17T20:56:52.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:52.848+0000 7f4e4ed89640 1 --2- 10.20.193.104:0/381376200 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4e2403dbf0 0x7f4e240400b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:52.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:52.848+0000 7f4e4ed89640 1 --2- 10.20.193.104:0/381376200 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4e481045f0 0x7f4e4819bb00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:52.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:52.848+0000 7f4e4ed89640 1 -- 10.20.193.104:0/381376200 >> 10.20.193.104:0/381376200 conn(0x7f4e480ffda0 msgr2=0x7f4e481009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:52.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:52.848+0000 7f4e4ed89640 1 -- 10.20.193.104:0/381376200 shutdown_connections 2026-02-17T20:56:52.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:52.848+0000 7f4e4ed89640 1 -- 10.20.193.104:0/381376200 wait complete. 2026-02-17T20:56:52.907 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-17T20:56:53.059 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:56:53.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.175+0000 7f1800606640 1 -- 10.20.193.104:0/1789046858 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f17f81045f0 msgr2=0x7f17f81049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:53.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.175+0000 7f1800606640 1 --2- 10.20.193.104:0/1789046858 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f17f81045f0 0x7f17f81049f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009990 tx=0x7f17e802f290 comp rx=0 tx=0).stop 2026-02-17T20:56:53.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.175+0000 7f1800606640 1 -- 10.20.193.104:0/1789046858 shutdown_connections 2026-02-17T20:56:53.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.175+0000 7f1800606640 1 --2- 10.20.193.104:0/1789046858 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f17f81045f0 0x7f17f81049f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:53.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.175+0000 7f1800606640 1 -- 10.20.193.104:0/1789046858 >> 10.20.193.104:0/1789046858 conn(0x7f17f80ffda0 msgr2=0x7f17f81021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:53.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.175+0000 7f1800606640 1 -- 10.20.193.104:0/1789046858 shutdown_connections 2026-02-17T20:56:53.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.175+0000 7f1800606640 1 -- 10.20.193.104:0/1789046858 wait complete. 2026-02-17T20:56:53.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.175+0000 7f1800606640 1 Processor -- start 2026-02-17T20:56:53.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.175+0000 7f1800606640 1 -- start start 2026-02-17T20:56:53.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.175+0000 7f1800606640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f17f81045f0 0x7f17f819baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:53.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.175+0000 7f1800606640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f17f810a430 con 0x7f17f81045f0 2026-02-17T20:56:53.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.175+0000 7f17fe37b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f17f81045f0 0x7f17f819baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:53.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.175+0000 7f17fe37b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f17f81045f0 0x7f17f819baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:48410/0 (socket says 10.20.193.104:48410) 2026-02-17T20:56:53.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.175+0000 7f17fe37b640 1 -- 10.20.193.104:0/2206474865 learned_addr learned my addr 10.20.193.104:0/2206474865 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:53.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.176+0000 7f17fe37b640 1 -- 10.20.193.104:0/2206474865 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f819bfe0 con 0x7f17f81045f0 2026-02-17T20:56:53.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.176+0000 7f17fe37b640 1 --2- 10.20.193.104:0/2206474865 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f17f81045f0 0x7f17f819baa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f17e8004290 tx=0x7f17e80042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:53.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.176+0000 7f17df7fe640 1 -- 10.20.193.104:0/2206474865 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f17e8046070 con 0x7f17f81045f0 2026-02-17T20:56:53.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.176+0000 7f1800606640 1 -- 10.20.193.104:0/2206474865 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f819c270 con 0x7f17f81045f0 2026-02-17T20:56:53.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.176+0000 7f17df7fe640 1 -- 10.20.193.104:0/2206474865 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f17e8004d30 con 0x7f17f81045f0 2026-02-17T20:56:53.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.176+0000 7f17df7fe640 1 -- 10.20.193.104:0/2206474865 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f17e80056d0 con 0x7f17f81045f0 2026-02-17T20:56:53.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.176+0000 7f1800606640 1 -- 10.20.193.104:0/2206474865 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f819ef60 con 0x7f17f81045f0 2026-02-17T20:56:53.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.176+0000 7f1800606640 1 -- 10.20.193.104:0/2206474865 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f810abd0 con 0x7f17f81045f0 2026-02-17T20:56:53.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.176+0000 7f17df7fe640 1 -- 10.20.193.104:0/2206474865 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 12) ==== 50274+0+0 (secure 0 0 0) 0x7f17e80048c0 con 0x7f17f81045f0 2026-02-17T20:56:53.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.177+0000 7f17df7fe640 1 --2- 10.20.193.104:0/2206474865 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f17d403dbf0 0x7f17d40400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:53.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.177+0000 7f17df7fe640 1 -- 10.20.193.104:0/2206474865 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f17e803e070 con 0x7f17f81045f0 2026-02-17T20:56:53.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.177+0000 7f17fdb7a640 1 --2- 10.20.193.104:0/2206474865 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f17d403dbf0 0x7f17d40400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:53.182 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.177+0000 7f17fdb7a640 1 --2- 10.20.193.104:0/2206474865 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f17d403dbf0 0x7f17d40400b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0099c0 tx=0x7f17ec006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:53.183 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.179+0000 7f17df7fe640 1 -- 10.20.193.104:0/2206474865 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f17e8005000 con 0x7f17f81045f0 2026-02-17T20:56:53.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.265+0000 7f1800606640 1 -- 10.20.193.104:0/2206474865 --> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f17f8194ed0 con 0x7f17d403dbf0 2026-02-17T20:56:53.268 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.266+0000 7f17df7fe640 1 -- 10.20.193.104:0/2206474865 <== mgr.14162 v2:10.20.193.104:6800/1034073782 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f17f8194ed0 con 0x7f17d403dbf0 2026-02-17T20:56:53.269 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:56:53.269 INFO:teuthology.orchestra.run.trial104.stdout:[{"addr": "10.20.193.104", "hostname": "trial104", "labels": [], "status": ""}, {"addr": "10.20.193.153", "hostname": "trial153", "labels": [], "status": ""}] 2026-02-17T20:56:53.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.267+0000 7f1800606640 1 -- 10.20.193.104:0/2206474865 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f17d403dbf0 msgr2=0x7f17d40400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:53.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.267+0000 7f1800606640 1 --2- 10.20.193.104:0/2206474865 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f17d403dbf0 0x7f17d40400b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0099c0 tx=0x7f17ec006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:53.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.267+0000 7f1800606640 1 -- 10.20.193.104:0/2206474865 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f17f81045f0 msgr2=0x7f17f819baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:53.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.267+0000 7f1800606640 1 --2- 10.20.193.104:0/2206474865 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f17f81045f0 0x7f17f819baa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f17e8004290 tx=0x7f17e80042c0 comp rx=0 tx=0).stop 2026-02-17T20:56:53.270 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.267+0000 7f1800606640 1 -- 10.20.193.104:0/2206474865 shutdown_connections 2026-02-17T20:56:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.267+0000 7f1800606640 1 --2- 10.20.193.104:0/2206474865 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f17d403dbf0 0x7f17d40400b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.267+0000 7f1800606640 1 --2- 10.20.193.104:0/2206474865 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f17f81045f0 0x7f17f819baa0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.267+0000 7f1800606640 1 -- 10.20.193.104:0/2206474865 >> 10.20.193.104:0/2206474865 conn(0x7f17f80ffda0 msgr2=0x7f17f81007e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.267+0000 7f1800606640 1 -- 10.20.193.104:0/2206474865 shutdown_connections 2026-02-17T20:56:53.271 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.267+0000 7f1800606640 1 -- 10.20.193.104:0/2206474865 wait complete. 2026-02-17T20:56:53.312 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-17T20:56:53.312 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd crush tunables default 2026-02-17T20:56:53.463 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:56:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.578+0000 7fa31ebe7640 1 -- 10.20.193.104:0/3875826706 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa3181045f0 msgr2=0x7fa3181049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.578+0000 7fa31ebe7640 1 --2- 10.20.193.104:0/3875826706 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa3181045f0 0x7fa3181049f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa3080099b0 tx=0x7fa30802f2b0 comp rx=0 tx=0).stop 2026-02-17T20:56:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.578+0000 7fa31ebe7640 1 -- 10.20.193.104:0/3875826706 shutdown_connections 2026-02-17T20:56:53.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.578+0000 7fa31ebe7640 1 --2- 10.20.193.104:0/3875826706 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa3181045f0 0x7fa3181049f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.578+0000 7fa31ebe7640 1 -- 10.20.193.104:0/3875826706 >> 10.20.193.104:0/3875826706 conn(0x7fa3180ffda0 msgr2=0x7fa3181021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.578+0000 7fa31ebe7640 1 -- 10.20.193.104:0/3875826706 shutdown_connections 2026-02-17T20:56:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.578+0000 7fa31ebe7640 1 -- 10.20.193.104:0/3875826706 wait complete. 2026-02-17T20:56:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.579+0000 7fa31ebe7640 1 Processor -- start 2026-02-17T20:56:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.579+0000 7fa31ebe7640 1 -- start start 2026-02-17T20:56:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.579+0000 7fa31ebe7640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa3181045f0 0x7fa31819bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.579+0000 7fa31ebe7640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fa31810a430 con 0x7fa3181045f0 2026-02-17T20:56:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.579+0000 7fa31c95c640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa3181045f0 0x7fa31819bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.579+0000 7fa31c95c640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa3181045f0 0x7fa31819bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:48422/0 (socket says 10.20.193.104:48422) 2026-02-17T20:56:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.579+0000 7fa31c95c640 1 -- 10.20.193.104:0/4062997094 learned_addr learned my addr 10.20.193.104:0/4062997094 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:56:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.579+0000 7fa31c95c640 1 -- 10.20.193.104:0/4062997094 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa31819c040 con 0x7fa3181045f0 2026-02-17T20:56:53.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.579+0000 7fa31c95c640 1 --2- 10.20.193.104:0/4062997094 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa3181045f0 0x7fa31819bb00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa308004290 tx=0x7fa3080042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.579+0000 7fa30dffb640 1 -- 10.20.193.104:0/4062997094 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa308002820 con 0x7fa3181045f0 2026-02-17T20:56:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.579+0000 7fa31ebe7640 1 -- 10.20.193.104:0/4062997094 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa31819c2d0 con 0x7fa3181045f0 2026-02-17T20:56:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.579+0000 7fa30dffb640 1 -- 10.20.193.104:0/4062997094 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fa308046070 con 0x7fa3181045f0 2026-02-17T20:56:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.579+0000 7fa30dffb640 1 -- 10.20.193.104:0/4062997094 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fa3080417b0 con 0x7fa3181045f0 2026-02-17T20:56:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.579+0000 7fa31ebe7640 1 -- 10.20.193.104:0/4062997094 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa31819efc0 con 0x7fa3181045f0 2026-02-17T20:56:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.580+0000 7fa31ebe7640 1 -- 10.20.193.104:0/4062997094 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa31810abd0 con 0x7fa3181045f0 2026-02-17T20:56:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.580+0000 7fa30dffb640 1 -- 10.20.193.104:0/4062997094 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 12) ==== 50274+0+0 (secure 0 0 0) 0x7fa308041a60 con 0x7fa3181045f0 2026-02-17T20:56:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.580+0000 7fa30dffb640 1 --2- 10.20.193.104:0/4062997094 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fa2f403dbf0 0x7fa2f40400b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.580+0000 7fa30dffb640 1 -- 10.20.193.104:0/4062997094 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa3080772c0 con 0x7fa3181045f0 2026-02-17T20:56:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.580+0000 7fa30ffff640 1 --2- 10.20.193.104:0/4062997094 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fa2f403dbf0 0x7fa2f40400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:53.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.580+0000 7fa30ffff640 1 --2- 10.20.193.104:0/4062997094 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fa2f403dbf0 0x7fa2f40400b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa3000099c0 tx=0x7fa300006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:53.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.582+0000 7fa30dffb640 1 -- 10.20.193.104:0/4062997094 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fa308040c80 con 0x7fa3181045f0 2026-02-17T20:56:53.670 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:53.667+0000 7fa31ebe7640 1 -- 10.20.193.104:0/4062997094 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fa318194e30 con 0x7fa3181045f0 2026-02-17T20:56:53.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:53 trial104 ceph-mon[20612]: Deploying daemon node-exporter.trial104 on trial104 2026-02-17T20:56:53.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:53 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:53.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:53 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:53.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:53 trial104 ceph-mon[20612]: Added host trial153 2026-02-17T20:56:53.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:53 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:53.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:53 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:53.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:53 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:53.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:53 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:54.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:54.338+0000 7fa30dffb640 1 -- 10.20.193.104:0/4062997094 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mgrmap(e 13) ==== 50318+0+0 (secure 0 0 0) 0x7fa308037c80 con 0x7fa3181045f0 2026-02-17T20:56:54.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:54.557+0000 7fa30dffb640 1 -- 10.20.193.104:0/4062997094 <== mon.0 v2:10.20.193.104:3300/0 8 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fa308034280 con 0x7fa3181045f0 2026-02-17T20:56:54.560 INFO:teuthology.orchestra.run.trial104.stderr:adjusted tunables profile to default 2026-02-17T20:56:54.562 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:54.559+0000 7fa31ebe7640 1 -- 10.20.193.104:0/4062997094 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fa2f403dbf0 msgr2=0x7fa2f40400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:54.562 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:54.559+0000 7fa31ebe7640 1 --2- 10.20.193.104:0/4062997094 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fa2f403dbf0 0x7fa2f40400b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa3000099c0 tx=0x7fa300006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:54.562 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:54.559+0000 7fa31ebe7640 1 -- 10.20.193.104:0/4062997094 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa3181045f0 msgr2=0x7fa31819bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:54.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:54.559+0000 7fa31ebe7640 1 --2- 10.20.193.104:0/4062997094 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa3181045f0 0x7fa31819bb00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa308004290 tx=0x7fa3080042c0 comp rx=0 tx=0).stop 2026-02-17T20:56:54.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:54.559+0000 7fa31ebe7640 1 -- 10.20.193.104:0/4062997094 shutdown_connections 2026-02-17T20:56:54.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:54.559+0000 7fa31ebe7640 1 --2- 10.20.193.104:0/4062997094 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fa2f403dbf0 0x7fa2f40400b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:54.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:54.559+0000 7fa31ebe7640 1 --2- 10.20.193.104:0/4062997094 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fa3181045f0 0x7fa31819bb00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:54.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:54.559+0000 7fa31ebe7640 1 -- 10.20.193.104:0/4062997094 >> 10.20.193.104:0/4062997094 conn(0x7fa3180ffda0 msgr2=0x7fa3181009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:54.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:54.559+0000 7fa31ebe7640 1 -- 10.20.193.104:0/4062997094 shutdown_connections 2026-02-17T20:56:54.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:56:54.559+0000 7fa31ebe7640 1 -- 10.20.193.104:0/4062997094 wait complete. 2026-02-17T20:56:54.685 INFO:tasks.cephadm:Adding mon.trial104 on trial104 2026-02-17T20:56:54.685 INFO:tasks.cephadm:Adding mon.trial153 on trial153 2026-02-17T20:56:54.685 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph orch apply mon '2;trial104:10.20.193.104=trial104;trial153:10.20.193.153=trial153' 2026-02-17T20:56:54.796 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:54 trial104 ceph-mon[20612]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T20:56:54.796 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:54 trial104 ceph-mon[20612]: Deploying daemon alertmanager.trial104 on trial104 2026-02-17T20:56:54.796 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:54 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/4062997094' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2026-02-17T20:56:54.796 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:54 trial104 ceph-mon[20612]: mgrmap e13: trial104.irrhmt(active, since 6s) 2026-02-17T20:56:54.828 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:56:54.856 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:56:54.965 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.961+0000 7fb84effd640 1 -- 10.20.193.153:0/966662704 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fb83c002da0 con 0x7fb8501045f0 2026-02-17T20:56:54.965 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.961+0000 7fb8562ff640 1 -- 10.20.193.153:0/966662704 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8501045f0 msgr2=0x7fb8501049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:54.965 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.961+0000 7fb8562ff640 1 --2- 10.20.193.153:0/966662704 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8501045f0 0x7fb8501049f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb83c009990 tx=0x7fb83c02f290 comp rx=0 tx=0).stop 2026-02-17T20:56:54.966 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.961+0000 7fb8562ff640 1 -- 10.20.193.153:0/966662704 shutdown_connections 2026-02-17T20:56:54.966 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.961+0000 7fb8562ff640 1 --2- 10.20.193.153:0/966662704 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8501045f0 0x7fb8501049f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:54.966 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.961+0000 7fb8562ff640 1 -- 10.20.193.153:0/966662704 >> 10.20.193.153:0/966662704 conn(0x7fb8500ffda0 msgr2=0x7fb8501021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:54.966 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.961+0000 7fb8562ff640 1 -- 10.20.193.153:0/966662704 shutdown_connections 2026-02-17T20:56:54.966 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.961+0000 7fb8562ff640 1 -- 10.20.193.153:0/966662704 wait complete. 2026-02-17T20:56:54.966 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.962+0000 7fb8562ff640 1 Processor -- start 2026-02-17T20:56:54.966 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.962+0000 7fb8562ff640 1 -- start start 2026-02-17T20:56:54.966 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.962+0000 7fb8562ff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8501045f0 0x7fb85019bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:54.966 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.962+0000 7fb8562ff640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb85010a430 con 0x7fb8501045f0 2026-02-17T20:56:54.966 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.962+0000 7fb84ffff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8501045f0 0x7fb85019bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:54.966 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.962+0000 7fb84ffff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8501045f0 0x7fb85019bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.153:42744/0 (socket says 10.20.193.153:42744) 2026-02-17T20:56:54.966 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.962+0000 7fb84ffff640 1 -- 10.20.193.153:0/807905055 learned_addr learned my addr 10.20.193.153:0/807905055 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:56:54.967 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.962+0000 7fb84ffff640 1 -- 10.20.193.153:0/807905055 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85019c000 con 0x7fb8501045f0 2026-02-17T20:56:54.968 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.963+0000 7fb84ffff640 1 --2- 10.20.193.153:0/807905055 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8501045f0 0x7fb85019bac0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb83c004290 tx=0x7fb83c0042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:54.968 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.963+0000 7fb84d7fa640 1 -- 10.20.193.153:0/807905055 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fb83c0048c0 con 0x7fb8501045f0 2026-02-17T20:56:54.968 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.963+0000 7fb8562ff640 1 -- 10.20.193.153:0/807905055 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb85019c290 con 0x7fb8501045f0 2026-02-17T20:56:54.968 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.963+0000 7fb8562ff640 1 -- 10.20.193.153:0/807905055 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb85019ef80 con 0x7fb8501045f0 2026-02-17T20:56:54.968 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.963+0000 7fb84d7fa640 1 -- 10.20.193.153:0/807905055 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fb83c005020 con 0x7fb8501045f0 2026-02-17T20:56:54.969 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.963+0000 7fb84d7fa640 1 -- 10.20.193.153:0/807905055 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fb83c04f060 con 0x7fb8501045f0 2026-02-17T20:56:54.969 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.963+0000 7fb8562ff640 1 -- 10.20.193.153:0/807905055 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb85010abd0 con 0x7fb8501045f0 2026-02-17T20:56:54.969 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.964+0000 7fb84d7fa640 1 -- 10.20.193.153:0/807905055 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 13) ==== 50318+0+0 (secure 0 0 0) 0x7fb83c004a60 con 0x7fb8501045f0 2026-02-17T20:56:54.969 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.964+0000 7fb84d7fa640 1 --2- 10.20.193.153:0/807905055 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fb82403dc90 0x7fb824040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:54.969 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.964+0000 7fb84d7fa640 1 -- 10.20.193.153:0/807905055 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb83c03e070 con 0x7fb8501045f0 2026-02-17T20:56:54.969 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.964+0000 7fb84f7fe640 1 --2- 10.20.193.153:0/807905055 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fb82403dc90 0x7fb824040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:54.969 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.965+0000 7fb84f7fe640 1 --2- 10.20.193.153:0/807905055 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fb82403dc90 0x7fb824040150 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb8400099c0 tx=0x7fb840006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:54.969 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:54.966+0000 7fb84d7fa640 1 -- 10.20.193.153:0/807905055 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb83c047270 con 0x7fb8501045f0 2026-02-17T20:56:55.058 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.055+0000 7fb8562ff640 1 -- 10.20.193.153:0/807905055 --> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;trial104:10.20.193.104=trial104;trial153:10.20.193.153=trial153", "target": ["mon-mgr", ""]}) -- 0x7fb850194f50 con 0x7fb82403dc90 2026-02-17T20:56:55.062 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.059+0000 7fb84d7fa640 1 -- 10.20.193.153:0/807905055 <== mgr.14162 v2:10.20.193.104:6800/1034073782 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb850194f50 con 0x7fb82403dc90 2026-02-17T20:56:55.062 INFO:teuthology.orchestra.run.trial153.stdout:Scheduled mon update... 2026-02-17T20:56:55.063 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.060+0000 7fb8562ff640 1 -- 10.20.193.153:0/807905055 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fb82403dc90 msgr2=0x7fb824040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:55.063 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.060+0000 7fb8562ff640 1 --2- 10.20.193.153:0/807905055 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fb82403dc90 0x7fb824040150 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb8400099c0 tx=0x7fb840006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:55.063 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.060+0000 7fb8562ff640 1 -- 10.20.193.153:0/807905055 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8501045f0 msgr2=0x7fb85019bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:55.063 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.060+0000 7fb8562ff640 1 --2- 10.20.193.153:0/807905055 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8501045f0 0x7fb85019bac0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb83c004290 tx=0x7fb83c0042c0 comp rx=0 tx=0).stop 2026-02-17T20:56:55.063 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.060+0000 7fb8562ff640 1 -- 10.20.193.153:0/807905055 shutdown_connections 2026-02-17T20:56:55.064 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.060+0000 7fb8562ff640 1 --2- 10.20.193.153:0/807905055 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fb82403dc90 0x7fb824040150 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:55.064 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.060+0000 7fb8562ff640 1 --2- 10.20.193.153:0/807905055 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8501045f0 0x7fb85019bac0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:55.064 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.060+0000 7fb8562ff640 1 -- 10.20.193.153:0/807905055 >> 10.20.193.153:0/807905055 conn(0x7fb8500ffda0 msgr2=0x7fb850100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:55.064 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.060+0000 7fb8562ff640 1 -- 10.20.193.153:0/807905055 shutdown_connections 2026-02-17T20:56:55.064 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.060+0000 7fb8562ff640 1 -- 10.20.193.153:0/807905055 wait complete. 2026-02-17T20:56:55.099 DEBUG:teuthology.orchestra.run.trial153:mon.trial153> sudo journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@mon.trial153.service 2026-02-17T20:56:55.101 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T20:56:55.102 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T20:56:55.279 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:56:55.308 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:56:55.410 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.406+0000 7f4fbbacb640 1 -- 10.20.193.153:0/616815597 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4fb41045f0 msgr2=0x7f4fb41049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:55.410 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.406+0000 7f4fbbacb640 1 --2- 10.20.193.153:0/616815597 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4fb41045f0 0x7f4fb41049f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009990 tx=0x7f4fa402f290 comp rx=0 tx=0).stop 2026-02-17T20:56:55.410 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.406+0000 7f4fbbacb640 1 -- 10.20.193.153:0/616815597 shutdown_connections 2026-02-17T20:56:55.410 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.406+0000 7f4fbbacb640 1 --2- 10.20.193.153:0/616815597 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4fb41045f0 0x7f4fb41049f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:55.410 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.406+0000 7f4fbbacb640 1 -- 10.20.193.153:0/616815597 >> 10.20.193.153:0/616815597 conn(0x7f4fb40ffda0 msgr2=0x7f4fb41021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:55.410 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.406+0000 7f4fbbacb640 1 -- 10.20.193.153:0/616815597 shutdown_connections 2026-02-17T20:56:55.410 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.406+0000 7f4fbbacb640 1 -- 10.20.193.153:0/616815597 wait complete. 2026-02-17T20:56:55.411 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.406+0000 7f4fbbacb640 1 Processor -- start 2026-02-17T20:56:55.411 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.406+0000 7f4fbbacb640 1 -- start start 2026-02-17T20:56:55.411 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.406+0000 7f4fbbacb640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4fb41045f0 0x7f4fb419bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:55.411 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.406+0000 7f4fbbacb640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4fb410a430 con 0x7f4fb41045f0 2026-02-17T20:56:55.411 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.407+0000 7f4fb9840640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4fb41045f0 0x7f4fb419bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:55.411 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.407+0000 7f4fb9840640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4fb41045f0 0x7f4fb419bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.153:42760/0 (socket says 10.20.193.153:42760) 2026-02-17T20:56:55.411 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.407+0000 7f4fb9840640 1 -- 10.20.193.153:0/3027575006 learned_addr learned my addr 10.20.193.153:0/3027575006 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:56:55.411 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.407+0000 7f4fb9840640 1 -- 10.20.193.153:0/3027575006 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fb419c000 con 0x7f4fb41045f0 2026-02-17T20:56:55.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.407+0000 7f4fb9840640 1 --2- 10.20.193.153:0/3027575006 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4fb41045f0 0x7f4fb419bac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4004290 tx=0x7f4fa40042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:55.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.408+0000 7f4fa2ffd640 1 -- 10.20.193.153:0/3027575006 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f4fa40048c0 con 0x7f4fb41045f0 2026-02-17T20:56:55.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.408+0000 7f4fa2ffd640 1 -- 10.20.193.153:0/3027575006 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f4fa4005020 con 0x7f4fb41045f0 2026-02-17T20:56:55.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.408+0000 7f4fbbacb640 1 -- 10.20.193.153:0/3027575006 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fb419c290 con 0x7f4fb41045f0 2026-02-17T20:56:55.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.408+0000 7f4fbbacb640 1 -- 10.20.193.153:0/3027575006 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fb419ef80 con 0x7f4fb41045f0 2026-02-17T20:56:55.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.408+0000 7f4fa2ffd640 1 -- 10.20.193.153:0/3027575006 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f4fa404f060 con 0x7f4fb41045f0 2026-02-17T20:56:55.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.408+0000 7f4fbbacb640 1 -- 10.20.193.153:0/3027575006 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fb410abd0 con 0x7f4fb41045f0 2026-02-17T20:56:55.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.408+0000 7f4fa2ffd640 1 -- 10.20.193.153:0/3027575006 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 13) ==== 50318+0+0 (secure 0 0 0) 0x7f4fa4004a60 con 0x7f4fb41045f0 2026-02-17T20:56:55.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.409+0000 7f4fa2ffd640 1 --2- 10.20.193.153:0/3027575006 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4f9003dc40 0x7f4f90040100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:55.414 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.409+0000 7f4fa2ffd640 1 -- 10.20.193.153:0/3027575006 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4fa403e070 con 0x7f4fb41045f0 2026-02-17T20:56:55.414 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.409+0000 7f4fb903f640 1 --2- 10.20.193.153:0/3027575006 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4f9003dc40 0x7f4f90040100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:55.414 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.409+0000 7f4fb903f640 1 --2- 10.20.193.153:0/3027575006 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4f9003dc40 0x7f4f90040100 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80099c0 tx=0x7f4fa8006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:55.414 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.411+0000 7f4fa2ffd640 1 -- 10.20.193.153:0/3027575006 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4fa4005560 con 0x7f4fb41045f0 2026-02-17T20:56:55.528 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.525+0000 7f4fbbacb640 1 -- 10.20.193.153:0/3027575006 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4fb4194f30 con 0x7f4fb41045f0 2026-02-17T20:56:55.529 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.525+0000 7f4fa2ffd640 1 -- 10.20.193.153:0/3027575006 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+752 (secure 0 0 0) 0x7f4fa4075430 con 0x7f4fb41045f0 2026-02-17T20:56:55.529 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:55.529 INFO:teuthology.orchestra.run.trial153.stdout:{"epoch":1,"fsid":"19072504-0c43-11f1-93a3-d404e6e7d460","modified":"2026-02-17T20:56:27.459417Z","created":"2026-02-17T20:56:27.459417Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial104","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:3300","nonce":0},{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T20:56:55.530 INFO:teuthology.orchestra.run.trial153.stderr:dumped monmap epoch 1 2026-02-17T20:56:55.530 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.526+0000 7f4fbbacb640 1 -- 10.20.193.153:0/3027575006 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4f9003dc40 msgr2=0x7f4f90040100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:55.530 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.526+0000 7f4fbbacb640 1 --2- 10.20.193.153:0/3027575006 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4f9003dc40 0x7f4f90040100 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4fa80099c0 tx=0x7f4fa8006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:55.530 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.526+0000 7f4fbbacb640 1 -- 10.20.193.153:0/3027575006 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4fb41045f0 msgr2=0x7f4fb419bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:55.531 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.526+0000 7f4fbbacb640 1 --2- 10.20.193.153:0/3027575006 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4fb41045f0 0x7f4fb419bac0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4004290 tx=0x7f4fa40042c0 comp rx=0 tx=0).stop 2026-02-17T20:56:55.531 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.526+0000 7f4fbbacb640 1 -- 10.20.193.153:0/3027575006 shutdown_connections 2026-02-17T20:56:55.531 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.526+0000 7f4fbbacb640 1 --2- 10.20.193.153:0/3027575006 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4f9003dc40 0x7f4f90040100 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:55.531 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.526+0000 7f4fbbacb640 1 --2- 10.20.193.153:0/3027575006 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4fb41045f0 0x7f4fb419bac0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:55.531 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.526+0000 7f4fbbacb640 1 -- 10.20.193.153:0/3027575006 >> 10.20.193.153:0/3027575006 conn(0x7f4fb40ffda0 msgr2=0x7f4fb4100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:55.531 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.526+0000 7f4fbbacb640 1 -- 10.20.193.153:0/3027575006 shutdown_connections 2026-02-17T20:56:55.531 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:55.526+0000 7f4fbbacb640 1 -- 10.20.193.153:0/3027575006 wait complete. 2026-02-17T20:56:55.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:55 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/4062997094' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-17T20:56:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:55 trial104 ceph-mon[20612]: osdmap e4: 0 total, 0 up, 0 in 2026-02-17T20:56:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:55 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:55 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:55 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:55 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:55 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:55 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:55 trial104 ceph-mon[20612]: Regenerating cephadm self-signed grafana TLS certificates 2026-02-17T20:56:55.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:55 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:55.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:55 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:55.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:55 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-02-17T20:56:55.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:55 trial104 ceph-mon[20612]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2026-02-17T20:56:55.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:55 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:55.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:55 trial104 ceph-mon[20612]: Deploying daemon grafana.trial104 on trial104 2026-02-17T20:56:55.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:55 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:55.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:55 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/3027575006' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T20:56:56.565 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T20:56:56.565 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T20:56:56.708 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:56:56.737 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:56:56.813 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:56 trial104 ceph-mon[20612]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;trial104:10.20.193.104=trial104;trial153:10.20.193.153=trial153", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:56:56.813 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:56 trial104 ceph-mon[20612]: Saving service mon spec with placement trial104:10.20.193.104=trial104;trial153:10.20.193.153=trial153;count:2 2026-02-17T20:56:56.835 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.832+0000 7ff7824d7640 1 -- 10.20.193.153:0/3029155727 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff77c1045f0 msgr2=0x7ff77c1049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:56.835 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.832+0000 7ff7824d7640 1 --2- 10.20.193.153:0/3029155727 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff77c1045f0 0x7ff77c1049f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff768009990 tx=0x7ff76802f290 comp rx=0 tx=0).stop 2026-02-17T20:56:56.835 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.832+0000 7ff7824d7640 1 -- 10.20.193.153:0/3029155727 shutdown_connections 2026-02-17T20:56:56.835 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.832+0000 7ff7824d7640 1 --2- 10.20.193.153:0/3029155727 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff77c1045f0 0x7ff77c1049f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:56.835 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.832+0000 7ff7824d7640 1 -- 10.20.193.153:0/3029155727 >> 10.20.193.153:0/3029155727 conn(0x7ff77c0ffda0 msgr2=0x7ff77c1021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:56.835 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.832+0000 7ff7824d7640 1 -- 10.20.193.153:0/3029155727 shutdown_connections 2026-02-17T20:56:56.835 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.832+0000 7ff7824d7640 1 -- 10.20.193.153:0/3029155727 wait complete. 2026-02-17T20:56:56.836 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.832+0000 7ff7824d7640 1 Processor -- start 2026-02-17T20:56:56.836 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.832+0000 7ff7824d7640 1 -- start start 2026-02-17T20:56:56.836 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.833+0000 7ff7824d7640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff77c1045f0 0x7ff77c19bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:56.836 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.833+0000 7ff7824d7640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff77c10a430 con 0x7ff77c1045f0 2026-02-17T20:56:56.836 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.833+0000 7ff77bfff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff77c1045f0 0x7ff77c19bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:56.836 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.833+0000 7ff77bfff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff77c1045f0 0x7ff77c19bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.153:42782/0 (socket says 10.20.193.153:42782) 2026-02-17T20:56:56.836 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.833+0000 7ff77bfff640 1 -- 10.20.193.153:0/1365091777 learned_addr learned my addr 10.20.193.153:0/1365091777 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:56:56.836 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.833+0000 7ff77bfff640 1 -- 10.20.193.153:0/1365091777 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff77c19c000 con 0x7ff77c1045f0 2026-02-17T20:56:56.836 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.833+0000 7ff77bfff640 1 --2- 10.20.193.153:0/1365091777 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff77c1045f0 0x7ff77c19bac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff768002410 tx=0x7ff768004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:56.836 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.833+0000 7ff7797fa640 1 -- 10.20.193.153:0/1365091777 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff7680045b0 con 0x7ff77c1045f0 2026-02-17T20:56:56.837 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.833+0000 7ff7824d7640 1 -- 10.20.193.153:0/1365091777 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff77c19c290 con 0x7ff77c1045f0 2026-02-17T20:56:56.837 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.833+0000 7ff7797fa640 1 -- 10.20.193.153:0/1365091777 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7ff768004d30 con 0x7ff77c1045f0 2026-02-17T20:56:56.837 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.833+0000 7ff7797fa640 1 -- 10.20.193.153:0/1365091777 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff768038510 con 0x7ff77c1045f0 2026-02-17T20:56:56.837 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.833+0000 7ff7824d7640 1 -- 10.20.193.153:0/1365091777 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff77c19ef80 con 0x7ff77c1045f0 2026-02-17T20:56:56.837 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.834+0000 7ff7824d7640 1 -- 10.20.193.153:0/1365091777 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff77c10abd0 con 0x7ff77c1045f0 2026-02-17T20:56:56.837 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.834+0000 7ff7797fa640 1 -- 10.20.193.153:0/1365091777 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 13) ==== 50318+0+0 (secure 0 0 0) 0x7ff768005020 con 0x7ff77c1045f0 2026-02-17T20:56:56.837 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.834+0000 7ff7797fa640 1 --2- 10.20.193.153:0/1365091777 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7ff75003dce0 0x7ff7500401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:56.837 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.834+0000 7ff7797fa640 1 -- 10.20.193.153:0/1365091777 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff76803e070 con 0x7ff77c1045f0 2026-02-17T20:56:56.837 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.834+0000 7ff77b7fe640 1 --2- 10.20.193.153:0/1365091777 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7ff75003dce0 0x7ff7500401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:56.838 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.835+0000 7ff77b7fe640 1 --2- 10.20.193.153:0/1365091777 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7ff75003dce0 0x7ff7500401a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0099c0 tx=0x7ff76c006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:56.840 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.837+0000 7ff7797fa640 1 -- 10.20.193.153:0/1365091777 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff768047270 con 0x7ff77c1045f0 2026-02-17T20:56:56.953 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.950+0000 7ff7824d7640 1 -- 10.20.193.153:0/1365091777 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff77c194e60 con 0x7ff77c1045f0 2026-02-17T20:56:56.953 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.950+0000 7ff7797fa640 1 -- 10.20.193.153:0/1365091777 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+752 (secure 0 0 0) 0x7ff768036df0 con 0x7ff77c1045f0 2026-02-17T20:56:56.954 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:56.954 INFO:teuthology.orchestra.run.trial153.stdout:{"epoch":1,"fsid":"19072504-0c43-11f1-93a3-d404e6e7d460","modified":"2026-02-17T20:56:27.459417Z","created":"2026-02-17T20:56:27.459417Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial104","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:3300","nonce":0},{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T20:56:56.955 INFO:teuthology.orchestra.run.trial153.stderr:dumped monmap epoch 1 2026-02-17T20:56:56.955 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.951+0000 7ff7824d7640 1 -- 10.20.193.153:0/1365091777 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7ff75003dce0 msgr2=0x7ff7500401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:56.955 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.951+0000 7ff7824d7640 1 --2- 10.20.193.153:0/1365091777 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7ff75003dce0 0x7ff7500401a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0099c0 tx=0x7ff76c006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:56.955 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.951+0000 7ff7824d7640 1 -- 10.20.193.153:0/1365091777 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff77c1045f0 msgr2=0x7ff77c19bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:56.955 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.951+0000 7ff7824d7640 1 --2- 10.20.193.153:0/1365091777 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff77c1045f0 0x7ff77c19bac0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff768002410 tx=0x7ff768004290 comp rx=0 tx=0).stop 2026-02-17T20:56:56.955 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.951+0000 7ff7824d7640 1 -- 10.20.193.153:0/1365091777 shutdown_connections 2026-02-17T20:56:56.955 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.951+0000 7ff7824d7640 1 --2- 10.20.193.153:0/1365091777 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7ff75003dce0 0x7ff7500401a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:56.955 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.951+0000 7ff7824d7640 1 --2- 10.20.193.153:0/1365091777 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff77c1045f0 0x7ff77c19bac0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:56.956 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.951+0000 7ff7824d7640 1 -- 10.20.193.153:0/1365091777 >> 10.20.193.153:0/1365091777 conn(0x7ff77c0ffda0 msgr2=0x7ff77c100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:56.956 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.951+0000 7ff7824d7640 1 -- 10.20.193.153:0/1365091777 shutdown_connections 2026-02-17T20:56:56.956 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:56.951+0000 7ff7824d7640 1 -- 10.20.193.153:0/1365091777 wait complete. 2026-02-17T20:56:57.653 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:57 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/1365091777' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T20:56:57.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:57 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:57.992 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T20:56:57.993 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T20:56:58.135 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:56:58.164 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:56:58.262 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.259+0000 7f4c11d74640 1 -- 10.20.193.153:0/1616808664 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f4c08002da0 con 0x7f4c141045f0 2026-02-17T20:56:58.265 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.260+0000 7f4c190ec640 1 -- 10.20.193.153:0/1616808664 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4c141045f0 msgr2=0x7f4c141049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:58.265 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.260+0000 7f4c190ec640 1 --2- 10.20.193.153:0/1616808664 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4c141045f0 0x7f4c141049f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4c08009990 tx=0x7f4c0802f290 comp rx=0 tx=0).stop 2026-02-17T20:56:58.265 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.260+0000 7f4c190ec640 1 -- 10.20.193.153:0/1616808664 shutdown_connections 2026-02-17T20:56:58.265 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.260+0000 7f4c190ec640 1 --2- 10.20.193.153:0/1616808664 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4c141045f0 0x7f4c141049f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:58.265 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.260+0000 7f4c190ec640 1 -- 10.20.193.153:0/1616808664 >> 10.20.193.153:0/1616808664 conn(0x7f4c140ffda0 msgr2=0x7f4c141021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:58.266 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.260+0000 7f4c190ec640 1 -- 10.20.193.153:0/1616808664 shutdown_connections 2026-02-17T20:56:58.266 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.260+0000 7f4c190ec640 1 -- 10.20.193.153:0/1616808664 wait complete. 2026-02-17T20:56:58.266 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.260+0000 7f4c190ec640 1 Processor -- start 2026-02-17T20:56:58.266 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.260+0000 7f4c190ec640 1 -- start start 2026-02-17T20:56:58.266 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.260+0000 7f4c190ec640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4c141045f0 0x7f4c1419bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:58.266 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.260+0000 7f4c190ec640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4c1410a430 con 0x7f4c141045f0 2026-02-17T20:56:58.266 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.261+0000 7f4c12d76640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4c141045f0 0x7f4c1419bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:58.266 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.261+0000 7f4c12d76640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4c141045f0 0x7f4c1419bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.153:42806/0 (socket says 10.20.193.153:42806) 2026-02-17T20:56:58.266 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.261+0000 7f4c12d76640 1 -- 10.20.193.153:0/2625567745 learned_addr learned my addr 10.20.193.153:0/2625567745 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:56:58.266 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.261+0000 7f4c12d76640 1 -- 10.20.193.153:0/2625567745 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c1419c000 con 0x7f4c141045f0 2026-02-17T20:56:58.266 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.261+0000 7f4c12d76640 1 --2- 10.20.193.153:0/2625567745 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4c141045f0 0x7f4c1419bac0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c08004290 tx=0x7f4c080042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:58.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.261+0000 7f4bf3fff640 1 -- 10.20.193.153:0/2625567745 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f4c080048c0 con 0x7f4c141045f0 2026-02-17T20:56:58.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.261+0000 7f4bf3fff640 1 -- 10.20.193.153:0/2625567745 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f4c08005020 con 0x7f4c141045f0 2026-02-17T20:56:58.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.261+0000 7f4c190ec640 1 -- 10.20.193.153:0/2625567745 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c1419c290 con 0x7f4c141045f0 2026-02-17T20:56:58.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.261+0000 7f4bf3fff640 1 -- 10.20.193.153:0/2625567745 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f4c08038510 con 0x7f4c141045f0 2026-02-17T20:56:58.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.261+0000 7f4c190ec640 1 -- 10.20.193.153:0/2625567745 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c1419ef80 con 0x7f4c141045f0 2026-02-17T20:56:58.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.261+0000 7f4c190ec640 1 -- 10.20.193.153:0/2625567745 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c1410abd0 con 0x7f4c141045f0 2026-02-17T20:56:58.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.262+0000 7f4bf3fff640 1 -- 10.20.193.153:0/2625567745 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 13) ==== 50318+0+0 (secure 0 0 0) 0x7f4c08004a60 con 0x7f4c141045f0 2026-02-17T20:56:58.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.262+0000 7f4bf3fff640 1 --2- 10.20.193.153:0/2625567745 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4be803dc90 0x7f4be8040150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:58.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.262+0000 7f4bf3fff640 1 -- 10.20.193.153:0/2625567745 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4c0803e070 con 0x7f4c141045f0 2026-02-17T20:56:58.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.262+0000 7f4c12575640 1 --2- 10.20.193.153:0/2625567745 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4be803dc90 0x7f4be8040150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:58.268 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.263+0000 7f4c12575640 1 --2- 10.20.193.153:0/2625567745 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4be803dc90 0x7f4be8040150 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0099c0 tx=0x7f4bfc006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:58.268 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.264+0000 7f4bf3fff640 1 -- 10.20.193.153:0/2625567745 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4c08034280 con 0x7f4c141045f0 2026-02-17T20:56:58.382 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.379+0000 7f4c190ec640 1 -- 10.20.193.153:0/2625567745 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f4c14104a70 con 0x7f4c141045f0 2026-02-17T20:56:58.383 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.380+0000 7f4bf3fff640 1 -- 10.20.193.153:0/2625567745 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+752 (secure 0 0 0) 0x7f4c08049d70 con 0x7f4c141045f0 2026-02-17T20:56:58.383 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:58.383 INFO:teuthology.orchestra.run.trial153.stdout:{"epoch":1,"fsid":"19072504-0c43-11f1-93a3-d404e6e7d460","modified":"2026-02-17T20:56:27.459417Z","created":"2026-02-17T20:56:27.459417Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial104","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:3300","nonce":0},{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T20:56:58.384 INFO:teuthology.orchestra.run.trial153.stderr:dumped monmap epoch 1 2026-02-17T20:56:58.384 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.380+0000 7f4c190ec640 1 -- 10.20.193.153:0/2625567745 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4be803dc90 msgr2=0x7f4be8040150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:58.385 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.380+0000 7f4c190ec640 1 --2- 10.20.193.153:0/2625567745 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4be803dc90 0x7f4be8040150 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4bfc0099c0 tx=0x7f4bfc006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:58.385 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.380+0000 7f4c190ec640 1 -- 10.20.193.153:0/2625567745 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4c141045f0 msgr2=0x7f4c1419bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:58.385 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.380+0000 7f4c190ec640 1 --2- 10.20.193.153:0/2625567745 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4c141045f0 0x7f4c1419bac0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4c08004290 tx=0x7f4c080042c0 comp rx=0 tx=0).stop 2026-02-17T20:56:58.385 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.380+0000 7f4c190ec640 1 -- 10.20.193.153:0/2625567745 shutdown_connections 2026-02-17T20:56:58.385 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.380+0000 7f4c190ec640 1 --2- 10.20.193.153:0/2625567745 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7f4be803dc90 0x7f4be8040150 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:58.385 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.380+0000 7f4c190ec640 1 --2- 10.20.193.153:0/2625567745 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4c141045f0 0x7f4c1419bac0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:58.385 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.380+0000 7f4c190ec640 1 -- 10.20.193.153:0/2625567745 >> 10.20.193.153:0/2625567745 conn(0x7f4c140ffda0 msgr2=0x7f4c14100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:58.385 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.380+0000 7f4c190ec640 1 -- 10.20.193.153:0/2625567745 shutdown_connections 2026-02-17T20:56:58.385 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:58.380+0000 7f4c190ec640 1 -- 10.20.193.153:0/2625567745 wait complete. 2026-02-17T20:56:58.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:58 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:58.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:58 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:58.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:58 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:58.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:58 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:58.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:58 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:58.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:58 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:58.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:58 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:58.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:58 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:56:58.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:58 trial104 ceph-mon[20612]: Deploying daemon prometheus.trial104 on trial104 2026-02-17T20:56:58.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:58 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/2625567745' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T20:56:59.419 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T20:56:59.420 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T20:56:59.562 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:56:59.589 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:56:59.690 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.686+0000 7fd385a69640 1 -- 10.20.193.153:0/3640174714 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd380102380 msgr2=0x7fd380102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:59.690 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.686+0000 7fd385a69640 1 --2- 10.20.193.153:0/3640174714 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd380102380 0x7fd380102780 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd3740099b0 tx=0x7fd37402f2b0 comp rx=0 tx=0).stop 2026-02-17T20:56:59.690 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.686+0000 7fd385a69640 1 -- 10.20.193.153:0/3640174714 shutdown_connections 2026-02-17T20:56:59.690 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.686+0000 7fd385a69640 1 --2- 10.20.193.153:0/3640174714 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd380102380 0x7fd380102780 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:59.690 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.686+0000 7fd385a69640 1 -- 10.20.193.153:0/3640174714 >> 10.20.193.153:0/3640174714 conn(0x7fd3800fdb10 msgr2=0x7fd3800fff50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:59.690 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.686+0000 7fd385a69640 1 -- 10.20.193.153:0/3640174714 shutdown_connections 2026-02-17T20:56:59.690 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.686+0000 7fd385a69640 1 -- 10.20.193.153:0/3640174714 wait complete. 2026-02-17T20:56:59.690 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.687+0000 7fd385a69640 1 Processor -- start 2026-02-17T20:56:59.691 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.687+0000 7fd385a69640 1 -- start start 2026-02-17T20:56:59.691 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.687+0000 7fd385a69640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd380102380 0x7fd380199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:59.691 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.687+0000 7fd385a69640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fd3801081c0 con 0x7fd380102380 2026-02-17T20:56:59.692 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.687+0000 7fd37effd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd380102380 0x7fd380199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:59.692 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.687+0000 7fd37effd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd380102380 0x7fd380199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.153:33702/0 (socket says 10.20.193.153:33702) 2026-02-17T20:56:59.692 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.687+0000 7fd37effd640 1 -- 10.20.193.153:0/85273183 learned_addr learned my addr 10.20.193.153:0/85273183 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:56:59.692 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.687+0000 7fd37effd640 1 -- 10.20.193.153:0/85273183 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd380199dd0 con 0x7fd380102380 2026-02-17T20:56:59.692 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.688+0000 7fd37effd640 1 --2- 10.20.193.153:0/85273183 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd380102380 0x7fd380199890 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd37402f860 tx=0x7fd37402fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:59.692 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.688+0000 7fd384a67640 1 -- 10.20.193.153:0/85273183 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fd374047070 con 0x7fd380102380 2026-02-17T20:56:59.692 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.688+0000 7fd385a69640 1 -- 10.20.193.153:0/85273183 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38019a060 con 0x7fd380102380 2026-02-17T20:56:59.693 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.688+0000 7fd385a69640 1 -- 10.20.193.153:0/85273183 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd38019cd50 con 0x7fd380102380 2026-02-17T20:56:59.693 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.688+0000 7fd384a67640 1 -- 10.20.193.153:0/85273183 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fd37403e070 con 0x7fd380102380 2026-02-17T20:56:59.693 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.688+0000 7fd384a67640 1 -- 10.20.193.153:0/85273183 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fd374042460 con 0x7fd380102380 2026-02-17T20:56:59.693 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.688+0000 7fd385a69640 1 -- 10.20.193.153:0/85273183 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd380108960 con 0x7fd380102380 2026-02-17T20:56:59.693 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.689+0000 7fd384a67640 1 -- 10.20.193.153:0/85273183 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 13) ==== 50318+0+0 (secure 0 0 0) 0x7fd374038890 con 0x7fd380102380 2026-02-17T20:56:59.693 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.689+0000 7fd384a67640 1 --2- 10.20.193.153:0/85273183 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fd35403dce0 0x7fd3540401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:56:59.693 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.689+0000 7fd384a67640 1 -- 10.20.193.153:0/85273183 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd374076b30 con 0x7fd380102380 2026-02-17T20:56:59.693 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.689+0000 7fd37e7fc640 1 --2- 10.20.193.153:0/85273183 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fd35403dce0 0x7fd3540401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:56:59.693 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.689+0000 7fd37e7fc640 1 --2- 10.20.193.153:0/85273183 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fd35403dce0 0x7fd3540401a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd3680099c0 tx=0x7fd368006eb0 comp rx=0 tx=0).ready entity=mgr.14162 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:56:59.694 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.691+0000 7fd384a67640 1 -- 10.20.193.153:0/85273183 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fd374042600 con 0x7fd380102380 2026-02-17T20:56:59.810 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.806+0000 7fd385a69640 1 -- 10.20.193.153:0/85273183 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fd380102800 con 0x7fd380102380 2026-02-17T20:56:59.810 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.807+0000 7fd384a67640 1 -- 10.20.193.153:0/85273183 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+752 (secure 0 0 0) 0x7fd380102800 con 0x7fd380102380 2026-02-17T20:56:59.811 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:56:59.811 INFO:teuthology.orchestra.run.trial153.stdout:{"epoch":1,"fsid":"19072504-0c43-11f1-93a3-d404e6e7d460","modified":"2026-02-17T20:56:27.459417Z","created":"2026-02-17T20:56:27.459417Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial104","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:3300","nonce":0},{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T20:56:59.812 INFO:teuthology.orchestra.run.trial153.stderr:dumped monmap epoch 1 2026-02-17T20:56:59.812 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.808+0000 7fd385a69640 1 -- 10.20.193.153:0/85273183 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fd35403dce0 msgr2=0x7fd3540401a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:59.812 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.808+0000 7fd385a69640 1 --2- 10.20.193.153:0/85273183 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fd35403dce0 0x7fd3540401a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd3680099c0 tx=0x7fd368006eb0 comp rx=0 tx=0).stop 2026-02-17T20:56:59.812 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.808+0000 7fd385a69640 1 -- 10.20.193.153:0/85273183 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd380102380 msgr2=0x7fd380199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:56:59.812 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.808+0000 7fd385a69640 1 --2- 10.20.193.153:0/85273183 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd380102380 0x7fd380199890 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd37402f860 tx=0x7fd37402fea0 comp rx=0 tx=0).stop 2026-02-17T20:56:59.812 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.808+0000 7fd385a69640 1 -- 10.20.193.153:0/85273183 shutdown_connections 2026-02-17T20:56:59.812 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.808+0000 7fd385a69640 1 --2- 10.20.193.153:0/85273183 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fd35403dce0 0x7fd3540401a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:59.812 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.808+0000 7fd385a69640 1 --2- 10.20.193.153:0/85273183 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fd380102380 0x7fd380199890 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:56:59.813 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.808+0000 7fd385a69640 1 -- 10.20.193.153:0/85273183 >> 10.20.193.153:0/85273183 conn(0x7fd3800fdb10 msgr2=0x7fd3800fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:56:59.813 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.808+0000 7fd385a69640 1 -- 10.20.193.153:0/85273183 shutdown_connections 2026-02-17T20:56:59.813 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:56:59.808+0000 7fd385a69640 1 -- 10.20.193.153:0/85273183 wait complete. 2026-02-17T20:56:59.929 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:56:59 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/85273183' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T20:57:00.845 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T20:57:00.846 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T20:57:01.005 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:57:01.045 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:57:01.145 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.141+0000 7fcd005d8640 1 -- 10.20.193.153:0/534399421 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fccf81045f0 msgr2=0x7fccf81049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:01.145 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.141+0000 7fcd005d8640 1 --2- 10.20.193.153:0/534399421 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fccf81045f0 0x7fccf81049f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcce8009990 tx=0x7fcce802f290 comp rx=0 tx=0).stop 2026-02-17T20:57:01.145 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.141+0000 7fcd005d8640 1 -- 10.20.193.153:0/534399421 shutdown_connections 2026-02-17T20:57:01.145 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.141+0000 7fcd005d8640 1 --2- 10.20.193.153:0/534399421 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fccf81045f0 0x7fccf81049f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:01.145 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.141+0000 7fcd005d8640 1 -- 10.20.193.153:0/534399421 >> 10.20.193.153:0/534399421 conn(0x7fccf80ffda0 msgr2=0x7fccf81021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:01.146 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.141+0000 7fcd005d8640 1 -- 10.20.193.153:0/534399421 shutdown_connections 2026-02-17T20:57:01.146 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.141+0000 7fcd005d8640 1 -- 10.20.193.153:0/534399421 wait complete. 2026-02-17T20:57:01.146 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.141+0000 7fcd005d8640 1 Processor -- start 2026-02-17T20:57:01.146 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.141+0000 7fcd005d8640 1 -- start start 2026-02-17T20:57:01.146 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.141+0000 7fcd005d8640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fccf81045f0 0x7fccf819bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:01.146 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.141+0000 7fcd005d8640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fccf810a430 con 0x7fccf81045f0 2026-02-17T20:57:01.146 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.141+0000 7fccfe34d640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fccf81045f0 0x7fccf819bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:01.146 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.142+0000 7fccfe34d640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fccf81045f0 0x7fccf819bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.153:33728/0 (socket says 10.20.193.153:33728) 2026-02-17T20:57:01.146 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.142+0000 7fccfe34d640 1 -- 10.20.193.153:0/2425563420 learned_addr learned my addr 10.20.193.153:0/2425563420 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:57:01.146 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.142+0000 7fccfe34d640 1 -- 10.20.193.153:0/2425563420 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccf819c000 con 0x7fccf81045f0 2026-02-17T20:57:01.148 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.142+0000 7fccfe34d640 1 --2- 10.20.193.153:0/2425563420 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fccf81045f0 0x7fccf819bac0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcce8002410 tx=0x7fcce8004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:01.148 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.143+0000 7fccdf7fe640 1 -- 10.20.193.153:0/2425563420 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fcce80045b0 con 0x7fccf81045f0 2026-02-17T20:57:01.148 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.143+0000 7fccdf7fe640 1 -- 10.20.193.153:0/2425563420 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fcce8004d30 con 0x7fccf81045f0 2026-02-17T20:57:01.148 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.143+0000 7fcd005d8640 1 -- 10.20.193.153:0/2425563420 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccf819c290 con 0x7fccf81045f0 2026-02-17T20:57:01.148 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.143+0000 7fccdf7fe640 1 -- 10.20.193.153:0/2425563420 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fcce8038510 con 0x7fccf81045f0 2026-02-17T20:57:01.148 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.143+0000 7fcd005d8640 1 -- 10.20.193.153:0/2425563420 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccf819ef80 con 0x7fccf81045f0 2026-02-17T20:57:01.148 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.143+0000 7fcd005d8640 1 -- 10.20.193.153:0/2425563420 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccf810abd0 con 0x7fccf81045f0 2026-02-17T20:57:01.149 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.143+0000 7fccdf7fe640 1 -- 10.20.193.153:0/2425563420 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 14) ==== 50332+0+0 (secure 0 0 0) 0x7fcce8005020 con 0x7fccf81045f0 2026-02-17T20:57:01.149 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.144+0000 7fccdf7fe640 1 --2- 10.20.193.153:0/2425563420 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fccd403dd30 0x7fccd40401f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:01.149 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.144+0000 7fccdf7fe640 1 -- 10.20.193.153:0/2425563420 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcce803e070 con 0x7fccf81045f0 2026-02-17T20:57:01.149 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.144+0000 7fccfdb4c640 1 -- 10.20.193.153:0/2425563420 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fccd403dd30 msgr2=0x7fccd40401f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.104:6800/1034073782 2026-02-17T20:57:01.149 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.144+0000 7fccfdb4c640 1 --2- 10.20.193.153:0/2425563420 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fccd403dd30 0x7fccd40401f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T20:57:01.149 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.146+0000 7fccdf7fe640 1 -- 10.20.193.153:0/2425563420 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcce8047270 con 0x7fccf81045f0 2026-02-17T20:57:01.264 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.261+0000 7fcd005d8640 1 -- 10.20.193.153:0/2425563420 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fccf8194e60 con 0x7fccf81045f0 2026-02-17T20:57:01.265 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.261+0000 7fccdf7fe640 1 -- 10.20.193.153:0/2425563420 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+752 (secure 0 0 0) 0x7fcce8036df0 con 0x7fccf81045f0 2026-02-17T20:57:01.265 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:57:01.265 INFO:teuthology.orchestra.run.trial153.stdout:{"epoch":1,"fsid":"19072504-0c43-11f1-93a3-d404e6e7d460","modified":"2026-02-17T20:56:27.459417Z","created":"2026-02-17T20:56:27.459417Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial104","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:3300","nonce":0},{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T20:57:01.266 INFO:teuthology.orchestra.run.trial153.stderr:dumped monmap epoch 1 2026-02-17T20:57:01.266 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.262+0000 7fcd005d8640 1 -- 10.20.193.153:0/2425563420 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fccd403dd30 msgr2=0x7fccd40401f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T20:57:01.266 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.262+0000 7fcd005d8640 1 --2- 10.20.193.153:0/2425563420 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fccd403dd30 0x7fccd40401f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:01.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.262+0000 7fcd005d8640 1 -- 10.20.193.153:0/2425563420 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fccf81045f0 msgr2=0x7fccf819bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:01.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.262+0000 7fcd005d8640 1 --2- 10.20.193.153:0/2425563420 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fccf81045f0 0x7fccf819bac0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcce8002410 tx=0x7fcce8004290 comp rx=0 tx=0).stop 2026-02-17T20:57:01.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.262+0000 7fcd005d8640 1 -- 10.20.193.153:0/2425563420 shutdown_connections 2026-02-17T20:57:01.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.262+0000 7fcd005d8640 1 --2- 10.20.193.153:0/2425563420 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7fccd403dd30 0x7fccd40401f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:01.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.262+0000 7fcd005d8640 1 --2- 10.20.193.153:0/2425563420 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fccf81045f0 0x7fccf819bac0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:01.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.262+0000 7fcd005d8640 1 -- 10.20.193.153:0/2425563420 >> 10.20.193.153:0/2425563420 conn(0x7fccf80ffda0 msgr2=0x7fccf8100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:01.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.262+0000 7fcd005d8640 1 -- 10.20.193.153:0/2425563420 shutdown_connections 2026-02-17T20:57:01.267 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:01.262+0000 7fcd005d8640 1 -- 10.20.193.153:0/2425563420 wait complete. 2026-02-17T20:57:01.361 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:00 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:01.361 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:00 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:01.361 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:00 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:01.361 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:00 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2026-02-17T20:57:02.302 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T20:57:02.303 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T20:57:02.346 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:01 trial104 ceph-mon[20612]: from='mgr.14162 10.20.193.104:0/2422630420' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2026-02-17T20:57:02.346 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:01 trial104 ceph-mon[20612]: mgrmap e14: trial104.irrhmt(active, since 13s) 2026-02-17T20:57:02.346 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:01 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/2425563420' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T20:57:02.445 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:57:02.476 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:57:02.584 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.579+0000 7ff0defab640 1 -- 10.20.193.153:0/1508167072 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff0d81045f0 msgr2=0x7ff0d81049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:02.584 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.579+0000 7ff0defab640 1 --2- 10.20.193.153:0/1508167072 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff0d81045f0 0x7ff0d81049f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8009990 tx=0x7ff0c802f290 comp rx=0 tx=0).stop 2026-02-17T20:57:02.584 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.579+0000 7ff0defab640 1 -- 10.20.193.153:0/1508167072 shutdown_connections 2026-02-17T20:57:02.584 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.579+0000 7ff0defab640 1 --2- 10.20.193.153:0/1508167072 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff0d81045f0 0x7ff0d81049f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:02.584 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.579+0000 7ff0defab640 1 -- 10.20.193.153:0/1508167072 >> 10.20.193.153:0/1508167072 conn(0x7ff0d80ffda0 msgr2=0x7ff0d81021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:02.584 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.579+0000 7ff0defab640 1 -- 10.20.193.153:0/1508167072 shutdown_connections 2026-02-17T20:57:02.585 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.579+0000 7ff0defab640 1 -- 10.20.193.153:0/1508167072 wait complete. 2026-02-17T20:57:02.585 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.580+0000 7ff0defab640 1 Processor -- start 2026-02-17T20:57:02.585 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.580+0000 7ff0defab640 1 -- start start 2026-02-17T20:57:02.585 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.580+0000 7ff0defab640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff0d81045f0 0x7ff0d819bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:02.585 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.580+0000 7ff0defab640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d810a430 con 0x7ff0d81045f0 2026-02-17T20:57:02.585 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.580+0000 7ff0dcd20640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff0d81045f0 0x7ff0d819bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:02.585 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.580+0000 7ff0dcd20640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff0d81045f0 0x7ff0d819bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.153:33746/0 (socket says 10.20.193.153:33746) 2026-02-17T20:57:02.585 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.580+0000 7ff0dcd20640 1 -- 10.20.193.153:0/2304813936 learned_addr learned my addr 10.20.193.153:0/2304813936 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:57:02.585 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.581+0000 7ff0dcd20640 1 -- 10.20.193.153:0/2304813936 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d819c000 con 0x7ff0d81045f0 2026-02-17T20:57:02.585 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.581+0000 7ff0dcd20640 1 --2- 10.20.193.153:0/2304813936 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff0d81045f0 0x7ff0d819bac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8004290 tx=0x7ff0c80042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:02.587 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.581+0000 7ff0cdffb640 1 -- 10.20.193.153:0/2304813936 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff0c80048c0 con 0x7ff0d81045f0 2026-02-17T20:57:02.587 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.581+0000 7ff0defab640 1 -- 10.20.193.153:0/2304813936 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d819c290 con 0x7ff0d81045f0 2026-02-17T20:57:02.587 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.581+0000 7ff0defab640 1 -- 10.20.193.153:0/2304813936 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d819ef80 con 0x7ff0d81045f0 2026-02-17T20:57:02.587 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.581+0000 7ff0cdffb640 1 -- 10.20.193.153:0/2304813936 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7ff0c8005020 con 0x7ff0d81045f0 2026-02-17T20:57:02.587 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.581+0000 7ff0cdffb640 1 -- 10.20.193.153:0/2304813936 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7ff0c8038510 con 0x7ff0d81045f0 2026-02-17T20:57:02.587 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.582+0000 7ff0defab640 1 -- 10.20.193.153:0/2304813936 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d810abd0 con 0x7ff0d81045f0 2026-02-17T20:57:02.587 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.582+0000 7ff0cdffb640 1 -- 10.20.193.153:0/2304813936 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 14) ==== 50332+0+0 (secure 0 0 0) 0x7ff0c8004a60 con 0x7ff0d81045f0 2026-02-17T20:57:02.588 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.582+0000 7ff0cdffb640 1 --2- 10.20.193.153:0/2304813936 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7ff0b403dd00 0x7ff0b40401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:02.588 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.582+0000 7ff0cdffb640 1 -- 10.20.193.153:0/2304813936 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff0c803e070 con 0x7ff0d81045f0 2026-02-17T20:57:02.588 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.582+0000 7ff0cffff640 1 -- 10.20.193.153:0/2304813936 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7ff0b403dd00 msgr2=0x7ff0b40401c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.104:6800/1034073782 2026-02-17T20:57:02.588 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.582+0000 7ff0cffff640 1 --2- 10.20.193.153:0/2304813936 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7ff0b403dd00 0x7ff0b40401c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T20:57:02.588 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.585+0000 7ff0cdffb640 1 -- 10.20.193.153:0/2304813936 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff0c8045c30 con 0x7ff0d81045f0 2026-02-17T20:57:02.703 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.700+0000 7ff0defab640 1 -- 10.20.193.153:0/2304813936 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7ff0d8194e30 con 0x7ff0d81045f0 2026-02-17T20:57:02.703 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.700+0000 7ff0cdffb640 1 -- 10.20.193.153:0/2304813936 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+752 (secure 0 0 0) 0x7ff0c80055b0 con 0x7ff0d81045f0 2026-02-17T20:57:02.704 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:57:02.704 INFO:teuthology.orchestra.run.trial153.stdout:{"epoch":1,"fsid":"19072504-0c43-11f1-93a3-d404e6e7d460","modified":"2026-02-17T20:56:27.459417Z","created":"2026-02-17T20:56:27.459417Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial104","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:3300","nonce":0},{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T20:57:02.705 INFO:teuthology.orchestra.run.trial153.stderr:dumped monmap epoch 1 2026-02-17T20:57:02.705 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.701+0000 7ff0defab640 1 -- 10.20.193.153:0/2304813936 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7ff0b403dd00 msgr2=0x7ff0b40401c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T20:57:02.705 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.701+0000 7ff0defab640 1 --2- 10.20.193.153:0/2304813936 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7ff0b403dd00 0x7ff0b40401c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:02.705 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.701+0000 7ff0defab640 1 -- 10.20.193.153:0/2304813936 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff0d81045f0 msgr2=0x7ff0d819bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:02.705 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.701+0000 7ff0defab640 1 --2- 10.20.193.153:0/2304813936 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff0d81045f0 0x7ff0d819bac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff0c8004290 tx=0x7ff0c80042c0 comp rx=0 tx=0).stop 2026-02-17T20:57:02.705 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.701+0000 7ff0defab640 1 -- 10.20.193.153:0/2304813936 shutdown_connections 2026-02-17T20:57:02.706 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.701+0000 7ff0defab640 1 --2- 10.20.193.153:0/2304813936 >> [v2:10.20.193.104:6800/1034073782,v1:10.20.193.104:6801/1034073782] conn(0x7ff0b403dd00 0x7ff0b40401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:02.706 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.701+0000 7ff0defab640 1 --2- 10.20.193.153:0/2304813936 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff0d81045f0 0x7ff0d819bac0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:02.706 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.701+0000 7ff0defab640 1 -- 10.20.193.153:0/2304813936 >> 10.20.193.153:0/2304813936 conn(0x7ff0d80ffda0 msgr2=0x7ff0d8100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:02.706 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.701+0000 7ff0defab640 1 -- 10.20.193.153:0/2304813936 shutdown_connections 2026-02-17T20:57:02.706 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:02.701+0000 7ff0defab640 1 -- 10.20.193.153:0/2304813936 wait complete. 2026-02-17T20:57:03.226 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:02 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/2304813936' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T20:57:03.741 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T20:57:03.742 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T20:57:03.885 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:57:03.914 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:57:04.027 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.022+0000 7f642dc97640 1 -- 10.20.193.153:0/1166873510 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64281045f0 msgr2=0x7f64281049f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:04.027 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.022+0000 7f642dc97640 1 --2- 10.20.193.153:0/1166873510 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64281045f0 0x7f64281049f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6414009990 tx=0x7f641402f290 comp rx=0 tx=0).stop 2026-02-17T20:57:04.027 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.022+0000 7f642dc97640 1 -- 10.20.193.153:0/1166873510 shutdown_connections 2026-02-17T20:57:04.027 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.022+0000 7f642dc97640 1 --2- 10.20.193.153:0/1166873510 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64281045f0 0x7f64281049f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:04.027 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.022+0000 7f642dc97640 1 -- 10.20.193.153:0/1166873510 >> 10.20.193.153:0/1166873510 conn(0x7f64280ffda0 msgr2=0x7f64281021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:04.027 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.022+0000 7f642dc97640 1 -- 10.20.193.153:0/1166873510 shutdown_connections 2026-02-17T20:57:04.027 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.022+0000 7f642dc97640 1 -- 10.20.193.153:0/1166873510 wait complete. 2026-02-17T20:57:04.027 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.022+0000 7f642dc97640 1 Processor -- start 2026-02-17T20:57:04.028 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.022+0000 7f642dc97640 1 -- start start 2026-02-17T20:57:04.028 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.022+0000 7f642dc97640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64281045f0 0x7f642819bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:04.028 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.022+0000 7f642dc97640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f642810a430 con 0x7f64281045f0 2026-02-17T20:57:04.028 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.023+0000 7f64277fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64281045f0 0x7f642819bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:04.028 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.023+0000 7f64277fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64281045f0 0x7f642819bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.153:33766/0 (socket says 10.20.193.153:33766) 2026-02-17T20:57:04.028 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.023+0000 7f64277fe640 1 -- 10.20.193.153:0/4141091728 learned_addr learned my addr 10.20.193.153:0/4141091728 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:57:04.028 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.023+0000 7f64277fe640 1 -- 10.20.193.153:0/4141091728 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642819c000 con 0x7f64281045f0 2026-02-17T20:57:04.028 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.023+0000 7f64277fe640 1 --2- 10.20.193.153:0/4141091728 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64281045f0 0x7f642819bac0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6414004290 tx=0x7f64140042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:04.028 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.023+0000 7f6424ff9640 1 -- 10.20.193.153:0/4141091728 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f64140048c0 con 0x7f64281045f0 2026-02-17T20:57:04.028 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.023+0000 7f6424ff9640 1 -- 10.20.193.153:0/4141091728 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f6414005020 con 0x7f64281045f0 2026-02-17T20:57:04.028 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.023+0000 7f642dc97640 1 -- 10.20.193.153:0/4141091728 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f642819c290 con 0x7f64281045f0 2026-02-17T20:57:04.029 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.023+0000 7f642dc97640 1 -- 10.20.193.153:0/4141091728 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f642819ef80 con 0x7f64281045f0 2026-02-17T20:57:04.029 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.023+0000 7f6424ff9640 1 -- 10.20.193.153:0/4141091728 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f641404f060 con 0x7f64281045f0 2026-02-17T20:57:04.029 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.024+0000 7f642dc97640 1 -- 10.20.193.153:0/4141091728 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f642810abd0 con 0x7f64281045f0 2026-02-17T20:57:04.029 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.024+0000 7f6424ff9640 1 -- 10.20.193.153:0/4141091728 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 15) ==== 50055+0+0 (secure 0 0 0) 0x7f6414052080 con 0x7f64281045f0 2026-02-17T20:57:04.029 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.024+0000 7f6424ff9640 1 -- 10.20.193.153:0/4141091728 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f641403e070 con 0x7f64281045f0 2026-02-17T20:57:04.030 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.027+0000 7f6424ff9640 1 -- 10.20.193.153:0/4141091728 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6414047270 con 0x7f64281045f0 2026-02-17T20:57:04.144 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.141+0000 7f642dc97640 1 -- 10.20.193.153:0/4141091728 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f6428194e60 con 0x7f64281045f0 2026-02-17T20:57:04.144 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.141+0000 7f6424ff9640 1 -- 10.20.193.153:0/4141091728 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+752 (secure 0 0 0) 0x7f6414005610 con 0x7f64281045f0 2026-02-17T20:57:04.145 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:57:04.145 INFO:teuthology.orchestra.run.trial153.stdout:{"epoch":1,"fsid":"19072504-0c43-11f1-93a3-d404e6e7d460","modified":"2026-02-17T20:56:27.459417Z","created":"2026-02-17T20:56:27.459417Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial104","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:3300","nonce":0},{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T20:57:04.145 INFO:teuthology.orchestra.run.trial153.stderr:dumped monmap epoch 1 2026-02-17T20:57:04.146 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.143+0000 7f642dc97640 1 -- 10.20.193.153:0/4141091728 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64281045f0 msgr2=0x7f642819bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:04.146 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.143+0000 7f642dc97640 1 --2- 10.20.193.153:0/4141091728 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64281045f0 0x7f642819bac0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6414004290 tx=0x7f64140042c0 comp rx=0 tx=0).stop 2026-02-17T20:57:04.147 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.143+0000 7f642dc97640 1 -- 10.20.193.153:0/4141091728 shutdown_connections 2026-02-17T20:57:04.147 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.143+0000 7f642dc97640 1 --2- 10.20.193.153:0/4141091728 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64281045f0 0x7f642819bac0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:04.147 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.143+0000 7f642dc97640 1 -- 10.20.193.153:0/4141091728 >> 10.20.193.153:0/4141091728 conn(0x7f64280ffda0 msgr2=0x7f6428100800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:04.147 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.143+0000 7f642dc97640 1 -- 10.20.193.153:0/4141091728 shutdown_connections 2026-02-17T20:57:04.147 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:04.143+0000 7f642dc97640 1 -- 10.20.193.153:0/4141091728 wait complete. 2026-02-17T20:57:04.273 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:03 trial104 ceph-mon[20612]: Active manager daemon trial104.irrhmt restarted 2026-02-17T20:57:04.273 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:03 trial104 ceph-mon[20612]: Activating manager daemon trial104.irrhmt 2026-02-17T20:57:04.273 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:03 trial104 ceph-mon[20612]: osdmap e5: 0 total, 0 up, 0 in 2026-02-17T20:57:04.273 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:03 trial104 ceph-mon[20612]: mgrmap e15: trial104.irrhmt(active, starting, since 0.00270347s) 2026-02-17T20:57:04.274 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial104"}]: dispatch 2026-02-17T20:57:04.274 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mgr metadata", "who": "trial104.irrhmt", "id": "trial104.irrhmt"}]: dispatch 2026-02-17T20:57:04.274 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mds metadata"}]: dispatch 2026-02-17T20:57:04.274 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata"}]: dispatch 2026-02-17T20:57:04.274 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata"}]: dispatch 2026-02-17T20:57:04.274 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:03 trial104 ceph-mon[20612]: Manager daemon trial104.irrhmt is now available 2026-02-17T20:57:04.274 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:04.274 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:04.274 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:57:04.274 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial104.irrhmt/mirror_snapshot_schedule"}]: dispatch 2026-02-17T20:57:04.274 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/trial104.irrhmt/trash_purge_schedule"}]: dispatch 2026-02-17T20:57:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:04 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/4141091728' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T20:57:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:04 trial104 ceph-mon[20612]: mgrmap e16: trial104.irrhmt(active, since 1.00439s) 2026-02-17T20:57:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:05.183 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T20:57:05.183 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T20:57:05.361 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:57:05.393 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-17T20:57:05.549 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.544+0000 7f27a2ffd640 1 -- 10.20.193.153:0/2052874684 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f2790038470 con 0x7f27a4102380 2026-02-17T20:57:05.549 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.545+0000 7f27aa65d640 1 -- 10.20.193.153:0/2052874684 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f27a4102380 msgr2=0x7f27a4102780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:05.549 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.545+0000 7f27aa65d640 1 --2- 10.20.193.153:0/2052874684 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f27a4102380 0x7f27a4102780 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f27900099b0 tx=0x7f279002f2b0 comp rx=0 tx=0).stop 2026-02-17T20:57:05.549 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.545+0000 7f27aa65d640 1 -- 10.20.193.153:0/2052874684 shutdown_connections 2026-02-17T20:57:05.549 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.545+0000 7f27aa65d640 1 --2- 10.20.193.153:0/2052874684 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f27a4102380 0x7f27a4102780 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:05.549 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.545+0000 7f27aa65d640 1 -- 10.20.193.153:0/2052874684 >> 10.20.193.153:0/2052874684 conn(0x7f27a40fdb10 msgr2=0x7f27a40fff50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:05.549 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.545+0000 7f27aa65d640 1 -- 10.20.193.153:0/2052874684 shutdown_connections 2026-02-17T20:57:05.549 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.545+0000 7f27aa65d640 1 -- 10.20.193.153:0/2052874684 wait complete. 2026-02-17T20:57:05.550 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.545+0000 7f27aa65d640 1 Processor -- start 2026-02-17T20:57:05.550 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.545+0000 7f27aa65d640 1 -- start start 2026-02-17T20:57:05.550 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.545+0000 7f27aa65d640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f27a4102380 0x7f27a419bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:05.550 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.545+0000 7f27aa65d640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f27a40758c0 con 0x7f27a4102380 2026-02-17T20:57:05.550 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.546+0000 7f27a3fff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f27a4102380 0x7f27a419bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:05.550 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.546+0000 7f27a3fff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f27a4102380 0x7f27a419bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.153:33780/0 (socket says 10.20.193.153:33780) 2026-02-17T20:57:05.550 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.546+0000 7f27a3fff640 1 -- 10.20.193.153:0/3046611870 learned_addr learned my addr 10.20.193.153:0/3046611870 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:57:05.550 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.546+0000 7f27a3fff640 1 -- 10.20.193.153:0/3046611870 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27a419c070 con 0x7f27a4102380 2026-02-17T20:57:05.550 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.546+0000 7f27a3fff640 1 --2- 10.20.193.153:0/3046611870 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f27a4102380 0x7f27a419bb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2790002a50 tx=0x7f279002fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:05.551 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.546+0000 7f27a17fa640 1 -- 10.20.193.153:0/3046611870 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f27900042f0 con 0x7f27a4102380 2026-02-17T20:57:05.551 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.546+0000 7f27a17fa640 1 -- 10.20.193.153:0/3046611870 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f2790046070 con 0x7f27a4102380 2026-02-17T20:57:05.551 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.546+0000 7f27aa65d640 1 -- 10.20.193.153:0/3046611870 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27a419c300 con 0x7f27a4102380 2026-02-17T20:57:05.551 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.546+0000 7f27a17fa640 1 -- 10.20.193.153:0/3046611870 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f2790041710 con 0x7f27a4102380 2026-02-17T20:57:05.551 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.546+0000 7f27aa65d640 1 -- 10.20.193.153:0/3046611870 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27a419eff0 con 0x7f27a4102380 2026-02-17T20:57:05.551 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.547+0000 7f27aa65d640 1 -- 10.20.193.153:0/3046611870 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27a4076060 con 0x7f27a4102380 2026-02-17T20:57:05.551 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.547+0000 7f27a17fa640 1 -- 10.20.193.153:0/3046611870 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 16) ==== 50182+0+0 (secure 0 0 0) 0x7f2790038770 con 0x7f27a4102380 2026-02-17T20:57:05.551 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.547+0000 7f27a17fa640 1 --2- 10.20.193.153:0/3046611870 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f277803db70 0x7f2778040030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:05.551 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.547+0000 7f27a17fa640 1 -- 10.20.193.153:0/3046611870 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f2790077140 con 0x7f27a4102380 2026-02-17T20:57:05.551 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.548+0000 7f27a37fe640 1 --2- 10.20.193.153:0/3046611870 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f277803db70 0x7f2778040030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:05.552 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.548+0000 7f27a37fe640 1 --2- 10.20.193.153:0/3046611870 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f277803db70 0x7f2778040030 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f27940099c0 tx=0x7f2794006eb0 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:05.553 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.549+0000 7f27a17fa640 1 -- 10.20.193.153:0/3046611870 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2790038a90 con 0x7f27a4102380 2026-02-17T20:57:05.667 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.663+0000 7f27aa65d640 1 -- 10.20.193.153:0/3046611870 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f27a4102800 con 0x7f27a4102380 2026-02-17T20:57:05.667 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.663+0000 7f27a17fa640 1 -- 10.20.193.153:0/3046611870 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+752 (secure 0 0 0) 0x7f2790075b20 con 0x7f27a4102380 2026-02-17T20:57:05.667 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:57:05.667 INFO:teuthology.orchestra.run.trial153.stdout:{"epoch":1,"fsid":"19072504-0c43-11f1-93a3-d404e6e7d460","modified":"2026-02-17T20:56:27.459417Z","created":"2026-02-17T20:56:27.459417Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial104","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:3300","nonce":0},{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T20:57:05.668 INFO:teuthology.orchestra.run.trial153.stderr:dumped monmap epoch 1 2026-02-17T20:57:05.668 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.664+0000 7f27aa65d640 1 -- 10.20.193.153:0/3046611870 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f277803db70 msgr2=0x7f2778040030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:05.668 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.664+0000 7f27aa65d640 1 --2- 10.20.193.153:0/3046611870 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f277803db70 0x7f2778040030 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f27940099c0 tx=0x7f2794006eb0 comp rx=0 tx=0).stop 2026-02-17T20:57:05.668 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.664+0000 7f27aa65d640 1 -- 10.20.193.153:0/3046611870 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f27a4102380 msgr2=0x7f27a419bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:05.668 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.664+0000 7f27aa65d640 1 --2- 10.20.193.153:0/3046611870 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f27a4102380 0x7f27a419bb30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2790002a50 tx=0x7f279002fea0 comp rx=0 tx=0).stop 2026-02-17T20:57:05.668 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.664+0000 7f27aa65d640 1 -- 10.20.193.153:0/3046611870 shutdown_connections 2026-02-17T20:57:05.668 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.664+0000 7f27aa65d640 1 --2- 10.20.193.153:0/3046611870 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f277803db70 0x7f2778040030 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:05.668 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.664+0000 7f27aa65d640 1 --2- 10.20.193.153:0/3046611870 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f27a4102380 0x7f27a419bb30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:05.668 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.664+0000 7f27aa65d640 1 -- 10.20.193.153:0/3046611870 >> 10.20.193.153:0/3046611870 conn(0x7f27a40fdb10 msgr2=0x7f27a4105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:05.669 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.664+0000 7f27aa65d640 1 -- 10.20.193.153:0/3046611870 shutdown_connections 2026-02-17T20:57:05.669 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:05.664+0000 7f27aa65d640 1 -- 10.20.193.153:0/3046611870 wait complete. 2026-02-17T20:57:06.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: [17/Feb/2026:20:57:04] ENGINE Bus STARTING 2026-02-17T20:57:06.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: [17/Feb/2026:20:57:04] ENGINE Serving on http://10.20.193.104:8765 2026-02-17T20:57:06.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: [17/Feb/2026:20:57:04] ENGINE Serving on https://10.20.193.104:7150 2026-02-17T20:57:06.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: [17/Feb/2026:20:57:04] ENGINE Bus STARTED 2026-02-17T20:57:06.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: [17/Feb/2026:20:57:04] ENGINE Client ('10.20.193.104', 40926) lost — peer dropped the TLS connection suddenly, during handshake: (6, 'TLS/SSL connection has been closed (EOF) (_ssl.c:1147)') 2026-02-17T20:57:06.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:06.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:06.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd/host:trial104", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:06.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:06.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:06.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:06.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:06.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd/host:trial153", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:06.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:06.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:06.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/3046611870' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T20:57:06.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:06.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:06.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:06.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:06.407 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:06.407 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-17T20:57:06.407 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2026-02-17T20:57:06.407 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:06.705 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T20:57:06.706 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T20:57:06.879 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/config/ceph.conf 2026-02-17T20:57:06.991 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.985+0000 7f46b191b640 1 -- 10.20.193.153:0/1700235449 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f46ac10a660 msgr2=0x7f46ac10aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:06.991 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.985+0000 7f46b191b640 1 --2- 10.20.193.153:0/1700235449 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f46ac10a660 0x7f46ac10aa40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f46a00099b0 tx=0x7f46a002f2b0 comp rx=0 tx=0).stop 2026-02-17T20:57:06.991 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.985+0000 7f46b191b640 1 -- 10.20.193.153:0/1700235449 shutdown_connections 2026-02-17T20:57:06.991 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.985+0000 7f46b191b640 1 --2- 10.20.193.153:0/1700235449 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f46ac10a660 0x7f46ac10aa40 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:06.991 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.985+0000 7f46b191b640 1 -- 10.20.193.153:0/1700235449 >> 10.20.193.153:0/1700235449 conn(0x7f46ac100250 msgr2=0x7f46ac102670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:06.991 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.985+0000 7f46b191b640 1 -- 10.20.193.153:0/1700235449 shutdown_connections 2026-02-17T20:57:06.991 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.985+0000 7f46b191b640 1 -- 10.20.193.153:0/1700235449 wait complete. 2026-02-17T20:57:06.991 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.985+0000 7f46b191b640 1 Processor -- start 2026-02-17T20:57:06.992 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.985+0000 7f46b191b640 1 -- start start 2026-02-17T20:57:06.992 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.985+0000 7f46b191b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f46ac10a660 0x7f46ac19be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:06.992 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.985+0000 7f46b191b640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f46ac10e9b0 con 0x7f46ac10a660 2026-02-17T20:57:06.992 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.986+0000 7f46aaffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f46ac10a660 0x7f46ac19be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:06.992 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.986+0000 7f46aaffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f46ac10a660 0x7f46ac19be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.153:33792/0 (socket says 10.20.193.153:33792) 2026-02-17T20:57:06.992 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.986+0000 7f46aaffd640 1 -- 10.20.193.153:0/915242075 learned_addr learned my addr 10.20.193.153:0/915242075 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:57:06.992 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.986+0000 7f46aaffd640 1 -- 10.20.193.153:0/915242075 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46ac19c380 con 0x7f46ac10a660 2026-02-17T20:57:06.992 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.986+0000 7f46aaffd640 1 --2- 10.20.193.153:0/915242075 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f46ac10a660 0x7f46ac19be40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f46a0002410 tx=0x7f46a0002d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:06.992 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.986+0000 7f46b0919640 1 -- 10.20.193.153:0/915242075 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f46a0047070 con 0x7f46ac10a660 2026-02-17T20:57:06.992 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.986+0000 7f46b0919640 1 -- 10.20.193.153:0/915242075 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f46a003e070 con 0x7f46ac10a660 2026-02-17T20:57:06.992 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.986+0000 7f46b191b640 1 -- 10.20.193.153:0/915242075 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46ac19c610 con 0x7f46ac10a660 2026-02-17T20:57:06.992 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.986+0000 7f46b191b640 1 -- 10.20.193.153:0/915242075 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46ac19ca70 con 0x7f46ac10a660 2026-02-17T20:57:06.994 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.987+0000 7f46b0919640 1 -- 10.20.193.153:0/915242075 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f46a0051060 con 0x7f46ac10a660 2026-02-17T20:57:06.994 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.987+0000 7f46b191b640 1 -- 10.20.193.153:0/915242075 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46ac105cd0 con 0x7f46ac10a660 2026-02-17T20:57:06.994 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.988+0000 7f46b0919640 1 -- 10.20.193.153:0/915242075 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 17) ==== 50376+0+0 (secure 0 0 0) 0x7f46a0004260 con 0x7f46ac10a660 2026-02-17T20:57:06.994 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.988+0000 7f46b0919640 1 --2- 10.20.193.153:0/915242075 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f468003dd80 0x7f4680040240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:06.994 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.988+0000 7f46b0919640 1 -- 10.20.193.153:0/915242075 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f46a00770e0 con 0x7f46ac10a660 2026-02-17T20:57:06.994 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.988+0000 7f46aa7fc640 1 --2- 10.20.193.153:0/915242075 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f468003dd80 0x7f4680040240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:06.994 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.988+0000 7f46aa7fc640 1 --2- 10.20.193.153:0/915242075 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f468003dd80 0x7f4680040240 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f46940099c0 tx=0x7f4694006eb0 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:06.995 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:06.990+0000 7f46b0919640 1 -- 10.20.193.153:0/915242075 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f46a0038890 con 0x7f46ac10a660 2026-02-17T20:57:07.112 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:07.108+0000 7f46b191b640 1 -- 10.20.193.153:0/915242075 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f46ac19d1a0 con 0x7f46ac10a660 2026-02-17T20:57:07.113 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:07.108+0000 7f46b0919640 1 -- 10.20.193.153:0/915242075 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+752 (secure 0 0 0) 0x7f46a0033d70 con 0x7f46ac10a660 2026-02-17T20:57:07.113 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:57:07.113 INFO:teuthology.orchestra.run.trial153.stdout:{"epoch":1,"fsid":"19072504-0c43-11f1-93a3-d404e6e7d460","modified":"2026-02-17T20:56:27.459417Z","created":"2026-02-17T20:56:27.459417Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial104","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:3300","nonce":0},{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T20:57:07.114 INFO:teuthology.orchestra.run.trial153.stderr:dumped monmap epoch 1 2026-02-17T20:57:07.115 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:07.110+0000 7f46b191b640 1 -- 10.20.193.153:0/915242075 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f468003dd80 msgr2=0x7f4680040240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:07.115 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:07.110+0000 7f46b191b640 1 --2- 10.20.193.153:0/915242075 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f468003dd80 0x7f4680040240 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f46940099c0 tx=0x7f4694006eb0 comp rx=0 tx=0).stop 2026-02-17T20:57:07.115 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:07.110+0000 7f46b191b640 1 -- 10.20.193.153:0/915242075 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f46ac10a660 msgr2=0x7f46ac19be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:07.115 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:07.110+0000 7f46b191b640 1 --2- 10.20.193.153:0/915242075 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f46ac10a660 0x7f46ac19be40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f46a0002410 tx=0x7f46a0002d30 comp rx=0 tx=0).stop 2026-02-17T20:57:07.115 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:07.110+0000 7f46b191b640 1 -- 10.20.193.153:0/915242075 shutdown_connections 2026-02-17T20:57:07.115 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:07.110+0000 7f46b191b640 1 --2- 10.20.193.153:0/915242075 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f468003dd80 0x7f4680040240 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:07.115 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:07.110+0000 7f46b191b640 1 --2- 10.20.193.153:0/915242075 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f46ac10a660 0x7f46ac19be40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:07.116 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:07.110+0000 7f46b191b640 1 -- 10.20.193.153:0/915242075 >> 10.20.193.153:0/915242075 conn(0x7f46ac100250 msgr2=0x7f46ac100630 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:07.116 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:07.110+0000 7f46b191b640 1 -- 10.20.193.153:0/915242075 shutdown_connections 2026-02-17T20:57:07.116 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:07.110+0000 7f46b191b640 1 -- 10.20.193.153:0/915242075 wait complete. 2026-02-17T20:57:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:06 trial104 ceph-mon[20612]: Updating trial104:/etc/ceph/ceph.conf 2026-02-17T20:57:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:06 trial104 ceph-mon[20612]: Updating trial153:/etc/ceph/ceph.conf 2026-02-17T20:57:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:06 trial104 ceph-mon[20612]: Updating trial104:/var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/config/ceph.conf 2026-02-17T20:57:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:06 trial104 ceph-mon[20612]: Updating trial153:/var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/config/ceph.conf 2026-02-17T20:57:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:06 trial104 ceph-mon[20612]: Updating trial104:/etc/ceph/ceph.client.admin.keyring 2026-02-17T20:57:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:06 trial104 ceph-mon[20612]: Updating trial153:/etc/ceph/ceph.client.admin.keyring 2026-02-17T20:57:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:06 trial104 ceph-mon[20612]: Updating trial104:/var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-17T20:57:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:06 trial104 ceph-mon[20612]: Updating trial153:/var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/config/ceph.client.admin.keyring 2026-02-17T20:57:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:06 trial104 ceph-mon[20612]: Deploying daemon ceph-exporter.trial153 on trial153 2026-02-17T20:57:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:06 trial104 ceph-mon[20612]: mgrmap e17: trial104.irrhmt(active, since 2s) 2026-02-17T20:57:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:06 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:06 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:06 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:06 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:06 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-17T20:57:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:06 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.trial153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2026-02-17T20:57:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:06 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:08.153 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T20:57:08.154 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T20:57:08.307 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/config/ceph.conf 2026-02-17T20:57:08.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:07 trial104 ceph-mon[20612]: Deploying daemon crash.trial153 on trial153 2026-02-17T20:57:08.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:07 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/915242075' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T20:57:08.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:07 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:08.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:07 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:08.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:07 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:08.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:07 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:08.412 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.406+0000 7f0bc7222640 1 -- 10.20.193.153:0/1553820691 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0bc010a650 msgr2=0x7f0bc010aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:08.412 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.406+0000 7f0bc7222640 1 --2- 10.20.193.153:0/1553820691 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0bc010a650 0x7f0bc010aa30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0bb00099b0 tx=0x7f0bb002f2b0 comp rx=0 tx=0).stop 2026-02-17T20:57:08.412 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.406+0000 7f0bc7222640 1 -- 10.20.193.153:0/1553820691 shutdown_connections 2026-02-17T20:57:08.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.406+0000 7f0bc7222640 1 --2- 10.20.193.153:0/1553820691 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0bc010a650 0x7f0bc010aa30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:08.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.406+0000 7f0bc7222640 1 -- 10.20.193.153:0/1553820691 >> 10.20.193.153:0/1553820691 conn(0x7f0bc0100280 msgr2=0x7f0bc01026a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:08.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.406+0000 7f0bc7222640 1 -- 10.20.193.153:0/1553820691 shutdown_connections 2026-02-17T20:57:08.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.406+0000 7f0bc7222640 1 -- 10.20.193.153:0/1553820691 wait complete. 2026-02-17T20:57:08.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.406+0000 7f0bc7222640 1 Processor -- start 2026-02-17T20:57:08.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.407+0000 7f0bc7222640 1 -- start start 2026-02-17T20:57:08.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.407+0000 7f0bc7222640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0bc010a650 0x7f0bc019be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:08.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.407+0000 7f0bc7222640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc010e9a0 con 0x7f0bc010a650 2026-02-17T20:57:08.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.407+0000 7f0bc4f97640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0bc010a650 0x7f0bc019be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:08.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.407+0000 7f0bc4f97640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0bc010a650 0x7f0bc019be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.153:33832/0 (socket says 10.20.193.153:33832) 2026-02-17T20:57:08.413 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.407+0000 7f0bc4f97640 1 -- 10.20.193.153:0/3269080721 learned_addr learned my addr 10.20.193.153:0/3269080721 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:57:08.414 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.407+0000 7f0bc4f97640 1 -- 10.20.193.153:0/3269080721 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc019c370 con 0x7f0bc010a650 2026-02-17T20:57:08.414 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.408+0000 7f0bc4f97640 1 --2- 10.20.193.153:0/3269080721 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0bc010a650 0x7f0bc019be30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0002dc0 tx=0x7f0bb0002df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:08.414 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.408+0000 7f0bb5ffb640 1 -- 10.20.193.153:0/3269080721 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f0bb0047070 con 0x7f0bc010a650 2026-02-17T20:57:08.414 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.408+0000 7f0bb5ffb640 1 -- 10.20.193.153:0/3269080721 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f0bb003e070 con 0x7f0bc010a650 2026-02-17T20:57:08.414 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.408+0000 7f0bc7222640 1 -- 10.20.193.153:0/3269080721 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc019c600 con 0x7f0bc010a650 2026-02-17T20:57:08.414 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.408+0000 7f0bc7222640 1 -- 10.20.193.153:0/3269080721 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc01a0700 con 0x7f0bc010a650 2026-02-17T20:57:08.414 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.408+0000 7f0bb5ffb640 1 -- 10.20.193.153:0/3269080721 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7f0bb0051060 con 0x7f0bc010a650 2026-02-17T20:57:08.414 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.408+0000 7f0bc7222640 1 -- 10.20.193.153:0/3269080721 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bc0105cc0 con 0x7f0bc010a650 2026-02-17T20:57:08.415 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.409+0000 7f0bb5ffb640 1 -- 10.20.193.153:0/3269080721 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 17) ==== 50376+0+0 (secure 0 0 0) 0x7f0bb0054080 con 0x7f0bc010a650 2026-02-17T20:57:08.415 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.409+0000 7f0bb5ffb640 1 --2- 10.20.193.153:0/3269080721 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0b9c03dd80 0x7f0b9c040240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:08.415 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.409+0000 7f0bb5ffb640 1 -- 10.20.193.153:0/3269080721 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f0bb0077130 con 0x7f0bc010a650 2026-02-17T20:57:08.415 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.409+0000 7f0bb7fff640 1 --2- 10.20.193.153:0/3269080721 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0b9c03dd80 0x7f0b9c040240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:08.415 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.410+0000 7f0bb7fff640 1 --2- 10.20.193.153:0/3269080721 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0b9c03dd80 0x7f0b9c040240 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80099c0 tx=0x7f0ba8006eb0 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:08.416 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.411+0000 7f0bb5ffb640 1 -- 10.20.193.153:0/3269080721 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0bb0036370 con 0x7f0bc010a650 2026-02-17T20:57:08.539 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.534+0000 7f0bc7222640 1 -- 10.20.193.153:0/3269080721 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f0bc019d190 con 0x7f0bc010a650 2026-02-17T20:57:08.539 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.534+0000 7f0bb5ffb640 1 -- 10.20.193.153:0/3269080721 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+752 (secure 0 0 0) 0x7f0bb0048260 con 0x7f0bc010a650 2026-02-17T20:57:08.539 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:57:08.540 INFO:teuthology.orchestra.run.trial153.stdout:{"epoch":1,"fsid":"19072504-0c43-11f1-93a3-d404e6e7d460","modified":"2026-02-17T20:56:27.459417Z","created":"2026-02-17T20:56:27.459417Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial104","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:3300","nonce":0},{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T20:57:08.540 INFO:teuthology.orchestra.run.trial153.stderr:dumped monmap epoch 1 2026-02-17T20:57:08.541 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.536+0000 7f0bc7222640 1 -- 10.20.193.153:0/3269080721 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0b9c03dd80 msgr2=0x7f0b9c040240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:08.541 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.536+0000 7f0bc7222640 1 --2- 10.20.193.153:0/3269080721 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0b9c03dd80 0x7f0b9c040240 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0ba80099c0 tx=0x7f0ba8006eb0 comp rx=0 tx=0).stop 2026-02-17T20:57:08.541 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.536+0000 7f0bc7222640 1 -- 10.20.193.153:0/3269080721 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0bc010a650 msgr2=0x7f0bc019be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:08.541 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.536+0000 7f0bc7222640 1 --2- 10.20.193.153:0/3269080721 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0bc010a650 0x7f0bc019be30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0002dc0 tx=0x7f0bb0002df0 comp rx=0 tx=0).stop 2026-02-17T20:57:08.541 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.536+0000 7f0bc7222640 1 -- 10.20.193.153:0/3269080721 shutdown_connections 2026-02-17T20:57:08.541 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.536+0000 7f0bc7222640 1 --2- 10.20.193.153:0/3269080721 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0b9c03dd80 0x7f0b9c040240 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:08.541 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.536+0000 7f0bc7222640 1 --2- 10.20.193.153:0/3269080721 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0bc010a650 0x7f0bc019be30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:08.542 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.536+0000 7f0bc7222640 1 -- 10.20.193.153:0/3269080721 >> 10.20.193.153:0/3269080721 conn(0x7f0bc0100280 msgr2=0x7f0bc0101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:08.542 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.536+0000 7f0bc7222640 1 -- 10.20.193.153:0/3269080721 shutdown_connections 2026-02-17T20:57:08.542 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:08.536+0000 7f0bc7222640 1 -- 10.20.193.153:0/3269080721 wait complete. 2026-02-17T20:57:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:08 trial104 ceph-mon[20612]: Deploying daemon node-exporter.trial153 on trial153 2026-02-17T20:57:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:08 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/3269080721' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T20:57:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:08 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:08 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:08 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:08 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:08 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:08 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.trial153.ivmqog", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-17T20:57:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:08 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.trial153.ivmqog", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-17T20:57:09.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:08 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-17T20:57:09.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:08 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:09.621 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T20:57:09.621 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T20:57:09.789 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial153/config 2026-02-17T20:57:09.909 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.902+0000 7fe847fff640 1 -- 10.20.193.153:0/4050088178 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe84810a4f0 msgr2=0x7fe84810a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:09.909 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.902+0000 7fe847fff640 1 --2- 10.20.193.153:0/4050088178 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe84810a4f0 0x7fe84810a8d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe83c0099b0 tx=0x7fe83c02f2b0 comp rx=0 tx=0).stop 2026-02-17T20:57:09.909 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.902+0000 7fe847fff640 1 -- 10.20.193.153:0/4050088178 shutdown_connections 2026-02-17T20:57:09.909 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.902+0000 7fe847fff640 1 --2- 10.20.193.153:0/4050088178 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe84810a4f0 0x7fe84810a8d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:09.910 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.902+0000 7fe847fff640 1 -- 10.20.193.153:0/4050088178 >> 10.20.193.153:0/4050088178 conn(0x7fe848100120 msgr2=0x7fe848102540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:09.910 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.902+0000 7fe847fff640 1 -- 10.20.193.153:0/4050088178 shutdown_connections 2026-02-17T20:57:09.910 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.902+0000 7fe847fff640 1 -- 10.20.193.153:0/4050088178 wait complete. 2026-02-17T20:57:09.910 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.902+0000 7fe847fff640 1 Processor -- start 2026-02-17T20:57:09.910 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.902+0000 7fe847fff640 1 -- start start 2026-02-17T20:57:09.910 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.903+0000 7fe847fff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe84810a4f0 0x7fe84819be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:09.910 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.903+0000 7fe847fff640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe84810e830 con 0x7fe84810a4f0 2026-02-17T20:57:09.910 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.903+0000 7fe846ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe84810a4f0 0x7fe84819be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:09.910 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.903+0000 7fe846ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe84810a4f0 0x7fe84819be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.153:49606/0 (socket says 10.20.193.153:49606) 2026-02-17T20:57:09.910 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.903+0000 7fe846ffd640 1 -- 10.20.193.153:0/2313936342 learned_addr learned my addr 10.20.193.153:0/2313936342 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:57:09.911 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.903+0000 7fe846ffd640 1 -- 10.20.193.153:0/2313936342 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe84819c360 con 0x7fe84810a4f0 2026-02-17T20:57:09.911 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.903+0000 7fe846ffd640 1 --2- 10.20.193.153:0/2313936342 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe84810a4f0 0x7fe84819be20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe83c002410 tx=0x7fe83c002d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:09.911 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.903+0000 7fe827fff640 1 -- 10.20.193.153:0/2313936342 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fe83c047070 con 0x7fe84810a4f0 2026-02-17T20:57:09.911 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.903+0000 7fe827fff640 1 -- 10.20.193.153:0/2313936342 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fe83c03e070 con 0x7fe84810a4f0 2026-02-17T20:57:09.911 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.903+0000 7fe847fff640 1 -- 10.20.193.153:0/2313936342 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe84819c650 con 0x7fe84810a4f0 2026-02-17T20:57:09.911 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.903+0000 7fe827fff640 1 -- 10.20.193.153:0/2313936342 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 226+0+0 (secure 0 0 0) 0x7fe83c042610 con 0x7fe84810a4f0 2026-02-17T20:57:09.911 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.903+0000 7fe847fff640 1 -- 10.20.193.153:0/2313936342 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8481a06f0 con 0x7fe84810a4f0 2026-02-17T20:57:09.911 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.904+0000 7fe847fff640 1 -- 10.20.193.153:0/2313936342 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe848105ba0 con 0x7fe84810a4f0 2026-02-17T20:57:09.911 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.904+0000 7fe827fff640 1 -- 10.20.193.153:0/2313936342 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 17) ==== 50376+0+0 (secure 0 0 0) 0x7fe83c04c440 con 0x7fe84810a4f0 2026-02-17T20:57:09.911 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.904+0000 7fe827fff640 1 --2- 10.20.193.153:0/2313936342 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe81c03ddd0 0x7fe81c040290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:09.912 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.904+0000 7fe827fff640 1 -- 10.20.193.153:0/2313936342 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fe83c076be0 con 0x7fe84810a4f0 2026-02-17T20:57:09.912 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.904+0000 7fe8467fc640 1 --2- 10.20.193.153:0/2313936342 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe81c03ddd0 0x7fe81c040290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:09.912 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.905+0000 7fe8467fc640 1 --2- 10.20.193.153:0/2313936342 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe81c03ddd0 0x7fe81c040290 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe8300099c0 tx=0x7fe830006eb0 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:09.912 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:09.907+0000 7fe827fff640 1 -- 10.20.193.153:0/2313936342 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe83c04a360 con 0x7fe84810a4f0 2026-02-17T20:57:10.031 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:10.026+0000 7fe847fff640 1 -- 10.20.193.153:0/2313936342 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe84819d180 con 0x7fe84810a4f0 2026-02-17T20:57:10.032 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:10.027+0000 7fe827fff640 1 -- 10.20.193.153:0/2313936342 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+752 (secure 0 0 0) 0x7fe83c03d180 con 0x7fe84810a4f0 2026-02-17T20:57:10.032 INFO:teuthology.orchestra.run.trial153.stderr:dumped monmap epoch 1 2026-02-17T20:57:10.032 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:57:10.032 INFO:teuthology.orchestra.run.trial153.stdout:{"epoch":1,"fsid":"19072504-0c43-11f1-93a3-d404e6e7d460","modified":"2026-02-17T20:56:27.459417Z","created":"2026-02-17T20:56:27.459417Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial104","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:3300","nonce":0},{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2026-02-17T20:57:10.033 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:10.029+0000 7fe847fff640 1 -- 10.20.193.153:0/2313936342 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe81c03ddd0 msgr2=0x7fe81c040290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:10.033 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:10.029+0000 7fe847fff640 1 --2- 10.20.193.153:0/2313936342 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe81c03ddd0 0x7fe81c040290 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe8300099c0 tx=0x7fe830006eb0 comp rx=0 tx=0).stop 2026-02-17T20:57:10.034 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:10.029+0000 7fe847fff640 1 -- 10.20.193.153:0/2313936342 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe84810a4f0 msgr2=0x7fe84819be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:10.034 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:10.029+0000 7fe847fff640 1 --2- 10.20.193.153:0/2313936342 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe84810a4f0 0x7fe84819be20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe83c002410 tx=0x7fe83c002d30 comp rx=0 tx=0).stop 2026-02-17T20:57:10.034 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:10.029+0000 7fe847fff640 1 -- 10.20.193.153:0/2313936342 shutdown_connections 2026-02-17T20:57:10.034 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:10.029+0000 7fe847fff640 1 --2- 10.20.193.153:0/2313936342 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe81c03ddd0 0x7fe81c040290 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:10.034 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:10.029+0000 7fe847fff640 1 --2- 10.20.193.153:0/2313936342 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe84810a4f0 0x7fe84819be20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:10.034 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:10.029+0000 7fe847fff640 1 -- 10.20.193.153:0/2313936342 >> 10.20.193.153:0/2313936342 conn(0x7fe848100120 msgr2=0x7fe848100500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:10.034 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:10.029+0000 7fe847fff640 1 -- 10.20.193.153:0/2313936342 shutdown_connections 2026-02-17T20:57:10.034 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:10.029+0000 7fe847fff640 1 -- 10.20.193.153:0/2313936342 wait complete. 2026-02-17T20:57:10.304 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:09 trial104 ceph-mon[20612]: Deploying daemon mgr.trial153.ivmqog on trial153 2026-02-17T20:57:10.304 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:09 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:10.304 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:09 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:10.304 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:09 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:10.304 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:09 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:10.304 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:09 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-17T20:57:10.304 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:09 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:11.075 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2026-02-17T20:57:11.076 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph mon dump -f json 2026-02-17T20:57:11.229 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial153/config 2026-02-17T20:57:15.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial104"}]: dispatch 2026-02-17T20:57:15.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial153"}]: dispatch 2026-02-17T20:57:15.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: mon.trial104 calling monitor election 2026-02-17T20:57:15.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial153"}]: dispatch 2026-02-17T20:57:15.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: from='mgr.? 10.20.193.153:0/325852719' entity='mgr.trial153.ivmqog' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/trial153.ivmqog/crt"}]: dispatch 2026-02-17T20:57:15.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: mon.trial153 calling monitor election 2026-02-17T20:57:15.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial153"}]: dispatch 2026-02-17T20:57:15.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial153"}]: dispatch 2026-02-17T20:57:15.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial153"}]: dispatch 2026-02-17T20:57:15.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial153"}]: dispatch 2026-02-17T20:57:15.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: mon.trial104 is new leader, mons trial104,trial153 in quorum (ranks 0,1) 2026-02-17T20:57:15.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: monmap epoch 2 2026-02-17T20:57:15.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: fsid 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T20:57:15.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: last_changed 2026-02-17T20:57:10.168013+0000 2026-02-17T20:57:15.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: created 2026-02-17T20:56:27.459417+0000 2026-02-17T20:57:15.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: min_mon_release 19 (squid) 2026-02-17T20:57:15.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: election_strategy: 1 2026-02-17T20:57:15.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: 0: [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] mon.trial104 2026-02-17T20:57:15.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: 1: [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] mon.trial153 2026-02-17T20:57:15.656 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: fsmap 2026-02-17T20:57:15.656 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: osdmap e5: 0 total, 0 up, 0 in 2026-02-17T20:57:15.656 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: mgrmap e17: trial104.irrhmt(active, since 11s) 2026-02-17T20:57:15.656 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: overall HEALTH_OK 2026-02-17T20:57:15.656 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: Standby manager daemon trial153.ivmqog started 2026-02-17T20:57:15.656 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: from='mgr.? 10.20.193.153:0/325852719' entity='mgr.trial153.ivmqog' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2026-02-17T20:57:15.656 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:15.656 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: from='mgr.? 10.20.193.153:0/325852719' entity='mgr.trial153.ivmqog' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/trial153.ivmqog/key"}]: dispatch 2026-02-17T20:57:15.656 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: from='mgr.? 10.20.193.153:0/325852719' entity='mgr.trial153.ivmqog' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2026-02-17T20:57:15.656 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:15.656 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:15.656 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:15 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:15.754 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.749+0000 7fef87bbe640 1 -- 10.20.193.153:0/2572577756 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fef8010a640 msgr2=0x7fef64005680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.749+0000 7fef87bbe640 1 --2- 10.20.193.153:0/2572577756 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fef8010a640 0x7fef64005680 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fef70002a00 tx=0x7fef70030c80 comp rx=0 tx=0).stop 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef87bbe640 1 -- 10.20.193.153:0/2572577756 shutdown_connections 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef87bbe640 1 --2- 10.20.193.153:0/2572577756 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fef8010a640 0x7fef64005680 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef87bbe640 1 -- 10.20.193.153:0/2572577756 >> 10.20.193.153:0/2572577756 conn(0x7fef801006d0 msgr2=0x7fef80102ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef87bbe640 1 -- 10.20.193.153:0/2572577756 shutdown_connections 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef87bbe640 1 -- 10.20.193.153:0/2572577756 wait complete. 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef87bbe640 1 Processor -- start 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef87bbe640 1 -- start start 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef87bbe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fef8010a640 0x7fef8019bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef87bbe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fef8019c440 0x7fef801a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef87bbe640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fef8010c470 con 0x7fef8010a640 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef87bbe640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fef8010c2f0 con 0x7fef8019c440 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef85132640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fef8019c440 0x7fef801a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef85132640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fef8019c440 0x7fef801a07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.153:49672/0 (socket says 10.20.193.153:49672) 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef85132640 1 -- 10.20.193.153:0/57086705 learned_addr learned my addr 10.20.193.153:0/57086705 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef85132640 1 -- 10.20.193.153:0/57086705 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fef8019c440 msgr2=0x7fef801a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef85132640 1 -- 10.20.193.153:0/57086705 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fef8019c440 msgr2=0x7fef801a07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef85132640 1 --2- 10.20.193.153:0/57086705 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fef8019c440 0x7fef801a07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef85933640 1 --2- 10.20.193.153:0/57086705 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fef8010a640 0x7fef8019bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.750+0000 7fef85132640 1 --2- 10.20.193.153:0/57086705 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fef8019c440 0x7fef801a07d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.751+0000 7fef85933640 1 -- 10.20.193.153:0/57086705 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fef8019c440 msgr2=0x7fef801a07d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.751+0000 7fef85933640 1 --2- 10.20.193.153:0/57086705 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fef8019c440 0x7fef801a07d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:15.755 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.751+0000 7fef85933640 1 -- 10.20.193.153:0/57086705 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8019caf0 con 0x7fef8010a640 2026-02-17T20:57:15.756 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.751+0000 7fef85933640 1 --2- 10.20.193.153:0/57086705 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fef8010a640 0x7fef8019bf00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef70002a00 tx=0x7fef70004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:15.756 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.751+0000 7fef6effd640 1 -- 10.20.193.153:0/57086705 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fef700326e0 con 0x7fef8010a640 2026-02-17T20:57:15.756 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.751+0000 7fef6effd640 1 -- 10.20.193.153:0/57086705 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fef70032cf0 con 0x7fef8010a640 2026-02-17T20:57:15.756 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.751+0000 7fef87bbe640 1 -- 10.20.193.153:0/57086705 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef801a0d10 con 0x7fef8010a640 2026-02-17T20:57:15.756 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.751+0000 7fef87bbe640 1 -- 10.20.193.153:0/57086705 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef801a12a0 con 0x7fef8010a640 2026-02-17T20:57:15.756 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.751+0000 7fef6effd640 1 -- 10.20.193.153:0/57086705 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fef7003ac50 con 0x7fef8010a640 2026-02-17T20:57:15.756 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.752+0000 7fef87bbe640 1 -- 10.20.193.153:0/57086705 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef80105d80 con 0x7fef8010a640 2026-02-17T20:57:15.757 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.753+0000 7fef6effd640 1 -- 10.20.193.153:0/57086705 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 18) ==== 100063+0+0 (secure 0 0 0) 0x7fef7000f040 con 0x7fef8010a640 2026-02-17T20:57:15.757 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.753+0000 7fef6effd640 1 --2- 10.20.193.153:0/57086705 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fef5c0774c0 0x7fef5c079980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:15.757 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.753+0000 7fef6effd640 1 -- 10.20.193.153:0/57086705 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fef70047020 con 0x7fef8010a640 2026-02-17T20:57:15.757 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.753+0000 7fef85132640 1 --2- 10.20.193.153:0/57086705 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fef5c0774c0 0x7fef5c079980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:15.758 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.754+0000 7fef85132640 1 --2- 10.20.193.153:0/57086705 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fef5c0774c0 0x7fef5c079980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fef74006fd0 tx=0x7fef74008040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:15.759 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.755+0000 7fef6effd640 1 -- 10.20.193.153:0/57086705 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fef7008ca40 con 0x7fef8010a640 2026-02-17T20:57:15.877 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.872+0000 7fef87bbe640 1 -- 10.20.193.153:0/57086705 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fef801a15b0 con 0x7fef8010a640 2026-02-17T20:57:15.877 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.872+0000 7fef6effd640 1 -- 10.20.193.153:0/57086705 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1029 (secure 0 0 0) 0x7fef700918f0 con 0x7fef8010a640 2026-02-17T20:57:15.877 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:57:15.878 INFO:teuthology.orchestra.run.trial153.stdout:{"epoch":2,"fsid":"19072504-0c43-11f1-93a3-d404e6e7d460","modified":"2026-02-17T20:57:10.168013Z","created":"2026-02-17T20:56:27.459417Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"trial104","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:3300","nonce":0},{"type":"v1","addr":"10.20.193.104:6789","nonce":0}]},"addr":"10.20.193.104:6789/0","public_addr":"10.20.193.104:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"trial153","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:3300","nonce":0},{"type":"v1","addr":"10.20.193.153:6789","nonce":0}]},"addr":"10.20.193.153:6789/0","public_addr":"10.20.193.153:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2026-02-17T20:57:15.879 INFO:teuthology.orchestra.run.trial153.stderr:dumped monmap epoch 2 2026-02-17T20:57:15.879 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.873+0000 7fef87bbe640 1 -- 10.20.193.153:0/57086705 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fef5c0774c0 msgr2=0x7fef5c079980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:15.879 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.873+0000 7fef87bbe640 1 --2- 10.20.193.153:0/57086705 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fef5c0774c0 0x7fef5c079980 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fef74006fd0 tx=0x7fef74008040 comp rx=0 tx=0).stop 2026-02-17T20:57:15.879 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.873+0000 7fef87bbe640 1 -- 10.20.193.153:0/57086705 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fef8010a640 msgr2=0x7fef8019bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:15.879 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.873+0000 7fef87bbe640 1 --2- 10.20.193.153:0/57086705 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fef8010a640 0x7fef8019bf00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef70002a00 tx=0x7fef70004d20 comp rx=0 tx=0).stop 2026-02-17T20:57:15.879 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.873+0000 7fef87bbe640 1 -- 10.20.193.153:0/57086705 shutdown_connections 2026-02-17T20:57:15.879 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.873+0000 7fef87bbe640 1 --2- 10.20.193.153:0/57086705 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fef5c0774c0 0x7fef5c079980 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:15.879 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.873+0000 7fef87bbe640 1 --2- 10.20.193.153:0/57086705 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fef8019c440 0x7fef801a07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:15.879 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.873+0000 7fef87bbe640 1 --2- 10.20.193.153:0/57086705 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fef8010a640 0x7fef8019bf00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:15.880 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.873+0000 7fef87bbe640 1 -- 10.20.193.153:0/57086705 >> 10.20.193.153:0/57086705 conn(0x7fef801006d0 msgr2=0x7fef80194860 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:15.880 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.873+0000 7fef87bbe640 1 -- 10.20.193.153:0/57086705 shutdown_connections 2026-02-17T20:57:15.880 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:15.873+0000 7fef87bbe640 1 -- 10.20.193.153:0/57086705 wait complete. 2026-02-17T20:57:15.915 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-17T20:57:15.915 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-17T20:57:16.074 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:57:16.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.182+0000 7f3f1feeb640 1 -- 10.20.193.104:0/131585614 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3f1810a650 msgr2=0x7f3f1810aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:16.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.182+0000 7f3f1feeb640 1 --2- 10.20.193.104:0/131585614 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3f1810a650 0x7f3f1810aa30 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3f080099b0 tx=0x7f3f0802f2b0 comp rx=0 tx=0).stop 2026-02-17T20:57:16.187 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.182+0000 7f3f1feeb640 1 -- 10.20.193.104:0/131585614 shutdown_connections 2026-02-17T20:57:16.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.182+0000 7f3f1feeb640 1 --2- 10.20.193.104:0/131585614 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3f1810a650 0x7f3f1810aa30 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:16.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.182+0000 7f3f1feeb640 1 -- 10.20.193.104:0/131585614 >> 10.20.193.104:0/131585614 conn(0x7f3f18100280 msgr2=0x7f3f181026a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:16.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.182+0000 7f3f1feeb640 1 -- 10.20.193.104:0/131585614 shutdown_connections 2026-02-17T20:57:16.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.182+0000 7f3f1feeb640 1 -- 10.20.193.104:0/131585614 wait complete. 2026-02-17T20:57:16.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.183+0000 7f3f1feeb640 1 Processor -- start 2026-02-17T20:57:16.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.183+0000 7f3f1feeb640 1 -- start start 2026-02-17T20:57:16.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.183+0000 7f3f1feeb640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3f1810a650 0x7f3f1819bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:16.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.183+0000 7f3f1feeb640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3f1819c4e0 0x7f3f181a0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:16.188 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.183+0000 7f3f1feeb640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1810e9a0 con 0x7f3f1819c4e0 2026-02-17T20:57:16.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.183+0000 7f3f1feeb640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1810e820 con 0x7f3f1810a650 2026-02-17T20:57:16.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.183+0000 7f3f1d45f640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3f1819c4e0 0x7f3f181a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:16.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.183+0000 7f3f1d45f640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3f1819c4e0 0x7f3f181a0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:35248/0 (socket says 10.20.193.104:35248) 2026-02-17T20:57:16.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.183+0000 7f3f1d45f640 1 -- 10.20.193.104:0/3188314576 learned_addr learned my addr 10.20.193.104:0/3188314576 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:57:16.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.183+0000 7f3f1d45f640 1 -- 10.20.193.104:0/3188314576 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3f1810a650 msgr2=0x7f3f1819bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:16.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.183+0000 7f3f1d45f640 1 --2- 10.20.193.104:0/3188314576 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3f1810a650 0x7f3f1819bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:16.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.183+0000 7f3f1d45f640 1 -- 10.20.193.104:0/3188314576 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1819cb90 con 0x7f3f1819c4e0 2026-02-17T20:57:16.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.183+0000 7f3f1d45f640 1 --2- 10.20.193.104:0/3188314576 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3f1819c4e0 0x7f3f181a0870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00b700 tx=0x7f3f0c00bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:16.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.183+0000 7f3f06ffd640 1 -- 10.20.193.104:0/3188314576 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f3f0c019070 con 0x7f3f1819c4e0 2026-02-17T20:57:16.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.183+0000 7f3f06ffd640 1 -- 10.20.193.104:0/3188314576 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f3f0c00cd60 con 0x7f3f1819c4e0 2026-02-17T20:57:16.189 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.183+0000 7f3f1feeb640 1 -- 10.20.193.104:0/3188314576 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f181a0db0 con 0x7f3f1819c4e0 2026-02-17T20:57:16.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.183+0000 7f3f06ffd640 1 -- 10.20.193.104:0/3188314576 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f3f0c014db0 con 0x7f3f1819c4e0 2026-02-17T20:57:16.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.184+0000 7f3f1feeb640 1 -- 10.20.193.104:0/3188314576 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f181a13c0 con 0x7f3f1819c4e0 2026-02-17T20:57:16.190 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.184+0000 7f3f1feeb640 1 -- 10.20.193.104:0/3188314576 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f18105cc0 con 0x7f3f1819c4e0 2026-02-17T20:57:16.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.185+0000 7f3f06ffd640 1 -- 10.20.193.104:0/3188314576 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 18) ==== 100063+0+0 (secure 0 0 0) 0x7f3f0c0145f0 con 0x7f3f1819c4e0 2026-02-17T20:57:16.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.185+0000 7f3f06ffd640 1 --2- 10.20.193.104:0/3188314576 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3ef40774c0 0x7f3ef4079980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:16.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.185+0000 7f3f06ffd640 1 -- 10.20.193.104:0/3188314576 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3f0c097a60 con 0x7f3f1819c4e0 2026-02-17T20:57:16.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.185+0000 7f3f1dc60640 1 --2- 10.20.193.104:0/3188314576 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3ef40774c0 0x7f3ef4079980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:16.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.185+0000 7f3f1dc60640 1 --2- 10.20.193.104:0/3188314576 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3ef40774c0 0x7f3ef4079980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3f080097c0 tx=0x7f3f08005e50 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:16.191 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.187+0000 7f3f06ffd640 1 -- 10.20.193.104:0/3188314576 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3f0c065da0 con 0x7f3f1819c4e0 2026-02-17T20:57:16.232 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: mgrmap e18: trial104.irrhmt(active, since 11s), standbys: trial153.ivmqog 2026-02-17T20:57:16.233 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mgr metadata", "who": "trial153.ivmqog", "id": "trial153.ivmqog"}]: dispatch 2026-02-17T20:57:16.233 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:16.233 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:16.233 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:16.233 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:16.233 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: Updating trial104:/etc/ceph/ceph.conf 2026-02-17T20:57:16.233 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: Updating trial153:/etc/ceph/ceph.conf 2026-02-17T20:57:16.233 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: Updating trial104:/var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/config/ceph.conf 2026-02-17T20:57:16.233 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: Updating trial153:/var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/config/ceph.conf 2026-02-17T20:57:16.234 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/57086705' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2026-02-17T20:57:16.234 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:16.234 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:16.234 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:16.234 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:16.234 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:16.234 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: Reconfiguring mon.trial104 (unknown last config time)... 2026-02-17T20:57:16.234 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-17T20:57:16.234 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-17T20:57:16.234 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:16.234 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: Reconfiguring daemon mon.trial104 on trial104 2026-02-17T20:57:16.234 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial153"}]: dispatch 2026-02-17T20:57:16.234 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:16.235 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:16.235 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.trial104.irrhmt", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-17T20:57:16.235 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-17T20:57:16.235 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:16 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:16.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.271+0000 7f3f1feeb640 1 -- 10.20.193.104:0/3188314576 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f3f1819d390 con 0x7f3f1819c4e0 2026-02-17T20:57:16.274 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.271+0000 7f3f06ffd640 1 -- 10.20.193.104:0/3188314576 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) ==== 76+0+227 (secure 0 0 0) 0x7f3f1819d390 con 0x7f3f1819c4e0 2026-02-17T20:57:16.275 INFO:teuthology.orchestra.run.trial104.stdout:# minimal ceph.conf for 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T20:57:16.275 INFO:teuthology.orchestra.run.trial104.stdout:[global] 2026-02-17T20:57:16.275 INFO:teuthology.orchestra.run.trial104.stdout: fsid = 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T20:57:16.275 INFO:teuthology.orchestra.run.trial104.stdout: mon_host = [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] 2026-02-17T20:57:16.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.273+0000 7f3f1feeb640 1 -- 10.20.193.104:0/3188314576 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3ef40774c0 msgr2=0x7f3ef4079980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:16.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.273+0000 7f3f1feeb640 1 --2- 10.20.193.104:0/3188314576 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3ef40774c0 0x7f3ef4079980 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3f080097c0 tx=0x7f3f08005e50 comp rx=0 tx=0).stop 2026-02-17T20:57:16.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.273+0000 7f3f1feeb640 1 -- 10.20.193.104:0/3188314576 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3f1819c4e0 msgr2=0x7f3f181a0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:16.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.273+0000 7f3f1feeb640 1 --2- 10.20.193.104:0/3188314576 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3f1819c4e0 0x7f3f181a0870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00b700 tx=0x7f3f0c00bbd0 comp rx=0 tx=0).stop 2026-02-17T20:57:16.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.273+0000 7f3f1feeb640 1 -- 10.20.193.104:0/3188314576 shutdown_connections 2026-02-17T20:57:16.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.273+0000 7f3f1feeb640 1 --2- 10.20.193.104:0/3188314576 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3ef40774c0 0x7f3ef4079980 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:16.276 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.273+0000 7f3f1feeb640 1 --2- 10.20.193.104:0/3188314576 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3f1819c4e0 0x7f3f181a0870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:16.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.273+0000 7f3f1feeb640 1 --2- 10.20.193.104:0/3188314576 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3f1810a650 0x7f3f1819bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:16.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.273+0000 7f3f1feeb640 1 -- 10.20.193.104:0/3188314576 >> 10.20.193.104:0/3188314576 conn(0x7f3f18100280 msgr2=0x7f3f18100660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:16.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.273+0000 7f3f1feeb640 1 -- 10.20.193.104:0/3188314576 shutdown_connections 2026-02-17T20:57:16.277 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:16.273+0000 7f3f1feeb640 1 -- 10.20.193.104:0/3188314576 wait complete. 2026-02-17T20:57:16.313 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-17T20:57:16.313 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:57:16.313 DEBUG:teuthology.orchestra.run.trial104:> sudo dd of=/etc/ceph/ceph.conf 2026-02-17T20:57:16.339 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:57:16.340 DEBUG:teuthology.orchestra.run.trial104:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-17T20:57:16.405 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T20:57:16.406 DEBUG:teuthology.orchestra.run.trial153:> sudo dd of=/etc/ceph/ceph.conf 2026-02-17T20:57:16.433 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T20:57:16.433 DEBUG:teuthology.orchestra.run.trial153:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-17T20:57:16.498 INFO:tasks.cephadm:Deploying OSDs... 2026-02-17T20:57:16.498 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:57:16.498 DEBUG:teuthology.orchestra.run.trial104:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T20:57:16.514 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T20:57:16.514 DEBUG:teuthology.orchestra.run.trial104:> stat /dev/vg_nvme/lv_1 2026-02-17T20:57:16.571 INFO:teuthology.orchestra.run.trial104.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T20:57:16.571 INFO:teuthology.orchestra.run.trial104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T20:57:16.571 INFO:teuthology.orchestra.run.trial104.stdout:Device: 6h/6d Inode: 1297 Links: 1 2026-02-17T20:57:16.572 INFO:teuthology.orchestra.run.trial104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T20:57:16.572 INFO:teuthology.orchestra.run.trial104.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T20:57:16.572 INFO:teuthology.orchestra.run.trial104.stdout:Access: 2026-02-17 20:56:59.761448602 +0000 2026-02-17T20:57:16.572 INFO:teuthology.orchestra.run.trial104.stdout:Modify: 2026-02-17 20:55:40.617142708 +0000 2026-02-17T20:57:16.572 INFO:teuthology.orchestra.run.trial104.stdout:Change: 2026-02-17 20:55:40.617142708 +0000 2026-02-17T20:57:16.572 INFO:teuthology.orchestra.run.trial104.stdout: Birth: 2026-02-17 20:55:40.617142708 +0000 2026-02-17T20:57:16.572 DEBUG:teuthology.orchestra.run.trial104:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T20:57:16.639 INFO:teuthology.orchestra.run.trial104.stderr:1+0 records in 2026-02-17T20:57:16.639 INFO:teuthology.orchestra.run.trial104.stderr:1+0 records out 2026-02-17T20:57:16.639 INFO:teuthology.orchestra.run.trial104.stderr:512 bytes copied, 0.000161531 s, 3.2 MB/s 2026-02-17T20:57:16.640 DEBUG:teuthology.orchestra.run.trial104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T20:57:16.701 DEBUG:teuthology.orchestra.run.trial104:> stat /dev/vg_nvme/lv_2 2026-02-17T20:57:16.757 INFO:teuthology.orchestra.run.trial104.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T20:57:16.757 INFO:teuthology.orchestra.run.trial104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T20:57:16.757 INFO:teuthology.orchestra.run.trial104.stdout:Device: 6h/6d Inode: 1294 Links: 1 2026-02-17T20:57:16.757 INFO:teuthology.orchestra.run.trial104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T20:57:16.757 INFO:teuthology.orchestra.run.trial104.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T20:57:16.757 INFO:teuthology.orchestra.run.trial104.stdout:Access: 2026-02-17 20:56:59.762448553 +0000 2026-02-17T20:57:16.757 INFO:teuthology.orchestra.run.trial104.stdout:Modify: 2026-02-17 20:55:40.617142708 +0000 2026-02-17T20:57:16.758 INFO:teuthology.orchestra.run.trial104.stdout:Change: 2026-02-17 20:55:40.617142708 +0000 2026-02-17T20:57:16.758 INFO:teuthology.orchestra.run.trial104.stdout: Birth: 2026-02-17 20:55:40.617142708 +0000 2026-02-17T20:57:16.758 DEBUG:teuthology.orchestra.run.trial104:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T20:57:16.821 INFO:teuthology.orchestra.run.trial104.stderr:1+0 records in 2026-02-17T20:57:16.821 INFO:teuthology.orchestra.run.trial104.stderr:1+0 records out 2026-02-17T20:57:16.821 INFO:teuthology.orchestra.run.trial104.stderr:512 bytes copied, 0.000191107 s, 2.7 MB/s 2026-02-17T20:57:16.822 DEBUG:teuthology.orchestra.run.trial104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T20:57:16.881 DEBUG:teuthology.orchestra.run.trial104:> stat /dev/vg_nvme/lv_3 2026-02-17T20:57:16.940 INFO:teuthology.orchestra.run.trial104.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T20:57:16.940 INFO:teuthology.orchestra.run.trial104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T20:57:16.940 INFO:teuthology.orchestra.run.trial104.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-17T20:57:16.940 INFO:teuthology.orchestra.run.trial104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T20:57:16.940 INFO:teuthology.orchestra.run.trial104.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T20:57:16.940 INFO:teuthology.orchestra.run.trial104.stdout:Access: 2026-02-17 20:56:59.762448553 +0000 2026-02-17T20:57:16.940 INFO:teuthology.orchestra.run.trial104.stdout:Modify: 2026-02-17 20:55:40.617142708 +0000 2026-02-17T20:57:16.940 INFO:teuthology.orchestra.run.trial104.stdout:Change: 2026-02-17 20:55:40.617142708 +0000 2026-02-17T20:57:16.940 INFO:teuthology.orchestra.run.trial104.stdout: Birth: 2026-02-17 20:55:40.617142708 +0000 2026-02-17T20:57:16.941 DEBUG:teuthology.orchestra.run.trial104:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T20:57:17.004 INFO:teuthology.orchestra.run.trial104.stderr:1+0 records in 2026-02-17T20:57:17.004 INFO:teuthology.orchestra.run.trial104.stderr:1+0 records out 2026-02-17T20:57:17.004 INFO:teuthology.orchestra.run.trial104.stderr:512 bytes copied, 0.0001611 s, 3.2 MB/s 2026-02-17T20:57:17.005 DEBUG:teuthology.orchestra.run.trial104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T20:57:17.064 DEBUG:teuthology.orchestra.run.trial104:> stat /dev/vg_nvme/lv_4 2026-02-17T20:57:17.122 INFO:teuthology.orchestra.run.trial104.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T20:57:17.122 INFO:teuthology.orchestra.run.trial104.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T20:57:17.123 INFO:teuthology.orchestra.run.trial104.stdout:Device: 6h/6d Inode: 1309 Links: 1 2026-02-17T20:57:17.123 INFO:teuthology.orchestra.run.trial104.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T20:57:17.123 INFO:teuthology.orchestra.run.trial104.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T20:57:17.123 INFO:teuthology.orchestra.run.trial104.stdout:Access: 2026-02-17 20:56:59.762448553 +0000 2026-02-17T20:57:17.123 INFO:teuthology.orchestra.run.trial104.stdout:Modify: 2026-02-17 20:55:40.617142708 +0000 2026-02-17T20:57:17.123 INFO:teuthology.orchestra.run.trial104.stdout:Change: 2026-02-17 20:55:40.617142708 +0000 2026-02-17T20:57:17.123 INFO:teuthology.orchestra.run.trial104.stdout: Birth: 2026-02-17 20:55:40.617142708 +0000 2026-02-17T20:57:17.123 DEBUG:teuthology.orchestra.run.trial104:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T20:57:17.188 INFO:teuthology.orchestra.run.trial104.stderr:1+0 records in 2026-02-17T20:57:17.188 INFO:teuthology.orchestra.run.trial104.stderr:1+0 records out 2026-02-17T20:57:17.188 INFO:teuthology.orchestra.run.trial104.stderr:512 bytes copied, 0.000160809 s, 3.2 MB/s 2026-02-17T20:57:17.190 DEBUG:teuthology.orchestra.run.trial104:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T20:57:17.249 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T20:57:17.249 DEBUG:teuthology.orchestra.run.trial153:> dd if=/scratch_devs of=/dev/stdout 2026-02-17T20:57:17.267 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-17T20:57:17.267 DEBUG:teuthology.orchestra.run.trial153:> stat /dev/vg_nvme/lv_1 2026-02-17T20:57:17.323 INFO:teuthology.orchestra.run.trial153.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-17T20:57:17.323 INFO:teuthology.orchestra.run.trial153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T20:57:17.323 INFO:teuthology.orchestra.run.trial153.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-17T20:57:17.323 INFO:teuthology.orchestra.run.trial153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T20:57:17.323 INFO:teuthology.orchestra.run.trial153.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T20:57:17.323 INFO:teuthology.orchestra.run.trial153.stdout:Access: 2026-02-17 20:57:09.942867341 +0000 2026-02-17T20:57:17.323 INFO:teuthology.orchestra.run.trial153.stdout:Modify: 2026-02-17 20:55:37.269728693 +0000 2026-02-17T20:57:17.324 INFO:teuthology.orchestra.run.trial153.stdout:Change: 2026-02-17 20:55:37.269728693 +0000 2026-02-17T20:57:17.324 INFO:teuthology.orchestra.run.trial153.stdout: Birth: 2026-02-17 20:55:37.269728693 +0000 2026-02-17T20:57:17.324 DEBUG:teuthology.orchestra.run.trial153:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-17T20:57:17.325 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: Reconfiguring mgr.trial104.irrhmt (unknown last config time)... 2026-02-17T20:57:17.325 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: Reconfiguring daemon mgr.trial104.irrhmt on trial104 2026-02-17T20:57:17.325 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3188314576' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:17.325 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:17.326 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:17.326 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: Reconfiguring ceph-exporter.trial104 (monmap changed)... 2026-02-17T20:57:17.326 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial104", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-17T20:57:17.326 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:17.326 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: Reconfiguring daemon ceph-exporter.trial104 on trial104 2026-02-17T20:57:17.326 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:17.326 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:17.326 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: Reconfiguring crash.trial104 (monmap changed)... 2026-02-17T20:57:17.326 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial104", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-17T20:57:17.326 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:17.326 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: Reconfiguring daemon crash.trial104 on trial104 2026-02-17T20:57:17.326 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:17.326 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:17.326 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: Reconfiguring alertmanager.trial104 (dependencies changed)... 2026-02-17T20:57:17.326 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:17 trial104 ceph-mon[20612]: Reconfiguring daemon alertmanager.trial104 on trial104 2026-02-17T20:57:17.386 INFO:teuthology.orchestra.run.trial153.stderr:1+0 records in 2026-02-17T20:57:17.386 INFO:teuthology.orchestra.run.trial153.stderr:1+0 records out 2026-02-17T20:57:17.386 INFO:teuthology.orchestra.run.trial153.stderr:512 bytes copied, 0.000171197 s, 3.0 MB/s 2026-02-17T20:57:17.387 DEBUG:teuthology.orchestra.run.trial153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-17T20:57:17.443 DEBUG:teuthology.orchestra.run.trial153:> stat /dev/vg_nvme/lv_2 2026-02-17T20:57:17.499 INFO:teuthology.orchestra.run.trial153.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-17T20:57:17.499 INFO:teuthology.orchestra.run.trial153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T20:57:17.500 INFO:teuthology.orchestra.run.trial153.stdout:Device: 6h/6d Inode: 1321 Links: 1 2026-02-17T20:57:17.500 INFO:teuthology.orchestra.run.trial153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T20:57:17.500 INFO:teuthology.orchestra.run.trial153.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T20:57:17.500 INFO:teuthology.orchestra.run.trial153.stdout:Access: 2026-02-17 20:57:09.942867341 +0000 2026-02-17T20:57:17.500 INFO:teuthology.orchestra.run.trial153.stdout:Modify: 2026-02-17 20:55:37.270728668 +0000 2026-02-17T20:57:17.500 INFO:teuthology.orchestra.run.trial153.stdout:Change: 2026-02-17 20:55:37.270728668 +0000 2026-02-17T20:57:17.500 INFO:teuthology.orchestra.run.trial153.stdout: Birth: 2026-02-17 20:55:37.270728668 +0000 2026-02-17T20:57:17.501 DEBUG:teuthology.orchestra.run.trial153:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-17T20:57:17.561 INFO:teuthology.orchestra.run.trial153.stderr:1+0 records in 2026-02-17T20:57:17.561 INFO:teuthology.orchestra.run.trial153.stderr:1+0 records out 2026-02-17T20:57:17.561 INFO:teuthology.orchestra.run.trial153.stderr:512 bytes copied, 0.00020492 s, 2.5 MB/s 2026-02-17T20:57:17.562 DEBUG:teuthology.orchestra.run.trial153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-17T20:57:17.620 DEBUG:teuthology.orchestra.run.trial153:> stat /dev/vg_nvme/lv_3 2026-02-17T20:57:17.676 INFO:teuthology.orchestra.run.trial153.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-17T20:57:17.676 INFO:teuthology.orchestra.run.trial153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T20:57:17.676 INFO:teuthology.orchestra.run.trial153.stdout:Device: 6h/6d Inode: 1301 Links: 1 2026-02-17T20:57:17.676 INFO:teuthology.orchestra.run.trial153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T20:57:17.676 INFO:teuthology.orchestra.run.trial153.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T20:57:17.676 INFO:teuthology.orchestra.run.trial153.stdout:Access: 2026-02-17 20:57:09.943867317 +0000 2026-02-17T20:57:17.676 INFO:teuthology.orchestra.run.trial153.stdout:Modify: 2026-02-17 20:55:37.269728693 +0000 2026-02-17T20:57:17.676 INFO:teuthology.orchestra.run.trial153.stdout:Change: 2026-02-17 20:55:37.269728693 +0000 2026-02-17T20:57:17.676 INFO:teuthology.orchestra.run.trial153.stdout: Birth: 2026-02-17 20:55:37.269728693 +0000 2026-02-17T20:57:17.677 DEBUG:teuthology.orchestra.run.trial153:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-17T20:57:17.738 INFO:teuthology.orchestra.run.trial153.stderr:1+0 records in 2026-02-17T20:57:17.738 INFO:teuthology.orchestra.run.trial153.stderr:1+0 records out 2026-02-17T20:57:17.738 INFO:teuthology.orchestra.run.trial153.stderr:512 bytes copied, 0.000159435 s, 3.2 MB/s 2026-02-17T20:57:17.739 DEBUG:teuthology.orchestra.run.trial153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-17T20:57:17.797 DEBUG:teuthology.orchestra.run.trial153:> stat /dev/vg_nvme/lv_4 2026-02-17T20:57:17.854 INFO:teuthology.orchestra.run.trial153.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-17T20:57:17.854 INFO:teuthology.orchestra.run.trial153.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-17T20:57:17.854 INFO:teuthology.orchestra.run.trial153.stdout:Device: 6h/6d Inode: 1303 Links: 1 2026-02-17T20:57:17.854 INFO:teuthology.orchestra.run.trial153.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T20:57:17.854 INFO:teuthology.orchestra.run.trial153.stdout:Context: system_u:object_r:device_t:s0 2026-02-17T20:57:17.854 INFO:teuthology.orchestra.run.trial153.stdout:Access: 2026-02-17 20:57:09.943867317 +0000 2026-02-17T20:57:17.855 INFO:teuthology.orchestra.run.trial153.stdout:Modify: 2026-02-17 20:55:37.269728693 +0000 2026-02-17T20:57:17.855 INFO:teuthology.orchestra.run.trial153.stdout:Change: 2026-02-17 20:55:37.269728693 +0000 2026-02-17T20:57:17.855 INFO:teuthology.orchestra.run.trial153.stdout: Birth: 2026-02-17 20:55:37.269728693 +0000 2026-02-17T20:57:17.855 DEBUG:teuthology.orchestra.run.trial153:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-17T20:57:17.918 INFO:teuthology.orchestra.run.trial153.stderr:1+0 records in 2026-02-17T20:57:17.918 INFO:teuthology.orchestra.run.trial153.stderr:1+0 records out 2026-02-17T20:57:17.919 INFO:teuthology.orchestra.run.trial153.stderr:512 bytes copied, 0.000149627 s, 3.4 MB/s 2026-02-17T20:57:17.920 DEBUG:teuthology.orchestra.run.trial153:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-17T20:57:17.979 INFO:tasks.cephadm:Deploying osd.0 on trial104 with /dev/vg_nvme/lv_4... 2026-02-17T20:57:17.979 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-17T20:57:18.135 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:57:18.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:18.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:18.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:18 trial104 ceph-mon[20612]: Reconfiguring grafana.trial104 (dependencies changed)... 2026-02-17T20:57:18.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:18 trial104 ceph-mon[20612]: Reconfiguring daemon grafana.trial104 on trial104 2026-02-17T20:57:18.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:18.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:18.891 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:57:18.908 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph orch daemon add osd trial104:vg_nvme/lv_4 2026-02-17T20:57:19.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:19.060 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:57:19.166 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f762a853640 1 -- 10.20.193.104:0/2597281731 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7624104750 msgr2=0x7f7624104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:19.166 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f762a853640 1 --2- 10.20.193.104:0/2597281731 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7624104750 0x7f7624104b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f76140099b0 tx=0x7f761402f220 comp rx=0 tx=0).stop 2026-02-17T20:57:19.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f762a853640 1 -- 10.20.193.104:0/2597281731 shutdown_connections 2026-02-17T20:57:19.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f762a853640 1 --2- 10.20.193.104:0/2597281731 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7624105950 0x7f7624105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:19.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f762a853640 1 --2- 10.20.193.104:0/2597281731 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7624104750 0x7f7624104b50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:19.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f762a853640 1 -- 10.20.193.104:0/2597281731 >> 10.20.193.104:0/2597281731 conn(0x7f76240fff00 msgr2=0x7f7624102320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:19.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f762a853640 1 -- 10.20.193.104:0/2597281731 shutdown_connections 2026-02-17T20:57:19.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f762a853640 1 -- 10.20.193.104:0/2597281731 wait complete. 2026-02-17T20:57:19.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f762a853640 1 Processor -- start 2026-02-17T20:57:19.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f762a853640 1 -- start start 2026-02-17T20:57:19.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f762a853640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7624104750 0x7f762419c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:19.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f762a853640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7624105950 0x7f762419c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:19.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f762a853640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f762410d300 con 0x7f7624105950 2026-02-17T20:57:19.167 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f762a853640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f762410d180 con 0x7f7624104750 2026-02-17T20:57:19.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f7629050640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7624105950 0x7f762419c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:19.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f7629050640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7624105950 0x7f762419c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:47110/0 (socket says 10.20.193.104:47110) 2026-02-17T20:57:19.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f7629050640 1 -- 10.20.193.104:0/1824177388 learned_addr learned my addr 10.20.193.104:0/1824177388 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:57:19.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.162+0000 7f7629851640 1 --2- 10.20.193.104:0/1824177388 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7624104750 0x7f762419c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:19.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.163+0000 7f7629050640 1 -- 10.20.193.104:0/1824177388 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7624104750 msgr2=0x7f762419c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:19.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.163+0000 7f7629050640 1 --2- 10.20.193.104:0/1824177388 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7624104750 0x7f762419c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:19.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.163+0000 7f7629050640 1 -- 10.20.193.104:0/1824177388 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762419cd10 con 0x7f7624105950 2026-02-17T20:57:19.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.163+0000 7f7629050640 1 --2- 10.20.193.104:0/1824177388 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7624105950 0x7f762419c690 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f761800d900 tx=0x7f761800ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:19.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.163+0000 7f7612ffd640 1 -- 10.20.193.104:0/1824177388 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f7618014070 con 0x7f7624105950 2026-02-17T20:57:19.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.163+0000 7f762a853640 1 -- 10.20.193.104:0/1824177388 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76241a1750 con 0x7f7624105950 2026-02-17T20:57:19.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.163+0000 7f7612ffd640 1 -- 10.20.193.104:0/1824177388 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f76180044a0 con 0x7f7624105950 2026-02-17T20:57:19.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.163+0000 7f7612ffd640 1 -- 10.20.193.104:0/1824177388 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f7618005020 con 0x7f7624105950 2026-02-17T20:57:19.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.163+0000 7f762a853640 1 -- 10.20.193.104:0/1824177388 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76241a1d60 con 0x7f7624105950 2026-02-17T20:57:19.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.163+0000 7f762a853640 1 -- 10.20.193.104:0/1824177388 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7624104b50 con 0x7f7624105950 2026-02-17T20:57:19.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.164+0000 7f7612ffd640 1 -- 10.20.193.104:0/1824177388 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 18) ==== 100063+0+0 (secure 0 0 0) 0x7f76180047c0 con 0x7f7624105950 2026-02-17T20:57:19.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.164+0000 7f7612ffd640 1 --2- 10.20.193.104:0/1824177388 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f76000774c0 0x7f7600079980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:19.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.165+0000 7f7629851640 1 --2- 10.20.193.104:0/1824177388 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f76000774c0 0x7f7600079980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:19.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.165+0000 7f7612ffd640 1 -- 10.20.193.104:0/1824177388 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7618098b20 con 0x7f7624105950 2026-02-17T20:57:19.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.165+0000 7f7629851640 1 --2- 10.20.193.104:0/1824177388 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f76000774c0 0x7f7600079980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7614002af0 tx=0x7f761403a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:19.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.166+0000 7f7612ffd640 1 -- 10.20.193.104:0/1824177388 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7618066cb0 con 0x7f7624105950 2026-02-17T20:57:19.258 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:19.255+0000 7f762a853640 1 -- 10.20.193.104:0/1824177388 --> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial104:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f76241a20d0 con 0x7f76000774c0 2026-02-17T20:57:19.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:19 trial104 ceph-mon[20612]: Reconfiguring prometheus.trial104 (dependencies changed)... 2026-02-17T20:57:19.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:19 trial104 ceph-mon[20612]: Reconfiguring daemon prometheus.trial104 on trial104 2026-02-17T20:57:19.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:57:19.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T20:57:19.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T20:57:19.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:19.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:19.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:19.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-17T20:57:19.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:19.863 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:19 trial153 ceph-mon[25357]: Reconfiguring prometheus.trial104 (dependencies changed)... 2026-02-17T20:57:19.863 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:19 trial153 ceph-mon[25357]: Reconfiguring daemon prometheus.trial104 on trial104 2026-02-17T20:57:19.863 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:57:19.863 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T20:57:19.864 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T20:57:19.864 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:19.864 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:19.864 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:19.864 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.trial153", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2026-02-17T20:57:19.864 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:21.015 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial104:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:57:21.015 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: Reconfiguring ceph-exporter.trial153 (monmap changed)... 2026-02-17T20:57:21.015 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: Reconfiguring daemon ceph-exporter.trial153 on trial153 2026-02-17T20:57:21.015 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.015 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.015 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: Reconfiguring crash.trial153 (monmap changed)... 2026-02-17T20:57:21.015 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-17T20:57:21.016 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:21.016 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: Reconfiguring daemon crash.trial153 on trial153 2026-02-17T20:57:21.016 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.016 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.016 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: Reconfiguring mgr.trial153.ivmqog (monmap changed)... 2026-02-17T20:57:21.016 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.trial153.ivmqog", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-17T20:57:21.016 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-17T20:57:21.016 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:21.016 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: Reconfiguring daemon mgr.trial153.ivmqog on trial153 2026-02-17T20:57:21.016 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/1024920364' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a22ae774-55bf-4c61-9328-96f1ad2a6a62"}]: dispatch 2026-02-17T20:57:21.016 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/1024920364' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a22ae774-55bf-4c61-9328-96f1ad2a6a62"}]': finished 2026-02-17T20:57:21.016 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: osdmap e6: 1 total, 0 up, 1 in 2026-02-17T20:57:21.017 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T20:57:21.017 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.017 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.017 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-17T20:57:21.017 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-17T20:57:21.017 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:21.017 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/1667589267' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T20:57:21.017 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.017 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.017 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-17T20:57:21.017 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial104:9093"}]: dispatch 2026-02-17T20:57:21.017 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.018 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-17T20:57:21.018 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial104:3000"}]: dispatch 2026-02-17T20:57:21.018 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.018 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-17T20:57:21.018 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial104:9095"}]: dispatch 2026-02-17T20:57:21.018 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.018 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:21.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial104:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:57:21.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: Reconfiguring ceph-exporter.trial153 (monmap changed)... 2026-02-17T20:57:21.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: Reconfiguring daemon ceph-exporter.trial153 on trial153 2026-02-17T20:57:21.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: Reconfiguring crash.trial153 (monmap changed)... 2026-02-17T20:57:21.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.trial153", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2026-02-17T20:57:21.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:21.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: Reconfiguring daemon crash.trial153 on trial153 2026-02-17T20:57:21.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: Reconfiguring mgr.trial153.ivmqog (monmap changed)... 2026-02-17T20:57:21.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.trial153.ivmqog", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2026-02-17T20:57:21.027 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mgr services"}]: dispatch 2026-02-17T20:57:21.027 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:21.027 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: Reconfiguring daemon mgr.trial153.ivmqog on trial153 2026-02-17T20:57:21.027 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/1024920364' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a22ae774-55bf-4c61-9328-96f1ad2a6a62"}]: dispatch 2026-02-17T20:57:21.027 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/1024920364' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a22ae774-55bf-4c61-9328-96f1ad2a6a62"}]': finished 2026-02-17T20:57:21.027 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: osdmap e6: 1 total, 0 up, 1 in 2026-02-17T20:57:21.027 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T20:57:21.027 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.027 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.027 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2026-02-17T20:57:21.027 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2026-02-17T20:57:21.027 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:21.028 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/1667589267' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T20:57:21.028 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.028 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.028 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-17T20:57:21.028 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial104:9093"}]: dispatch 2026-02-17T20:57:21.028 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.028 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-17T20:57:21.028 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial104:3000"}]: dispatch 2026-02-17T20:57:21.028 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.028 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-17T20:57:21.028 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial104:9095"}]: dispatch 2026-02-17T20:57:21.028 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:21.028 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:22.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:21 trial153 ceph-mon[25357]: Reconfiguring mon.trial153 (monmap changed)... 2026-02-17T20:57:22.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:21 trial153 ceph-mon[25357]: Reconfiguring daemon mon.trial153 on trial153 2026-02-17T20:57:22.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:21 trial153 ceph-mon[25357]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-17T20:57:22.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:21 trial153 ceph-mon[25357]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial104:9093"}]: dispatch 2026-02-17T20:57:22.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:21 trial153 ceph-mon[25357]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-17T20:57:22.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:21 trial153 ceph-mon[25357]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial104:3000"}]: dispatch 2026-02-17T20:57:22.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:21 trial153 ceph-mon[25357]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-17T20:57:22.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:21 trial153 ceph-mon[25357]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial104:9095"}]: dispatch 2026-02-17T20:57:22.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:21 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:22.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:21 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:22.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:21 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:22.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:21 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:22.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:21 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:22.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:21 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:22.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:21 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:22.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:21 trial104 ceph-mon[20612]: Reconfiguring mon.trial153 (monmap changed)... 2026-02-17T20:57:22.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:21 trial104 ceph-mon[20612]: Reconfiguring daemon mon.trial153 on trial153 2026-02-17T20:57:22.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:21 trial104 ceph-mon[20612]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2026-02-17T20:57:22.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:21 trial104 ceph-mon[20612]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://trial104:9093"}]: dispatch 2026-02-17T20:57:22.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:21 trial104 ceph-mon[20612]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2026-02-17T20:57:22.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:21 trial104 ceph-mon[20612]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://trial104:3000"}]: dispatch 2026-02-17T20:57:22.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:21 trial104 ceph-mon[20612]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2026-02-17T20:57:22.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:21 trial104 ceph-mon[20612]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://trial104:9095"}]: dispatch 2026-02-17T20:57:22.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:21 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:22.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:21 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:22.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:21 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:22.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:21 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:22.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:21 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:22.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:21 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:22.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:21 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:23.837 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:23 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-17T20:57:23.838 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:23 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:24.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:23 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2026-02-17T20:57:24.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:23 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:25.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:24 trial153 ceph-mon[25357]: Deploying daemon osd.0 on trial104 2026-02-17T20:57:25.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:24 trial153 ceph-mon[25357]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T20:57:25.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:24 trial104 ceph-mon[20612]: Deploying daemon osd.0 on trial104 2026-02-17T20:57:25.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:24 trial104 ceph-mon[20612]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T20:57:26.899 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:26 trial104 ceph-mon[20612]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T20:57:26.899 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:26 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:26.899 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:26 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:26.899 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:26 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:26.899 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:26 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:26.899 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:26 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:27.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:26 trial153 ceph-mon[25357]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T20:57:27.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:26 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:27.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:26 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:27.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:26 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:27.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:26 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:27.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:26 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:27.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:27.068+0000 7f7612ffd640 1 -- 10.20.193.104:0/1824177388 <== mgr.14203 v2:10.20.193.104:6800/2484917436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f76241a20d0 con 0x7f76000774c0 2026-02-17T20:57:27.070 INFO:teuthology.orchestra.run.trial104.stdout:Created osd(s) 0 on host 'trial104' 2026-02-17T20:57:27.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:27.070+0000 7f762a853640 1 -- 10.20.193.104:0/1824177388 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f76000774c0 msgr2=0x7f7600079980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:27.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:27.070+0000 7f762a853640 1 --2- 10.20.193.104:0/1824177388 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f76000774c0 0x7f7600079980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7614002af0 tx=0x7f761403a040 comp rx=0 tx=0).stop 2026-02-17T20:57:27.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:27.070+0000 7f762a853640 1 -- 10.20.193.104:0/1824177388 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7624105950 msgr2=0x7f762419c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:27.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:27.070+0000 7f762a853640 1 --2- 10.20.193.104:0/1824177388 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7624105950 0x7f762419c690 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f761800d900 tx=0x7f761800ddd0 comp rx=0 tx=0).stop 2026-02-17T20:57:27.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:27.070+0000 7f762a853640 1 -- 10.20.193.104:0/1824177388 shutdown_connections 2026-02-17T20:57:27.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:27.070+0000 7f762a853640 1 --2- 10.20.193.104:0/1824177388 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f76000774c0 0x7f7600079980 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:27.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:27.070+0000 7f762a853640 1 --2- 10.20.193.104:0/1824177388 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7624105950 0x7f762419c690 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:27.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:27.070+0000 7f762a853640 1 --2- 10.20.193.104:0/1824177388 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7624104750 0x7f762419c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:27.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:27.070+0000 7f762a853640 1 -- 10.20.193.104:0/1824177388 >> 10.20.193.104:0/1824177388 conn(0x7f76240fff00 msgr2=0x7f7624102320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:27.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:27.070+0000 7f762a853640 1 -- 10.20.193.104:0/1824177388 shutdown_connections 2026-02-17T20:57:27.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:27.070+0000 7f762a853640 1 -- 10.20.193.104:0/1824177388 wait complete. 2026-02-17T20:57:27.110 DEBUG:teuthology.orchestra.run.trial104:osd.0> sudo journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.0.service 2026-02-17T20:57:27.112 INFO:tasks.cephadm:Deploying osd.1 on trial104 with /dev/vg_nvme/lv_3... 2026-02-17T20:57:27.112 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-17T20:57:27.316 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:57:28.043 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:27 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.043 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:27 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.044 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:27 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:28.044 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:27 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:28.044 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:27 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.044 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:27 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:28.044 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:27 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.044 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:27 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.044 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:27 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.044 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:27 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.044 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:27 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.044 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:27 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.045 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 20:57:27 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-0[38871]: 2026-02-17T20:57:27.730+0000 7f86e6d33740 -1 Falling back to public interface 2026-02-17T20:57:28.112 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:57:28.128 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph orch daemon add osd trial104:vg_nvme/lv_3 2026-02-17T20:57:28.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:27 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:27 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:27 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:28.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:27 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:28.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:27 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:27 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:28.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:27 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:27 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:27 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:27 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:27 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:27 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:28.321 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:57:28.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.428+0000 7f9558a26640 1 -- 10.20.193.104:0/3549083901 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9554103830 msgr2=0x7f9554105ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:28.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.428+0000 7f9558a26640 1 --2- 10.20.193.104:0/3549083901 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9554103830 0x7f9554105ca0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f953c0099b0 tx=0x7f953c02f220 comp rx=0 tx=0).stop 2026-02-17T20:57:28.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.428+0000 7f9558a26640 1 -- 10.20.193.104:0/3549083901 shutdown_connections 2026-02-17T20:57:28.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.428+0000 7f9558a26640 1 --2- 10.20.193.104:0/3549083901 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9554103830 0x7f9554105ca0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:28.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.428+0000 7f9558a26640 1 --2- 10.20.193.104:0/3549083901 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9554100ee0 0x7f95541032f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:28.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.428+0000 7f9558a26640 1 -- 10.20.193.104:0/3549083901 >> 10.20.193.104:0/3549083901 conn(0x7f95540fcd30 msgr2=0x7f95540ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:28.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.428+0000 7f9558a26640 1 -- 10.20.193.104:0/3549083901 shutdown_connections 2026-02-17T20:57:28.432 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.428+0000 7f9558a26640 1 -- 10.20.193.104:0/3549083901 wait complete. 2026-02-17T20:57:28.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.428+0000 7f9558a26640 1 Processor -- start 2026-02-17T20:57:28.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.428+0000 7f9558a26640 1 -- start start 2026-02-17T20:57:28.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.428+0000 7f9558a26640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9554100ee0 0x7f95541a0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:28.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.428+0000 7f9558a26640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9554103830 0x7f95541a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:28.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.428+0000 7f9558a26640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f95541119c0 con 0x7f9554103830 2026-02-17T20:57:28.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.428+0000 7f9558a26640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9554111840 con 0x7f9554100ee0 2026-02-17T20:57:28.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.428+0000 7f9551d74640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9554103830 0x7f95541a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:28.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.428+0000 7f9551d74640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9554103830 0x7f95541a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:55136/0 (socket says 10.20.193.104:55136) 2026-02-17T20:57:28.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.428+0000 7f9551d74640 1 -- 10.20.193.104:0/3199512535 learned_addr learned my addr 10.20.193.104:0/3199512535 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:57:28.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.429+0000 7f9552575640 1 --2- 10.20.193.104:0/3199512535 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9554100ee0 0x7f95541a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:28.433 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.429+0000 7f9551d74640 1 -- 10.20.193.104:0/3199512535 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9554100ee0 msgr2=0x7f95541a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:28.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.429+0000 7f9551d74640 1 --2- 10.20.193.104:0/3199512535 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9554100ee0 0x7f95541a0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:28.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.429+0000 7f9551d74640 1 -- 10.20.193.104:0/3199512535 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95541a13c0 con 0x7f9554103830 2026-02-17T20:57:28.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.429+0000 7f9551d74640 1 --2- 10.20.193.104:0/3199512535 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9554103830 0x7f95541a0d40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f953c002410 tx=0x7f953c02fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:28.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.429+0000 7f953b7fe640 1 -- 10.20.193.104:0/3199512535 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f953c004420 con 0x7f9554103830 2026-02-17T20:57:28.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.429+0000 7f953b7fe640 1 -- 10.20.193.104:0/3199512535 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f953c038a40 con 0x7f9554103830 2026-02-17T20:57:28.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.429+0000 7f953b7fe640 1 -- 10.20.193.104:0/3199512535 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f953c0418e0 con 0x7f9554103830 2026-02-17T20:57:28.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.429+0000 7f9558a26640 1 -- 10.20.193.104:0/3199512535 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95541a5da0 con 0x7f9554103830 2026-02-17T20:57:28.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.429+0000 7f9558a26640 1 -- 10.20.193.104:0/3199512535 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95541a6330 con 0x7f9554103830 2026-02-17T20:57:28.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.429+0000 7f9558a26640 1 -- 10.20.193.104:0/3199512535 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95541012e0 con 0x7f9554103830 2026-02-17T20:57:28.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.430+0000 7f953b7fe640 1 -- 10.20.193.104:0/3199512535 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 18) ==== 100063+0+0 (secure 0 0 0) 0x7f953c038bf0 con 0x7f9554103830 2026-02-17T20:57:28.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.430+0000 7f953b7fe640 1 --2- 10.20.193.104:0/3199512535 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f952c0774c0 0x7f952c079980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:28.435 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.431+0000 7f953b7fe640 1 -- 10.20.193.104:0/3199512535 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1485+0+0 (secure 0 0 0) 0x7f953c03e070 con 0x7f9554103830 2026-02-17T20:57:28.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.431+0000 7f9552575640 1 --2- 10.20.193.104:0/3199512535 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f952c0774c0 0x7f952c079980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:28.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.431+0000 7f9552575640 1 --2- 10.20.193.104:0/3199512535 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f952c0774c0 0x7f952c079980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9548003920 tx=0x7f9548005f50 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:28.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.433+0000 7f953b7fe640 1 -- 10.20.193.104:0/3199512535 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f953c035320 con 0x7f9554103830 2026-02-17T20:57:28.522 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:28.520+0000 7f9558a26640 1 -- 10.20.193.104:0/3199512535 --> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial104:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f95541041f0 con 0x7f952c0774c0 2026-02-17T20:57:29.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:28 trial153 ceph-mon[25357]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T20:57:29.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:28 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T20:57:29.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:28 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T20:57:29.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:28 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:29.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:28 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:29.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:28 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:29.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:28 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:29.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:28 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:29.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:28 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:29.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:28 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:29.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:28 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:29.358 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:28 trial104 ceph-mon[20612]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T20:57:29.359 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:28 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T20:57:29.359 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:28 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T20:57:29.359 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:28 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:29.359 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:28 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:29.359 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:28 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:29.359 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:28 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:29.359 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:28 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:29.359 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:28 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:29.359 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:28 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:29.359 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:28 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:30.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:29 trial153 ceph-mon[25357]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial104:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:57:30.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:29 trial153 ceph-mon[25357]: Detected new or changed devices on trial104 2026-02-17T20:57:30.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:29 trial153 ceph-mon[25357]: Adjusting osd_memory_target on trial104 to 78799M 2026-02-17T20:57:30.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:29 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/280858334' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e221e89a-fd48-4e6f-a73d-a109718c9b7a"}]: dispatch 2026-02-17T20:57:30.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:29 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/280858334' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e221e89a-fd48-4e6f-a73d-a109718c9b7a"}]': finished 2026-02-17T20:57:30.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:29 trial153 ceph-mon[25357]: osdmap e7: 2 total, 0 up, 2 in 2026-02-17T20:57:30.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:29 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T20:57:30.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:29 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:30.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:29 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/3180642190' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T20:57:30.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:29 trial104 ceph-mon[20612]: from='client.14254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial104:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:57:30.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:29 trial104 ceph-mon[20612]: Detected new or changed devices on trial104 2026-02-17T20:57:30.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:29 trial104 ceph-mon[20612]: Adjusting osd_memory_target on trial104 to 78799M 2026-02-17T20:57:30.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:29 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/280858334' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e221e89a-fd48-4e6f-a73d-a109718c9b7a"}]: dispatch 2026-02-17T20:57:30.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:29 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/280858334' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e221e89a-fd48-4e6f-a73d-a109718c9b7a"}]': finished 2026-02-17T20:57:30.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:29 trial104 ceph-mon[20612]: osdmap e7: 2 total, 0 up, 2 in 2026-02-17T20:57:30.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:29 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T20:57:30.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:29 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:30.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:29 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3180642190' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T20:57:31.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:30 trial104 ceph-mon[20612]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T20:57:31.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:30 trial104 ceph-mon[20612]: from='osd.0 [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-17T20:57:31.154 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 20:57:30 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-0[38871]: 2026-02-17T20:57:30.777+0000 7f86e6d33740 -1 osd.0 0 log_to_monitors true 2026-02-17T20:57:31.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:30 trial153 ceph-mon[25357]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T20:57:31.290 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:30 trial153 ceph-mon[25357]: from='osd.0 [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2026-02-17T20:57:32.553 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 20:57:32 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-0[38871]: 2026-02-17T20:57:32.275+0000 7f86e2cb4640 -1 osd.0 0 waiting for initial osdmap 2026-02-17T20:57:32.553 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 20:57:32 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-0[38871]: 2026-02-17T20:57:32.277+0000 7f86deade640 -1 osd.0 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T20:57:32.554 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:32 trial104 ceph-mon[20612]: from='osd.0 [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-17T20:57:32.554 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:32 trial104 ceph-mon[20612]: osdmap e8: 2 total, 0 up, 2 in 2026-02-17T20:57:32.554 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:32 trial104 ceph-mon[20612]: from='osd.0 [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial104", "root=default"]}]: dispatch 2026-02-17T20:57:32.554 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:32 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T20:57:32.554 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:32 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:32.554 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:32 trial104 ceph-mon[20612]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T20:57:32.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:32 trial153 ceph-mon[25357]: from='osd.0 [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-17T20:57:32.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:32 trial153 ceph-mon[25357]: osdmap e8: 2 total, 0 up, 2 in 2026-02-17T20:57:32.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:32 trial153 ceph-mon[25357]: from='osd.0 [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial104", "root=default"]}]: dispatch 2026-02-17T20:57:32.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:32 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T20:57:32.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:32 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:32.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:32 trial153 ceph-mon[25357]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T20:57:33.341 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:33 trial104 ceph-mon[20612]: from='osd.0 [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial104", "root=default"]}]': finished 2026-02-17T20:57:33.341 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:33 trial104 ceph-mon[20612]: osdmap e9: 2 total, 0 up, 2 in 2026-02-17T20:57:33.341 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T20:57:33.341 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:33.341 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T20:57:33.341 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-17T20:57:33.341 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:33.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:33 trial153 ceph-mon[25357]: from='osd.0 [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial104", "root=default"]}]': finished 2026-02-17T20:57:33.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:33 trial153 ceph-mon[25357]: osdmap e9: 2 total, 0 up, 2 in 2026-02-17T20:57:33.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T20:57:33.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:33.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T20:57:33.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2026-02-17T20:57:33.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:34.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:34 trial104 ceph-mon[20612]: purged_snaps scrub starts 2026-02-17T20:57:34.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:34 trial104 ceph-mon[20612]: purged_snaps scrub ok 2026-02-17T20:57:34.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:34 trial104 ceph-mon[20612]: Deploying daemon osd.1 on trial104 2026-02-17T20:57:34.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:34 trial104 ceph-mon[20612]: osd.0 [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704] boot 2026-02-17T20:57:34.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:34 trial104 ceph-mon[20612]: osdmap e10: 2 total, 1 up, 2 in 2026-02-17T20:57:34.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:34 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T20:57:34.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:34 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:34.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:34 trial104 ceph-mon[20612]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T20:57:34.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:34 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:57:34.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:34 trial153 ceph-mon[25357]: purged_snaps scrub starts 2026-02-17T20:57:34.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:34 trial153 ceph-mon[25357]: purged_snaps scrub ok 2026-02-17T20:57:34.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:34 trial153 ceph-mon[25357]: Deploying daemon osd.1 on trial104 2026-02-17T20:57:34.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:34 trial153 ceph-mon[25357]: osd.0 [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704] boot 2026-02-17T20:57:34.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:34 trial153 ceph-mon[25357]: osdmap e10: 2 total, 1 up, 2 in 2026-02-17T20:57:34.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:34 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2026-02-17T20:57:34.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:34 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:34.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:34 trial153 ceph-mon[25357]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-17T20:57:34.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:34 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:57:35.577 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:35 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:35.577 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:35 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:35.577 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:35 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:35.773 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:35 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:35.773 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:35 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:35.774 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:35 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:36.379 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:36.377+0000 7f953b7fe640 1 -- 10.20.193.104:0/3199512535 <== mgr.14203 v2:10.20.193.104:6800/2484917436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f95541041f0 con 0x7f952c0774c0 2026-02-17T20:57:36.379 INFO:teuthology.orchestra.run.trial104.stdout:Created osd(s) 1 on host 'trial104' 2026-02-17T20:57:36.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:36.380+0000 7f9558a26640 1 -- 10.20.193.104:0/3199512535 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f952c0774c0 msgr2=0x7f952c079980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:36.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:36.380+0000 7f9558a26640 1 --2- 10.20.193.104:0/3199512535 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f952c0774c0 0x7f952c079980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9548003920 tx=0x7f9548005f50 comp rx=0 tx=0).stop 2026-02-17T20:57:36.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:36.380+0000 7f9558a26640 1 -- 10.20.193.104:0/3199512535 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9554103830 msgr2=0x7f95541a0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:36.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:36.380+0000 7f9558a26640 1 --2- 10.20.193.104:0/3199512535 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9554103830 0x7f95541a0d40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f953c002410 tx=0x7f953c02fe10 comp rx=0 tx=0).stop 2026-02-17T20:57:36.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:36.380+0000 7f9558a26640 1 -- 10.20.193.104:0/3199512535 shutdown_connections 2026-02-17T20:57:36.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:36.380+0000 7f9558a26640 1 --2- 10.20.193.104:0/3199512535 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f952c0774c0 0x7f952c079980 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:36.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:36.380+0000 7f9558a26640 1 --2- 10.20.193.104:0/3199512535 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9554103830 0x7f95541a0d40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:36.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:36.380+0000 7f9558a26640 1 --2- 10.20.193.104:0/3199512535 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9554100ee0 0x7f95541a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:36.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:36.380+0000 7f9558a26640 1 -- 10.20.193.104:0/3199512535 >> 10.20.193.104:0/3199512535 conn(0x7f95540fcd30 msgr2=0x7f95540ff120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:36.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:36.380+0000 7f9558a26640 1 -- 10.20.193.104:0/3199512535 shutdown_connections 2026-02-17T20:57:36.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:36.380+0000 7f9558a26640 1 -- 10.20.193.104:0/3199512535 wait complete. 2026-02-17T20:57:36.418 DEBUG:teuthology.orchestra.run.trial104:osd.1> sudo journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.1.service 2026-02-17T20:57:36.431 INFO:tasks.cephadm:Deploying osd.2 on trial104 with /dev/vg_nvme/lv_2... 2026-02-17T20:57:36.431 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-17T20:57:36.633 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:57:36.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:36 trial104 ceph-mon[20612]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T20:57:36.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:36 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:36.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:36 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:36.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:36 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:36.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:36 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:36.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:36 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:36.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:36 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:36.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:36 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:36.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:36 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:36.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:36 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:36.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:36 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:37.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:36 trial153 ceph-mon[25357]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T20:57:37.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:36 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:37.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:36 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:37.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:36 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:37.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:36 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:37.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:36 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:37.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:36 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:37.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:36 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:37.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:36 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:37.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:36 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:37.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:36 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:37.407 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:57:37.422 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph orch daemon add osd trial104:vg_nvme/lv_2 2026-02-17T20:57:37.445 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 20:57:37 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-1[45355]: 2026-02-17T20:57:37.297+0000 7fb614a35740 -1 Falling back to public interface 2026-02-17T20:57:37.578 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:57:37.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.682+0000 7fc7bdf99640 1 -- 10.20.193.104:0/2078072496 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc7b8105b20 msgr2=0x7fc7b8105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:37.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.682+0000 7fc7bdf99640 1 --2- 10.20.193.104:0/2078072496 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc7b8105b20 0x7fc7b8105fa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80099b0 tx=0x7fc7a802f220 comp rx=0 tx=0).stop 2026-02-17T20:57:37.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.682+0000 7fc7bdf99640 1 -- 10.20.193.104:0/2078072496 shutdown_connections 2026-02-17T20:57:37.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.682+0000 7fc7bdf99640 1 --2- 10.20.193.104:0/2078072496 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc7b8105b20 0x7fc7b8105fa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:37.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.682+0000 7fc7bdf99640 1 --2- 10.20.193.104:0/2078072496 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc7b8104920 0x7fc7b8104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:37.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.682+0000 7fc7bdf99640 1 -- 10.20.193.104:0/2078072496 >> 10.20.193.104:0/2078072496 conn(0x7fc7b81000b0 msgr2=0x7fc7b81024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:37.687 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.682+0000 7fc7bdf99640 1 -- 10.20.193.104:0/2078072496 shutdown_connections 2026-02-17T20:57:37.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.682+0000 7fc7bdf99640 1 -- 10.20.193.104:0/2078072496 wait complete. 2026-02-17T20:57:37.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7bdf99640 1 Processor -- start 2026-02-17T20:57:37.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7bdf99640 1 -- start start 2026-02-17T20:57:37.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7bdf99640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc7b8104920 0x7fc7b819c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:37.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7bdf99640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc7b8105b20 0x7fc7b819c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:37.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7bdf99640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b810d4b0 con 0x7fc7b8105b20 2026-02-17T20:57:37.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7bdf99640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b810d330 con 0x7fc7b8104920 2026-02-17T20:57:37.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7b6ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc7b8105b20 0x7fc7b819c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:37.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7b6ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc7b8105b20 0x7fc7b819c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:55200/0 (socket says 10.20.193.104:55200) 2026-02-17T20:57:37.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7b6ffd640 1 -- 10.20.193.104:0/4179239460 learned_addr learned my addr 10.20.193.104:0/4179239460 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:57:37.688 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7b77fe640 1 --2- 10.20.193.104:0/4179239460 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc7b8104920 0x7fc7b819c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:37.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7b6ffd640 1 -- 10.20.193.104:0/4179239460 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc7b8104920 msgr2=0x7fc7b819c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:37.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7b6ffd640 1 --2- 10.20.193.104:0/4179239460 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc7b8104920 0x7fc7b819c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:37.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7b6ffd640 1 -- 10.20.193.104:0/4179239460 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b819cec0 con 0x7fc7b8105b20 2026-02-17T20:57:37.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7b6ffd640 1 --2- 10.20.193.104:0/4179239460 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc7b8105b20 0x7fc7b819c840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8002410 tx=0x7fc7a802fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:37.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7b4ff9640 1 -- 10.20.193.104:0/4179239460 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc7a8004420 con 0x7fc7b8105b20 2026-02-17T20:57:37.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7b4ff9640 1 -- 10.20.193.104:0/4179239460 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fc7a8038a40 con 0x7fc7b8105b20 2026-02-17T20:57:37.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7b4ff9640 1 -- 10.20.193.104:0/4179239460 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc7a80418e0 con 0x7fc7b8105b20 2026-02-17T20:57:37.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7bdf99640 1 -- 10.20.193.104:0/4179239460 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b81a18a0 con 0x7fc7b8105b20 2026-02-17T20:57:37.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.683+0000 7fc7bdf99640 1 -- 10.20.193.104:0/4179239460 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b81a1eb0 con 0x7fc7b8105b20 2026-02-17T20:57:37.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.684+0000 7fc7bdf99640 1 -- 10.20.193.104:0/4179239460 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7b8104d20 con 0x7fc7b8105b20 2026-02-17T20:57:37.689 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.685+0000 7fc7b4ff9640 1 -- 10.20.193.104:0/4179239460 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 18) ==== 100063+0+0 (secure 0 0 0) 0x7fc7a8038bf0 con 0x7fc7b8105b20 2026-02-17T20:57:37.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.685+0000 7fc7b4ff9640 1 --2- 10.20.193.104:0/4179239460 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc78c077510 0x7fc78c0799d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:37.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.685+0000 7fc7b4ff9640 1 -- 10.20.193.104:0/4179239460 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 2095+0+0 (secure 0 0 0) 0x7fc7a803e070 con 0x7fc7b8105b20 2026-02-17T20:57:37.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.685+0000 7fc7b77fe640 1 --2- 10.20.193.104:0/4179239460 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc78c077510 0x7fc78c0799d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:37.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.685+0000 7fc7b77fe640 1 --2- 10.20.193.104:0/4179239460 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc78c077510 0x7fc78c0799d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4005fd0 tx=0x7fc7a4004380 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:37.690 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.687+0000 7fc7b4ff9640 1 -- 10.20.193.104:0/4179239460 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc7a808b8a0 con 0x7fc7b8105b20 2026-02-17T20:57:37.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:37.773+0000 7fc7bdf99640 1 -- 10.20.193.104:0/4179239460 --> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial104:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc7b80630c0 con 0x7fc78c077510 2026-02-17T20:57:38.615 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:38 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:38.615 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:38 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:38.615 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:38 trial104 ceph-mon[20612]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T20:57:38.615 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:38 trial104 ceph-mon[20612]: from='client.14272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial104:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:57:38.615 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:38 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T20:57:38.616 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:38 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T20:57:38.616 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:38 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:38.616 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:38 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:38.616 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:38 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:38.616 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:38 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:38.616 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:38 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:38.616 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:38 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:38.616 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:38 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:38.616 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:38 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:38.616 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:38 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:38.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:38 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:38.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:38 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:38.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:38 trial153 ceph-mon[25357]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T20:57:38.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:38 trial153 ceph-mon[25357]: from='client.14272 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial104:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:57:38.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:38 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T20:57:38.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:38 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T20:57:38.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:38 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:38.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:38 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:38.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:38 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:38.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:38 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:38.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:38 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:38.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:38 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:38.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:38 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:38.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:38 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:38.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:38 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:39.653 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:39 trial104 ceph-mon[20612]: Detected new or changed devices on trial104 2026-02-17T20:57:39.653 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:39 trial104 ceph-mon[20612]: Adjusting osd_memory_target on trial104 to 39399M 2026-02-17T20:57:39.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:39 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3880305706' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0266db8-19cd-4ddb-a96a-cb84d2b0c4c6"}]: dispatch 2026-02-17T20:57:39.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:39 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3880305706' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e0266db8-19cd-4ddb-a96a-cb84d2b0c4c6"}]': finished 2026-02-17T20:57:39.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:39 trial104 ceph-mon[20612]: osdmap e11: 3 total, 1 up, 3 in 2026-02-17T20:57:39.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:39 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:39.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:39 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:39.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:39 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/625275210' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T20:57:39.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:39 trial153 ceph-mon[25357]: Detected new or changed devices on trial104 2026-02-17T20:57:39.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:39 trial153 ceph-mon[25357]: Adjusting osd_memory_target on trial104 to 39399M 2026-02-17T20:57:39.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:39 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/3880305706' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e0266db8-19cd-4ddb-a96a-cb84d2b0c4c6"}]: dispatch 2026-02-17T20:57:39.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:39 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/3880305706' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e0266db8-19cd-4ddb-a96a-cb84d2b0c4c6"}]': finished 2026-02-17T20:57:39.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:39 trial153 ceph-mon[25357]: osdmap e11: 3 total, 1 up, 3 in 2026-02-17T20:57:39.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:39 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:39.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:39 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:39.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:39 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/625275210' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T20:57:40.555 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:40 trial104 ceph-mon[20612]: pgmap v17: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T20:57:40.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:40 trial153 ceph-mon[25357]: pgmap v17: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T20:57:40.903 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 20:57:40 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-1[45355]: 2026-02-17T20:57:40.585+0000 7fb614a35740 -1 osd.1 0 log_to_monitors true 2026-02-17T20:57:41.539 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:41 trial104 ceph-mon[20612]: from='osd.1 [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-17T20:57:41.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:41 trial153 ceph-mon[25357]: from='osd.1 [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2026-02-17T20:57:42.344 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:42 trial104 ceph-mon[20612]: from='osd.1 [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-17T20:57:42.345 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:42 trial104 ceph-mon[20612]: osdmap e12: 3 total, 1 up, 3 in 2026-02-17T20:57:42.345 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:42 trial104 ceph-mon[20612]: from='osd.1 [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial104", "root=default"]}]: dispatch 2026-02-17T20:57:42.345 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:42 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:42.345 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:42 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:42.345 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:42 trial104 ceph-mon[20612]: pgmap v19: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T20:57:42.345 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 20:57:42 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-1[45355]: 2026-02-17T20:57:42.294+0000 7fb6109b6640 -1 osd.1 0 waiting for initial osdmap 2026-02-17T20:57:42.346 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 20:57:42 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-1[45355]: 2026-02-17T20:57:42.296+0000 7fb60c7e0640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T20:57:42.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:42 trial153 ceph-mon[25357]: from='osd.1 [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-17T20:57:42.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:42 trial153 ceph-mon[25357]: osdmap e12: 3 total, 1 up, 3 in 2026-02-17T20:57:42.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:42 trial153 ceph-mon[25357]: from='osd.1 [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial104", "root=default"]}]: dispatch 2026-02-17T20:57:42.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:42 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:42.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:42 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:42.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:42 trial153 ceph-mon[25357]: pgmap v19: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T20:57:43.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:43 trial104 ceph-mon[20612]: from='osd.1 [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial104", "root=default"]}]': finished 2026-02-17T20:57:43.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:43 trial104 ceph-mon[20612]: osdmap e13: 3 total, 1 up, 3 in 2026-02-17T20:57:43.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:43 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:43.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:43 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:43.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:43 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:43.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:43 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-17T20:57:43.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:43 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:43.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:43 trial104 ceph-mon[20612]: Deploying daemon osd.2 on trial104 2026-02-17T20:57:43.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:43 trial153 ceph-mon[25357]: from='osd.1 [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial104", "root=default"]}]': finished 2026-02-17T20:57:43.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:43 trial153 ceph-mon[25357]: osdmap e13: 3 total, 1 up, 3 in 2026-02-17T20:57:43.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:43 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:43.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:43 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:43.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:43 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:43.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:43 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2026-02-17T20:57:43.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:43 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:43.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:43 trial153 ceph-mon[25357]: Deploying daemon osd.2 on trial104 2026-02-17T20:57:44.653 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:44 trial104 ceph-mon[20612]: purged_snaps scrub starts 2026-02-17T20:57:44.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:44 trial104 ceph-mon[20612]: purged_snaps scrub ok 2026-02-17T20:57:44.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:44 trial104 ceph-mon[20612]: osd.1 [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859] boot 2026-02-17T20:57:44.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:44 trial104 ceph-mon[20612]: osdmap e14: 3 total, 2 up, 3 in 2026-02-17T20:57:44.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:44 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:44.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:44 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:44.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:44 trial104 ceph-mon[20612]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T20:57:44.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:44 trial153 ceph-mon[25357]: purged_snaps scrub starts 2026-02-17T20:57:44.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:44 trial153 ceph-mon[25357]: purged_snaps scrub ok 2026-02-17T20:57:44.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:44 trial153 ceph-mon[25357]: osd.1 [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859] boot 2026-02-17T20:57:44.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:44 trial153 ceph-mon[25357]: osdmap e14: 3 total, 2 up, 3 in 2026-02-17T20:57:44.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:44 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2026-02-17T20:57:44.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:44 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:44.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:44 trial153 ceph-mon[25357]: pgmap v22: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-17T20:57:45.448 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:45.445+0000 7fc7b4ff9640 1 -- 10.20.193.104:0/4179239460 <== mgr.14203 v2:10.20.193.104:6800/2484917436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fc7b80630c0 con 0x7fc78c077510 2026-02-17T20:57:45.448 INFO:teuthology.orchestra.run.trial104.stdout:Created osd(s) 2 on host 'trial104' 2026-02-17T20:57:45.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:45.448+0000 7fc7bdf99640 1 -- 10.20.193.104:0/4179239460 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc78c077510 msgr2=0x7fc78c0799d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:45.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:45.448+0000 7fc7bdf99640 1 --2- 10.20.193.104:0/4179239460 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc78c077510 0x7fc78c0799d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4005fd0 tx=0x7fc7a4004380 comp rx=0 tx=0).stop 2026-02-17T20:57:45.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:45.448+0000 7fc7bdf99640 1 -- 10.20.193.104:0/4179239460 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc7b8105b20 msgr2=0x7fc7b819c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:45.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:45.448+0000 7fc7bdf99640 1 --2- 10.20.193.104:0/4179239460 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc7b8105b20 0x7fc7b819c840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc7a8002410 tx=0x7fc7a802fe10 comp rx=0 tx=0).stop 2026-02-17T20:57:45.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:45.448+0000 7fc7bdf99640 1 -- 10.20.193.104:0/4179239460 shutdown_connections 2026-02-17T20:57:45.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:45.448+0000 7fc7bdf99640 1 --2- 10.20.193.104:0/4179239460 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc78c077510 0x7fc78c0799d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:45.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:45.448+0000 7fc7bdf99640 1 --2- 10.20.193.104:0/4179239460 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc7b8105b20 0x7fc7b819c840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:45.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:45.448+0000 7fc7bdf99640 1 --2- 10.20.193.104:0/4179239460 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc7b8104920 0x7fc7b819c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:45.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:45.448+0000 7fc7bdf99640 1 -- 10.20.193.104:0/4179239460 >> 10.20.193.104:0/4179239460 conn(0x7fc7b81000b0 msgr2=0x7fc7b81091a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:45.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:45.448+0000 7fc7bdf99640 1 -- 10.20.193.104:0/4179239460 shutdown_connections 2026-02-17T20:57:45.451 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:45.448+0000 7fc7bdf99640 1 -- 10.20.193.104:0/4179239460 wait complete. 2026-02-17T20:57:45.489 DEBUG:teuthology.orchestra.run.trial104:osd.2> sudo journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.2.service 2026-02-17T20:57:45.531 INFO:tasks.cephadm:Deploying osd.3 on trial104 with /dev/vg_nvme/lv_1... 2026-02-17T20:57:45.531 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-17T20:57:45.551 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:45 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:45.551 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:45 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:45.551 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:45 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:45.721 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:57:45.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:45 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:45.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:45 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:45.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:45 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T20:57:46.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:46.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:46.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:46.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:46.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:46.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:46.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:46.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:46.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.656 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 20:57:46 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-2[51726]: 2026-02-17T20:57:46.376+0000 7f9e14b03740 -1 Falling back to public interface 2026-02-17T20:57:46.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T20:57:46.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:46.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:46.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:46.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:46.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:46.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:46.778 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:46.778 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:46.778 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:46.860 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:57:46.876 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph orch daemon add osd trial104:vg_nvme/lv_1 2026-02-17T20:57:47.034 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:57:47.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.135+0000 7fdde7acf640 1 -- 10.20.193.104:0/1045509893 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdde01026b0 msgr2=0x7fdde0102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:47.140 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.135+0000 7fdde7acf640 1 --2- 10.20.193.104:0/1045509893 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdde01026b0 0x7fdde0102ab0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fddd00099b0 tx=0x7fddd002f220 comp rx=0 tx=0).stop 2026-02-17T20:57:47.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.135+0000 7fdde7acf640 1 -- 10.20.193.104:0/1045509893 shutdown_connections 2026-02-17T20:57:47.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.135+0000 7fdde7acf640 1 --2- 10.20.193.104:0/1045509893 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fdde01038b0 0x7fdde0103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:47.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.135+0000 7fdde7acf640 1 --2- 10.20.193.104:0/1045509893 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdde01026b0 0x7fdde0102ab0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:47.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.135+0000 7fdde7acf640 1 -- 10.20.193.104:0/1045509893 >> 10.20.193.104:0/1045509893 conn(0x7fdde00fde60 msgr2=0x7fdde0100280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:47.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.135+0000 7fdde7acf640 1 -- 10.20.193.104:0/1045509893 shutdown_connections 2026-02-17T20:57:47.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.135+0000 7fdde7acf640 1 -- 10.20.193.104:0/1045509893 wait complete. 2026-02-17T20:57:47.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.135+0000 7fdde7acf640 1 Processor -- start 2026-02-17T20:57:47.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.135+0000 7fdde7acf640 1 -- start start 2026-02-17T20:57:47.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.135+0000 7fdde7acf640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fdde01026b0 0x7fdde019c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:47.141 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.135+0000 7fdde7acf640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdde01038b0 0x7fdde019c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:47.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.135+0000 7fdde7acf640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fdde010b260 con 0x7fdde01038b0 2026-02-17T20:57:47.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.135+0000 7fdde7acf640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fdde010b0e0 con 0x7fdde01026b0 2026-02-17T20:57:47.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.136+0000 7fdde5043640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdde01038b0 0x7fdde019c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:47.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.136+0000 7fdde5043640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdde01038b0 0x7fdde019c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:58086/0 (socket says 10.20.193.104:58086) 2026-02-17T20:57:47.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.136+0000 7fdde5043640 1 -- 10.20.193.104:0/3124005785 learned_addr learned my addr 10.20.193.104:0/3124005785 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:57:47.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.136+0000 7fdde5844640 1 --2- 10.20.193.104:0/3124005785 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fdde01026b0 0x7fdde019c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:47.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.136+0000 7fdde5043640 1 -- 10.20.193.104:0/3124005785 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fdde01026b0 msgr2=0x7fdde019c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:47.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.136+0000 7fdde5043640 1 --2- 10.20.193.104:0/3124005785 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fdde01026b0 0x7fdde019c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:47.142 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.136+0000 7fdde5043640 1 -- 10.20.193.104:0/3124005785 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdde019cf80 con 0x7fdde01038b0 2026-02-17T20:57:47.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.136+0000 7fdde5043640 1 --2- 10.20.193.104:0/3124005785 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdde01038b0 0x7fdde019c900 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fddd400c8f0 tx=0x7fddd400cdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:47.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.136+0000 7fddceffd640 1 -- 10.20.193.104:0/3124005785 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fddd4007c30 con 0x7fdde01038b0 2026-02-17T20:57:47.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.136+0000 7fdde7acf640 1 -- 10.20.193.104:0/3124005785 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdde01a19c0 con 0x7fdde01038b0 2026-02-17T20:57:47.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.136+0000 7fddceffd640 1 -- 10.20.193.104:0/3124005785 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fddd4007dd0 con 0x7fdde01038b0 2026-02-17T20:57:47.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.136+0000 7fddceffd640 1 -- 10.20.193.104:0/3124005785 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fddd40187c0 con 0x7fdde01038b0 2026-02-17T20:57:47.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.136+0000 7fdde7acf640 1 -- 10.20.193.104:0/3124005785 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdde01a1fd0 con 0x7fdde01038b0 2026-02-17T20:57:47.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.136+0000 7fdde7acf640 1 -- 10.20.193.104:0/3124005785 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdde0102ab0 con 0x7fdde01038b0 2026-02-17T20:57:47.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.137+0000 7fddceffd640 1 -- 10.20.193.104:0/3124005785 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 18) ==== 100063+0+0 (secure 0 0 0) 0x7fddd400f450 con 0x7fdde01038b0 2026-02-17T20:57:47.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.138+0000 7fddceffd640 1 --2- 10.20.193.104:0/3124005785 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fddbc0774c0 0x7fddbc079980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:47.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.138+0000 7fddceffd640 1 -- 10.20.193.104:0/3124005785 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2527+0+0 (secure 0 0 0) 0x7fddd4099210 con 0x7fdde01038b0 2026-02-17T20:57:47.143 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.138+0000 7fdde5844640 1 --2- 10.20.193.104:0/3124005785 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fddbc0774c0 0x7fddbc079980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:47.144 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.138+0000 7fdde5844640 1 --2- 10.20.193.104:0/3124005785 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fddbc0774c0 0x7fddbc079980 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fddd00097c0 tx=0x7fddd003a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:47.144 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.139+0000 7fddceffd640 1 -- 10.20.193.104:0/3124005785 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fddd4014030 con 0x7fdde01038b0 2026-02-17T20:57:47.229 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:47.226+0000 7fdde7acf640 1 -- 10.20.193.104:0/3124005785 --> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial104:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fdde00630c0 con 0x7fddbc0774c0 2026-02-17T20:57:47.758 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:47 trial104 ceph-mon[20612]: Detected new or changed devices on trial104 2026-02-17T20:57:47.759 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:47 trial104 ceph-mon[20612]: Adjusting osd_memory_target on trial104 to 26266M 2026-02-17T20:57:47.759 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:47 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T20:57:47.759 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:47 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T20:57:47.759 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:47 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:47.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:47 trial153 ceph-mon[25357]: Detected new or changed devices on trial104 2026-02-17T20:57:47.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:47 trial153 ceph-mon[25357]: Adjusting osd_memory_target on trial104 to 26266M 2026-02-17T20:57:47.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:47 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T20:57:47.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:47 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T20:57:47.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:47 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:48.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:48 trial153 ceph-mon[25357]: from='client.14290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial104:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:57:48.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:48 trial153 ceph-mon[25357]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T20:57:48.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:48 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/2797852271' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b10ab50-7d78-4eea-b768-34534959a99d"}]: dispatch 2026-02-17T20:57:48.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:48 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/2797852271' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3b10ab50-7d78-4eea-b768-34534959a99d"}]': finished 2026-02-17T20:57:48.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:48 trial153 ceph-mon[25357]: osdmap e15: 4 total, 2 up, 4 in 2026-02-17T20:57:48.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:48.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:48.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:48 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/3000639751' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T20:57:48.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:48 trial104 ceph-mon[20612]: from='client.14290 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial104:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:57:48.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:48 trial104 ceph-mon[20612]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T20:57:48.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:48 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/2797852271' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3b10ab50-7d78-4eea-b768-34534959a99d"}]: dispatch 2026-02-17T20:57:48.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:48 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/2797852271' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3b10ab50-7d78-4eea-b768-34534959a99d"}]': finished 2026-02-17T20:57:48.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:48 trial104 ceph-mon[20612]: osdmap e15: 4 total, 2 up, 4 in 2026-02-17T20:57:48.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:48.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:48.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:48 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3000639751' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T20:57:49.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:49 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:57:49.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:49 trial153 ceph-mon[25357]: from='osd.2 [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-17T20:57:49.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:49 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:57:49.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:49 trial104 ceph-mon[20612]: from='osd.2 [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2026-02-17T20:57:49.904 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 20:57:49 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-2[51726]: 2026-02-17T20:57:49.407+0000 7f9e14b03740 -1 osd.2 0 log_to_monitors true 2026-02-17T20:57:50.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:50 trial153 ceph-mon[25357]: from='osd.2 [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-17T20:57:50.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:50 trial153 ceph-mon[25357]: osdmap e16: 4 total, 2 up, 4 in 2026-02-17T20:57:50.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:50 trial153 ceph-mon[25357]: from='osd.2 [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial104", "root=default"]}]: dispatch 2026-02-17T20:57:50.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:50 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:50.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:50 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:50.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:50 trial153 ceph-mon[25357]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T20:57:50.879 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 20:57:50 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-2[51726]: 2026-02-17T20:57:50.489+0000 7f9e10a84640 -1 osd.2 0 waiting for initial osdmap 2026-02-17T20:57:50.879 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 20:57:50 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-2[51726]: 2026-02-17T20:57:50.491+0000 7f9e0c8ae640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T20:57:50.879 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:50 trial104 ceph-mon[20612]: from='osd.2 [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-17T20:57:50.879 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:50 trial104 ceph-mon[20612]: osdmap e16: 4 total, 2 up, 4 in 2026-02-17T20:57:50.879 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:50 trial104 ceph-mon[20612]: from='osd.2 [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial104", "root=default"]}]: dispatch 2026-02-17T20:57:50.879 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:50 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:50.880 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:50 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:50.880 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:50 trial104 ceph-mon[20612]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T20:57:51.725 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:51 trial104 ceph-mon[20612]: from='osd.2 [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial104", "root=default"]}]': finished 2026-02-17T20:57:51.726 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:51 trial104 ceph-mon[20612]: osdmap e17: 4 total, 2 up, 4 in 2026-02-17T20:57:51.726 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:51 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:51.726 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:51 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:51.726 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:51 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:51.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:51 trial153 ceph-mon[25357]: from='osd.2 [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial104", "root=default"]}]': finished 2026-02-17T20:57:51.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:51 trial153 ceph-mon[25357]: osdmap e17: 4 total, 2 up, 4 in 2026-02-17T20:57:51.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:51 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:51.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:51 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:51.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:51 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:52.554 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:52 trial104 ceph-mon[20612]: purged_snaps scrub starts 2026-02-17T20:57:52.554 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:52 trial104 ceph-mon[20612]: purged_snaps scrub ok 2026-02-17T20:57:52.554 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:52.554 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:52 trial104 ceph-mon[20612]: osd.2 [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919] boot 2026-02-17T20:57:52.554 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:52 trial104 ceph-mon[20612]: osdmap e18: 4 total, 3 up, 4 in 2026-02-17T20:57:52.555 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:52.555 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:52.555 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:52 trial104 ceph-mon[20612]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T20:57:52.555 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-17T20:57:52.555 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-02-17T20:57:52.555 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:52.555 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:52 trial104 ceph-mon[20612]: Deploying daemon osd.3 on trial104 2026-02-17T20:57:52.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:52 trial153 ceph-mon[25357]: purged_snaps scrub starts 2026-02-17T20:57:52.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:52 trial153 ceph-mon[25357]: purged_snaps scrub ok 2026-02-17T20:57:52.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:52.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:52 trial153 ceph-mon[25357]: osd.2 [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919] boot 2026-02-17T20:57:52.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:52 trial153 ceph-mon[25357]: osdmap e18: 4 total, 3 up, 4 in 2026-02-17T20:57:52.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2026-02-17T20:57:52.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:52.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:52 trial153 ceph-mon[25357]: pgmap v30: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-17T20:57:52.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2026-02-17T20:57:52.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2026-02-17T20:57:52.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:52.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:52 trial153 ceph-mon[25357]: Deploying daemon osd.3 on trial104 2026-02-17T20:57:53.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:53 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-17T20:57:53.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:53 trial153 ceph-mon[25357]: osdmap e19: 4 total, 3 up, 4 in 2026-02-17T20:57:53.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:53 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:53.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:53 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-17T20:57:53.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:53 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-17T20:57:53.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:53 trial104 ceph-mon[20612]: osdmap e19: 4 total, 3 up, 4 in 2026-02-17T20:57:53.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:53 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:53.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:53 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2026-02-17T20:57:54.193 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 20:57:53 trial104 sudo[57662]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-17T20:57:54.193 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 20:57:53 trial104 sudo[57662]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T20:57:54.193 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 20:57:53 trial104 sudo[57662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T20:57:54.193 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 20:57:53 trial104 sudo[57662]: pam_unix(sudo:session): session closed for user root 2026-02-17T20:57:54.193 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 20:57:53 trial104 sudo[57692]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-17T20:57:54.193 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 20:57:53 trial104 sudo[57692]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T20:57:54.193 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 20:57:53 trial104 sudo[57692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T20:57:54.193 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 20:57:53 trial104 sudo[57692]: pam_unix(sudo:session): session closed for user root 2026-02-17T20:57:54.194 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 sudo[57833]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-17T20:57:54.194 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 sudo[57833]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T20:57:54.194 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 sudo[57833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T20:57:54.194 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 sudo[57833]: pam_unix(sudo:session): session closed for user root 2026-02-17T20:57:54.194 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 sudo[57848]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-17T20:57:54.194 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 sudo[57848]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T20:57:54.194 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 sudo[57848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T20:57:54.195 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 sudo[57848]: pam_unix(sudo:session): session closed for user root 2026-02-17T20:57:54.195 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 20:57:53 trial104 sudo[57734]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-17T20:57:54.195 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 20:57:53 trial104 sudo[57734]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T20:57:54.195 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 20:57:53 trial104 sudo[57734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T20:57:54.195 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 20:57:53 trial104 sudo[57734]: pam_unix(sudo:session): session closed for user root 2026-02-17T20:57:54.195 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 20:57:53 trial104 sudo[57752]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-17T20:57:54.195 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 20:57:53 trial104 sudo[57752]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T20:57:54.196 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 20:57:53 trial104 sudo[57752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T20:57:54.196 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 20:57:53 trial104 sudo[57752]: pam_unix(sudo:session): session closed for user root 2026-02-17T20:57:54.196 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 20:57:54 trial104 sudo[57765]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-17T20:57:54.196 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 20:57:54 trial104 sudo[57765]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T20:57:54.196 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 20:57:54 trial104 sudo[57765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T20:57:54.196 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 20:57:54 trial104 sudo[57765]: pam_unix(sudo:session): session closed for user root 2026-02-17T20:57:54.196 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 20:57:54 trial104 sudo[57793]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-17T20:57:54.196 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 20:57:54 trial104 sudo[57793]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T20:57:54.196 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 20:57:54 trial104 sudo[57793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T20:57:54.197 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 20:57:54 trial104 sudo[57793]: pam_unix(sudo:session): session closed for user root 2026-02-17T20:57:54.500 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 sudo[28637]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-17T20:57:54.500 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 sudo[28637]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T20:57:54.500 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 sudo[28637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T20:57:54.501 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 sudo[28637]: pam_unix(sudo:session): session closed for user root 2026-02-17T20:57:54.501 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 sudo[28641]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-17T20:57:54.501 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 sudo[28641]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-17T20:57:54.501 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 sudo[28641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-17T20:57:54.501 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 sudo[28641]: pam_unix(sudo:session): session closed for user root 2026-02-17T20:57:54.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:54.599+0000 7fddceffd640 1 -- 10.20.193.104:0/3124005785 <== mgr.14203 v2:10.20.193.104:6800/2484917436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fdde00630c0 con 0x7fddbc0774c0 2026-02-17T20:57:54.602 INFO:teuthology.orchestra.run.trial104.stdout:Created osd(s) 3 on host 'trial104' 2026-02-17T20:57:54.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:54.601+0000 7fdde7acf640 1 -- 10.20.193.104:0/3124005785 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fddbc0774c0 msgr2=0x7fddbc079980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:54.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:54.601+0000 7fdde7acf640 1 --2- 10.20.193.104:0/3124005785 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fddbc0774c0 0x7fddbc079980 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fddd00097c0 tx=0x7fddd003a040 comp rx=0 tx=0).stop 2026-02-17T20:57:54.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:54.601+0000 7fdde7acf640 1 -- 10.20.193.104:0/3124005785 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdde01038b0 msgr2=0x7fdde019c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:54.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:54.601+0000 7fdde7acf640 1 --2- 10.20.193.104:0/3124005785 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdde01038b0 0x7fdde019c900 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fddd400c8f0 tx=0x7fddd400cdc0 comp rx=0 tx=0).stop 2026-02-17T20:57:54.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:54.602+0000 7fdde7acf640 1 -- 10.20.193.104:0/3124005785 shutdown_connections 2026-02-17T20:57:54.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:54.602+0000 7fdde7acf640 1 --2- 10.20.193.104:0/3124005785 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fddbc0774c0 0x7fddbc079980 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:54.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:54.602+0000 7fdde7acf640 1 --2- 10.20.193.104:0/3124005785 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fdde01038b0 0x7fdde019c900 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:54.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:54.602+0000 7fdde7acf640 1 --2- 10.20.193.104:0/3124005785 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fdde01026b0 0x7fdde019c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:54.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:54.602+0000 7fdde7acf640 1 -- 10.20.193.104:0/3124005785 >> 10.20.193.104:0/3124005785 conn(0x7fdde00fde60 msgr2=0x7fdde0075750 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:54.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:54.602+0000 7fdde7acf640 1 -- 10.20.193.104:0/3124005785 shutdown_connections 2026-02-17T20:57:54.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:57:54.602+0000 7fdde7acf640 1 -- 10.20.193.104:0/3124005785 wait complete. 2026-02-17T20:57:54.641 DEBUG:teuthology.orchestra.run.trial104:osd.3> sudo journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.3.service 2026-02-17T20:57:54.644 INFO:tasks.cephadm:Deploying osd.4 on trial153 with /dev/vg_nvme/lv_4... 2026-02-17T20:57:54.644 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-17T20:57:54.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-17T20:57:54.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: osdmap e20: 4 total, 3 up, 4 in 2026-02-17T20:57:54.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:54.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: pgmap v33: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T20:57:54.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:54.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:54.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:54.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:54.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:54.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-17T20:57:54.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-17T20:57:54.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial104"}]: dispatch 2026-02-17T20:57:54.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-17T20:57:54.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial153"}]: dispatch 2026-02-17T20:57:54.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial104"}]: dispatch 2026-02-17T20:57:54.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial153"}]: dispatch 2026-02-17T20:57:54.778 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-17T20:57:54.778 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:54.798 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial153/config 2026-02-17T20:57:54.888 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-17T20:57:54.888 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: osdmap e20: 4 total, 3 up, 4 in 2026-02-17T20:57:54.888 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:54.888 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: pgmap v33: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T20:57:54.888 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:54.888 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:54.888 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:54.888 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:54.888 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:54.889 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-17T20:57:54.889 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-17T20:57:54.889 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial104"}]: dispatch 2026-02-17T20:57:54.889 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-17T20:57:54.889 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial153"}]: dispatch 2026-02-17T20:57:54.889 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial104"}]: dispatch 2026-02-17T20:57:54.889 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mon metadata", "id": "trial153"}]: dispatch 2026-02-17T20:57:54.889 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-17T20:57:54.889 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.571 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:57:55.586 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph orch daemon add osd trial153:vg_nvme/lv_4 2026-02-17T20:57:55.598 INFO:journalctl@ceph.osd.3.trial104.stdout:Feb 17 20:57:55 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-3[57388]: 2026-02-17T20:57:55.329+0000 7f71c396a740 -1 Falling back to public interface 2026-02-17T20:57:55.738 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial153/config 2026-02-17T20:57:55.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: osdmap e21: 4 total, 3 up, 4 in 2026-02-17T20:57:55.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:55.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:55.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:55.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:55.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:55.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:55.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:55.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:55.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:55.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:55.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.850 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.843+0000 7f64d2f4a640 1 -- 10.20.193.153:0/2323055531 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f64cc103190 msgr2=0x7f64cc105580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:55.850 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.843+0000 7f64d2f4a640 1 --2- 10.20.193.153:0/2323055531 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f64cc103190 0x7f64cc105580 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f64bc0099b0 tx=0x7f64bc02f220 comp rx=0 tx=0).stop 2026-02-17T20:57:55.851 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.843+0000 7f64d2f4a640 1 -- 10.20.193.153:0/2323055531 shutdown_connections 2026-02-17T20:57:55.851 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.843+0000 7f64d2f4a640 1 --2- 10.20.193.153:0/2323055531 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64cc105ac0 0x7f64cc107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:55.851 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.843+0000 7f64d2f4a640 1 --2- 10.20.193.153:0/2323055531 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f64cc103190 0x7f64cc105580 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:55.851 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.843+0000 7f64d2f4a640 1 -- 10.20.193.153:0/2323055531 >> 10.20.193.153:0/2323055531 conn(0x7f64cc0fcd30 msgr2=0x7f64cc0ff150 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:57:55.851 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.843+0000 7f64d2f4a640 1 -- 10.20.193.153:0/2323055531 shutdown_connections 2026-02-17T20:57:55.851 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.843+0000 7f64d2f4a640 1 -- 10.20.193.153:0/2323055531 wait complete. 2026-02-17T20:57:55.851 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.843+0000 7f64d2f4a640 1 Processor -- start 2026-02-17T20:57:55.851 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.843+0000 7f64d2f4a640 1 -- start start 2026-02-17T20:57:55.851 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64d2f4a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f64cc103190 0x7f64cc19c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:55.851 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64d2f4a640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64cc105ac0 0x7f64cc19c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:55.852 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64d2f4a640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f64cc10b2a0 con 0x7f64cc105ac0 2026-02-17T20:57:55.852 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64d2f4a640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64cc10b120 con 0x7f64cc103190 2026-02-17T20:57:55.852 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64d0cbf640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f64cc103190 0x7f64cc19c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:55.852 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64d0cbf640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f64cc103190 0x7f64cc19c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.153:36314/0 (socket says 10.20.193.153:36314) 2026-02-17T20:57:55.852 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64d0cbf640 1 -- 10.20.193.153:0/1383256853 learned_addr learned my addr 10.20.193.153:0/1383256853 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:57:55.852 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64c3fff640 1 --2- 10.20.193.153:0/1383256853 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64cc105ac0 0x7f64cc19c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:55.852 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64d0cbf640 1 -- 10.20.193.153:0/1383256853 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64cc105ac0 msgr2=0x7f64cc19c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:57:55.852 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64d0cbf640 1 --2- 10.20.193.153:0/1383256853 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64cc105ac0 0x7f64cc19c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:57:55.852 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64d0cbf640 1 -- 10.20.193.153:0/1383256853 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64cc19cf70 con 0x7f64cc103190 2026-02-17T20:57:55.852 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64c3fff640 1 --2- 10.20.193.153:0/1383256853 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64cc105ac0 0x7f64cc19c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T20:57:55.852 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64d0cbf640 1 --2- 10.20.193.153:0/1383256853 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f64cc103190 0x7f64cc19c3b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f64bc002410 tx=0x7f64bc02fe10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:55.853 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64c1ffb640 1 -- 10.20.193.153:0/1383256853 <== mon.1 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f64bc004420 con 0x7f64cc103190 2026-02-17T20:57:55.853 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64c1ffb640 1 -- 10.20.193.153:0/1383256853 <== mon.1 v2:10.20.193.153:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f64bc038a40 con 0x7f64cc103190 2026-02-17T20:57:55.853 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64d2f4a640 1 -- 10.20.193.153:0/1383256853 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64cc1a1950 con 0x7f64cc103190 2026-02-17T20:57:55.853 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64c1ffb640 1 -- 10.20.193.153:0/1383256853 <== mon.1 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f64bc0418e0 con 0x7f64cc103190 2026-02-17T20:57:55.853 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64d2f4a640 1 -- 10.20.193.153:0/1383256853 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64cc1a1f60 con 0x7f64cc103190 2026-02-17T20:57:55.853 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.844+0000 7f64d2f4a640 1 -- 10.20.193.153:0/1383256853 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64cc103570 con 0x7f64cc103190 2026-02-17T20:57:55.853 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.845+0000 7f64c1ffb640 1 -- 10.20.193.153:0/1383256853 <== mon.1 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 18) ==== 100063+0+0 (secure 0 0 0) 0x7f64bc038bf0 con 0x7f64cc103190 2026-02-17T20:57:55.853 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.845+0000 7f64c1ffb640 1 --2- 10.20.193.153:0/1383256853 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f64a8077510 0x7f64a80799d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:57:55.853 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.846+0000 7f64c1ffb640 1 -- 10.20.193.153:0/1383256853 <== mon.1 v2:10.20.193.153:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3345+0+0 (secure 0 0 0) 0x7f64bc03e070 con 0x7f64cc103190 2026-02-17T20:57:55.853 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.846+0000 7f64c3fff640 1 --2- 10.20.193.153:0/1383256853 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f64a8077510 0x7f64a80799d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:57:55.854 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.846+0000 7f64c3fff640 1 --2- 10.20.193.153:0/1383256853 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f64a8077510 0x7f64a80799d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f64cc19d860 tx=0x7f64b4005f50 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:57:55.854 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.847+0000 7f64c1ffb640 1 -- 10.20.193.153:0/1383256853 <== mon.1 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f64bc08b8d0 con 0x7f64cc103190 2026-02-17T20:57:55.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: osdmap e21: 4 total, 3 up, 4 in 2026-02-17T20:57:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:55.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:55.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:57:55.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:55.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:55.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:57:55.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:55.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:57:55.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:57:55.937 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:55.933+0000 7f64d2f4a640 1 -- 10.20.193.153:0/1383256853 --> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f64cc0630c0 con 0x7f64a8077510 2026-02-17T20:57:56.606 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:57:56.601+0000 7f64c1ffb640 1 -- 10.20.193.153:0/1383256853 <== mon.1 v2:10.20.193.153:3300/0 7 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f64bc083560 con 0x7f64cc103190 2026-02-17T20:57:56.713 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:56 trial153 ceph-mon[25357]: Detected new or changed devices on trial104 2026-02-17T20:57:56.713 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:56 trial153 ceph-mon[25357]: Adjusting osd_memory_target on trial104 to 19699M 2026-02-17T20:57:56.713 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:56 trial153 ceph-mon[25357]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T20:57:56.713 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:56 trial153 ceph-mon[25357]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:57:56.713 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T20:57:56.714 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T20:57:56.714 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:56.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:56 trial104 ceph-mon[20612]: Detected new or changed devices on trial104 2026-02-17T20:57:56.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:56 trial104 ceph-mon[20612]: Adjusting osd_memory_target on trial104 to 19699M 2026-02-17T20:57:56.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:56 trial104 ceph-mon[20612]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T20:57:56.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:56 trial104 ceph-mon[20612]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial153:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:57:56.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T20:57:56.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T20:57:56.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:57:57.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:57 trial104 ceph-mon[20612]: mgrmap e19: trial104.irrhmt(active, since 52s), standbys: trial153.ivmqog 2026-02-17T20:57:57.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:57 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/3755131488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d713875a-a825-474b-9ea5-cf8935174190"}]: dispatch 2026-02-17T20:57:57.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:57 trial104 ceph-mon[20612]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d713875a-a825-474b-9ea5-cf8935174190"}]: dispatch 2026-02-17T20:57:57.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:57 trial104 ceph-mon[20612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d713875a-a825-474b-9ea5-cf8935174190"}]': finished 2026-02-17T20:57:57.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:57 trial104 ceph-mon[20612]: osdmap e22: 5 total, 3 up, 5 in 2026-02-17T20:57:57.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:57 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:57.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:57 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:57:57.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:57 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/2097619912' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T20:57:58.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:57 trial153 ceph-mon[25357]: mgrmap e19: trial104.irrhmt(active, since 52s), standbys: trial153.ivmqog 2026-02-17T20:57:58.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:57 trial153 ceph-mon[25357]: from='client.? 10.20.193.153:0/3755131488' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d713875a-a825-474b-9ea5-cf8935174190"}]: dispatch 2026-02-17T20:57:58.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:57 trial153 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d713875a-a825-474b-9ea5-cf8935174190"}]: dispatch 2026-02-17T20:57:58.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:57 trial153 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d713875a-a825-474b-9ea5-cf8935174190"}]': finished 2026-02-17T20:57:58.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:57 trial153 ceph-mon[25357]: osdmap e22: 5 total, 3 up, 5 in 2026-02-17T20:57:58.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:57 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:58.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:57 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:57:58.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:57 trial153 ceph-mon[25357]: from='client.? 10.20.193.153:0/2097619912' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T20:57:58.403 INFO:journalctl@ceph.osd.3.trial104.stdout:Feb 17 20:57:58 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-3[57388]: 2026-02-17T20:57:58.111+0000 7f71c396a740 -1 osd.3 0 log_to_monitors true 2026-02-17T20:57:58.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:58 trial104 ceph-mon[20612]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T20:57:58.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:58 trial104 ceph-mon[20612]: from='osd.3 [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-17T20:57:59.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:58 trial153 ceph-mon[25357]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T20:57:59.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:58 trial153 ceph-mon[25357]: from='osd.3 [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2026-02-17T20:57:59.880 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:59 trial153 ceph-mon[25357]: from='osd.3 [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-17T20:57:59.881 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:59 trial153 ceph-mon[25357]: osdmap e23: 5 total, 3 up, 5 in 2026-02-17T20:57:59.881 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:59 trial153 ceph-mon[25357]: from='osd.3 [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial104", "root=default"]}]: dispatch 2026-02-17T20:57:59.881 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:59 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:59.881 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:57:59 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:57:59.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:59 trial104 ceph-mon[20612]: from='osd.3 [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-17T20:57:59.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:59 trial104 ceph-mon[20612]: osdmap e23: 5 total, 3 up, 5 in 2026-02-17T20:57:59.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:59 trial104 ceph-mon[20612]: from='osd.3 [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial104", "root=default"]}]: dispatch 2026-02-17T20:57:59.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:59 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:57:59.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:57:59 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:57:59.904 INFO:journalctl@ceph.osd.3.trial104.stdout:Feb 17 20:57:59 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-3[57388]: 2026-02-17T20:57:59.794+0000 7f71bf8eb640 -1 osd.3 0 waiting for initial osdmap 2026-02-17T20:57:59.904 INFO:journalctl@ceph.osd.3.trial104.stdout:Feb 17 20:57:59 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-3[57388]: 2026-02-17T20:57:59.795+0000 7f71b770d640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T20:58:00.709 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:00 trial153 ceph-mon[25357]: from='osd.3 [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial104", "root=default"]}]': finished 2026-02-17T20:58:00.710 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:00 trial153 ceph-mon[25357]: osdmap e24: 5 total, 3 up, 5 in 2026-02-17T20:58:00.710 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:00 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:58:00.710 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:00 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:58:00.710 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:00 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:58:00.710 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:00 trial153 ceph-mon[25357]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T20:58:00.710 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:00 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-02-17T20:58:00.710 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:00 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:00.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:00 trial104 ceph-mon[20612]: from='osd.3 [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial104", "root=default"]}]': finished 2026-02-17T20:58:00.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:00 trial104 ceph-mon[20612]: osdmap e24: 5 total, 3 up, 5 in 2026-02-17T20:58:00.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:00 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:58:00.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:00 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:58:00.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:00 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:58:00.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:00 trial104 ceph-mon[20612]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-17T20:58:00.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:00 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2026-02-17T20:58:00.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:00 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:01.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:01 trial104 ceph-mon[20612]: purged_snaps scrub starts 2026-02-17T20:58:01.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:01 trial104 ceph-mon[20612]: purged_snaps scrub ok 2026-02-17T20:58:01.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:01 trial104 ceph-mon[20612]: OSD bench result of 129443.426060 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.3. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T20:58:01.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:01 trial104 ceph-mon[20612]: Deploying daemon osd.4 on trial153 2026-02-17T20:58:01.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:01 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:58:01.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:01 trial104 ceph-mon[20612]: osd.3 [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135] boot 2026-02-17T20:58:01.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:01 trial104 ceph-mon[20612]: osdmap e25: 5 total, 4 up, 5 in 2026-02-17T20:58:01.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:01 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:58:01.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:01 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:58:02.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:01 trial153 ceph-mon[25357]: purged_snaps scrub starts 2026-02-17T20:58:02.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:01 trial153 ceph-mon[25357]: purged_snaps scrub ok 2026-02-17T20:58:02.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:01 trial153 ceph-mon[25357]: OSD bench result of 129443.426060 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.3. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T20:58:02.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:01 trial153 ceph-mon[25357]: Deploying daemon osd.4 on trial153 2026-02-17T20:58:02.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:01 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:58:02.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:01 trial153 ceph-mon[25357]: osd.3 [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135] boot 2026-02-17T20:58:02.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:01 trial153 ceph-mon[25357]: osdmap e25: 5 total, 4 up, 5 in 2026-02-17T20:58:02.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:01 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2026-02-17T20:58:02.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:01 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:58:02.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:02 trial153 ceph-mon[25357]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-17T20:58:02.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:02 trial104 ceph-mon[20612]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-17T20:58:03.608 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:03.603+0000 7f64c1ffb640 1 -- 10.20.193.153:0/1383256853 <== mgr.14203 v2:10.20.193.104:6800/2484917436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f64cc0630c0 con 0x7f64a8077510 2026-02-17T20:58:03.609 INFO:teuthology.orchestra.run.trial153.stdout:Created osd(s) 4 on host 'trial153' 2026-02-17T20:58:03.610 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:03.606+0000 7f64d2f4a640 1 -- 10.20.193.153:0/1383256853 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f64a8077510 msgr2=0x7f64a80799d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:03.611 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:03.606+0000 7f64d2f4a640 1 --2- 10.20.193.153:0/1383256853 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f64a8077510 0x7f64a80799d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f64cc19d860 tx=0x7f64b4005f50 comp rx=0 tx=0).stop 2026-02-17T20:58:03.611 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:03.606+0000 7f64d2f4a640 1 -- 10.20.193.153:0/1383256853 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f64cc103190 msgr2=0x7f64cc19c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:03.611 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:03.606+0000 7f64d2f4a640 1 --2- 10.20.193.153:0/1383256853 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f64cc103190 0x7f64cc19c3b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f64bc002410 tx=0x7f64bc02fe10 comp rx=0 tx=0).stop 2026-02-17T20:58:03.611 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:03.606+0000 7f64d2f4a640 1 -- 10.20.193.153:0/1383256853 shutdown_connections 2026-02-17T20:58:03.611 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:03.606+0000 7f64d2f4a640 1 --2- 10.20.193.153:0/1383256853 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f64a8077510 0x7f64a80799d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:03.611 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:03.606+0000 7f64d2f4a640 1 --2- 10.20.193.153:0/1383256853 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64cc105ac0 0x7f64cc19c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:03.611 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:03.606+0000 7f64d2f4a640 1 --2- 10.20.193.153:0/1383256853 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f64cc103190 0x7f64cc19c3b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:03.611 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:03.606+0000 7f64d2f4a640 1 -- 10.20.193.153:0/1383256853 >> 10.20.193.153:0/1383256853 conn(0x7f64cc0fcd30 msgr2=0x7f64cc101760 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:03.611 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:03.606+0000 7f64d2f4a640 1 -- 10.20.193.153:0/1383256853 shutdown_connections 2026-02-17T20:58:03.611 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:03.606+0000 7f64d2f4a640 1 -- 10.20.193.153:0/1383256853 wait complete. 2026-02-17T20:58:03.648 DEBUG:teuthology.orchestra.run.trial153:osd.4> sudo journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.4.service 2026-02-17T20:58:03.651 INFO:tasks.cephadm:Deploying osd.5 on trial153 with /dev/vg_nvme/lv_3... 2026-02-17T20:58:03.651 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-17T20:58:03.820 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:03.820 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:03.820 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:03.821 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:03.821 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:03.821 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:03.821 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:03.821 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:03.821 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:03.821 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:03.821 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:03.855 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial153/config 2026-02-17T20:58:03.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:03.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:03.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:03.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:03.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:03.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:03.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:03.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:03.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:03.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:03.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:04.581 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 20:58:04 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-4[31240]: 2026-02-17T20:58:04.517+0000 7f8040210740 -1 Falling back to public interface 2026-02-17T20:58:04.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:04 trial104 ceph-mon[20612]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-17T20:58:04.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:58:04.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:04.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:04.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:04.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:04.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:04.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:04.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:04.928 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:04 trial153 ceph-mon[25357]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-17T20:58:04.928 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:58:04.928 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:04.928 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:04.928 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:04.928 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:04.928 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:04.928 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:04.928 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:04.979 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:58:04.995 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph orch daemon add osd trial153:vg_nvme/lv_3 2026-02-17T20:58:05.145 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial153/config 2026-02-17T20:58:05.249 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.245+0000 7f9bb5547640 1 -- 10.20.193.153:0/1657160213 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9bb0104920 msgr2=0x7f9bb0104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:05.249 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.245+0000 7f9bb5547640 1 --2- 10.20.193.153:0/1657160213 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9bb0104920 0x7f9bb0104d20 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40099b0 tx=0x7f9ba402f220 comp rx=0 tx=0).stop 2026-02-17T20:58:05.249 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.245+0000 7f9bb5547640 1 -- 10.20.193.153:0/1657160213 shutdown_connections 2026-02-17T20:58:05.249 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.245+0000 7f9bb5547640 1 --2- 10.20.193.153:0/1657160213 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9bb0105b20 0x7f9bb0105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:05.249 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.245+0000 7f9bb5547640 1 --2- 10.20.193.153:0/1657160213 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9bb0104920 0x7f9bb0104d20 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:05.249 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.245+0000 7f9bb5547640 1 -- 10.20.193.153:0/1657160213 >> 10.20.193.153:0/1657160213 conn(0x7f9bb01000b0 msgr2=0x7f9bb01024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:05.249 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.245+0000 7f9bb5547640 1 -- 10.20.193.153:0/1657160213 shutdown_connections 2026-02-17T20:58:05.249 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.245+0000 7f9bb5547640 1 -- 10.20.193.153:0/1657160213 wait complete. 2026-02-17T20:58:05.249 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.245+0000 7f9bb5547640 1 Processor -- start 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.245+0000 7f9bb5547640 1 -- start start 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9bb5547640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9bb0104920 0x7f9bb019c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9bb5547640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9bb0105b20 0x7f9bb019c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9bb5547640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb010d4d0 con 0x7f9bb0105b20 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9bb5547640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb010d350 con 0x7f9bb0104920 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9baeffd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9bb0104920 0x7f9bb019c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9baeffd640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9bb0104920 0x7f9bb019c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.153:49052/0 (socket says 10.20.193.153:49052) 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9baeffd640 1 -- 10.20.193.153:0/2397883837 learned_addr learned my addr 10.20.193.153:0/2397883837 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9baeffd640 1 -- 10.20.193.153:0/2397883837 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9bb0105b20 msgr2=0x7f9bb019c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9bae7fc640 1 --2- 10.20.193.153:0/2397883837 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9bb0105b20 0x7f9bb019c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9baeffd640 1 --2- 10.20.193.153:0/2397883837 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9bb0105b20 0x7f9bb019c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9baeffd640 1 -- 10.20.193.153:0/2397883837 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb019cf00 con 0x7f9bb0104920 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9bae7fc640 1 --2- 10.20.193.153:0/2397883837 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9bb0105b20 0x7f9bb019c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9baeffd640 1 --2- 10.20.193.153:0/2397883837 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9bb0104920 0x7f9bb019c340 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4002410 tx=0x7f9ba4002910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9b8ffff640 1 -- 10.20.193.153:0/2397883837 <== mon.1 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9ba4004420 con 0x7f9bb0104920 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9b8ffff640 1 -- 10.20.193.153:0/2397883837 <== mon.1 v2:10.20.193.153:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f9ba4038a40 con 0x7f9bb0104920 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9bb5547640 1 -- 10.20.193.153:0/2397883837 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb01a18e0 con 0x7f9bb0104920 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9b8ffff640 1 -- 10.20.193.153:0/2397883837 <== mon.1 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9ba40417c0 con 0x7f9bb0104920 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9bb5547640 1 -- 10.20.193.153:0/2397883837 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bb01a1ef0 con 0x7f9bb0104920 2026-02-17T20:58:05.250 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.246+0000 7f9bb5547640 1 -- 10.20.193.153:0/2397883837 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bb0104d20 con 0x7f9bb0104920 2026-02-17T20:58:05.251 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.247+0000 7f9b8ffff640 1 -- 10.20.193.153:0/2397883837 <== mon.1 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f9ba4038bf0 con 0x7f9bb0104920 2026-02-17T20:58:05.251 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.247+0000 7f9b8ffff640 1 --2- 10.20.193.153:0/2397883837 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9b840775a0 0x7f9b84079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:05.251 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.247+0000 7f9b8ffff640 1 -- 10.20.193.153:0/2397883837 <== mon.1 v2:10.20.193.153:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3777+0+0 (secure 0 0 0) 0x7f9ba403e070 con 0x7f9bb0104920 2026-02-17T20:58:05.251 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.248+0000 7f9bae7fc640 1 --2- 10.20.193.153:0/2397883837 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9b840775a0 0x7f9b84079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:05.252 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.248+0000 7f9bae7fc640 1 --2- 10.20.193.153:0/2397883837 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9b840775a0 0x7f9b84079a60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9bb019d7f0 tx=0x7f9b98009290 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:05.253 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.250+0000 7f9b8ffff640 1 -- 10.20.193.153:0/2397883837 <== mon.1 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9ba40ee9f0 con 0x7f9bb0104920 2026-02-17T20:58:05.341 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:05.337+0000 7f9bb5547640 1 -- 10.20.193.153:0/2397883837 --> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f9bb00630c0 con 0x7f9b840775a0 2026-02-17T20:58:05.868 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:05 trial153 ceph-mon[25357]: Detected new or changed devices on trial153 2026-02-17T20:58:05.868 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:05 trial153 ceph-mon[25357]: Adjusting osd_memory_target on trial153 to 81871M 2026-02-17T20:58:05.868 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:05 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T20:58:05.868 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:05 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T20:58:05.869 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:05 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:05.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:05 trial104 ceph-mon[20612]: Detected new or changed devices on trial153 2026-02-17T20:58:05.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:05 trial104 ceph-mon[20612]: Adjusting osd_memory_target on trial153 to 81871M 2026-02-17T20:58:05.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T20:58:05.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T20:58:05.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:05 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:06.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:06 trial104 ceph-mon[20612]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:06.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:06 trial104 ceph-mon[20612]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-17T20:58:06.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:06 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/1526481910' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65f4195f-0129-41e5-931f-4b0a53ee6868"}]: dispatch 2026-02-17T20:58:06.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:06 trial104 ceph-mon[20612]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65f4195f-0129-41e5-931f-4b0a53ee6868"}]: dispatch 2026-02-17T20:58:06.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:06 trial104 ceph-mon[20612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65f4195f-0129-41e5-931f-4b0a53ee6868"}]': finished 2026-02-17T20:58:06.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:06 trial104 ceph-mon[20612]: osdmap e26: 6 total, 4 up, 6 in 2026-02-17T20:58:06.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:06 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:58:06.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:06 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:06.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:06 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/1296023669' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T20:58:07.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:06 trial153 ceph-mon[25357]: from='client.24161 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial153:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:07.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:06 trial153 ceph-mon[25357]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-17T20:58:07.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:06 trial153 ceph-mon[25357]: from='client.? 10.20.193.153:0/1526481910' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65f4195f-0129-41e5-931f-4b0a53ee6868"}]: dispatch 2026-02-17T20:58:07.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:06 trial153 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65f4195f-0129-41e5-931f-4b0a53ee6868"}]: dispatch 2026-02-17T20:58:07.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:06 trial153 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65f4195f-0129-41e5-931f-4b0a53ee6868"}]': finished 2026-02-17T20:58:07.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:06 trial153 ceph-mon[25357]: osdmap e26: 6 total, 4 up, 6 in 2026-02-17T20:58:07.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:06 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:58:07.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:06 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:07.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:06 trial153 ceph-mon[25357]: from='client.? 10.20.193.153:0/1296023669' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T20:58:07.627 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 20:58:07 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-4[31240]: 2026-02-17T20:58:07.301+0000 7f8040210740 -1 osd.4 0 log_to_monitors true 2026-02-17T20:58:07.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:07 trial104 ceph-mon[20612]: from='osd.4 [v2:10.20.193.153:6800/250110565,v1:10.20.193.153:6801/250110565]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-17T20:58:07.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:07 trial104 ceph-mon[20612]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-17T20:58:08.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:07 trial153 ceph-mon[25357]: from='osd.4 [v2:10.20.193.153:6800/250110565,v1:10.20.193.153:6801/250110565]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-17T20:58:08.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:07 trial153 ceph-mon[25357]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2026-02-17T20:58:08.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:08 trial104 ceph-mon[20612]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-17T20:58:08.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:08 trial104 ceph-mon[20612]: from='osd.4 [v2:10.20.193.153:6800/250110565,v1:10.20.193.153:6801/250110565]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial153", "root=default"]}]: dispatch 2026-02-17T20:58:08.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:08 trial104 ceph-mon[20612]: osdmap e27: 6 total, 4 up, 6 in 2026-02-17T20:58:08.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:08 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:58:08.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:08 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:08.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:08 trial104 ceph-mon[20612]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial153", "root=default"]}]: dispatch 2026-02-17T20:58:08.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:08 trial104 ceph-mon[20612]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-17T20:58:09.025 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 20:58:08 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-4[31240]: 2026-02-17T20:58:08.632+0000 7f803c191640 -1 osd.4 0 waiting for initial osdmap 2026-02-17T20:58:09.025 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 20:58:08 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-4[31240]: 2026-02-17T20:58:08.634+0000 7f8037fbb640 -1 osd.4 28 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T20:58:09.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:08 trial153 ceph-mon[25357]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-17T20:58:09.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:08 trial153 ceph-mon[25357]: from='osd.4 [v2:10.20.193.153:6800/250110565,v1:10.20.193.153:6801/250110565]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial153", "root=default"]}]: dispatch 2026-02-17T20:58:09.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:08 trial153 ceph-mon[25357]: osdmap e27: 6 total, 4 up, 6 in 2026-02-17T20:58:09.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:08 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:58:09.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:08 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:09.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:08 trial153 ceph-mon[25357]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial153", "root=default"]}]: dispatch 2026-02-17T20:58:09.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:08 trial153 ceph-mon[25357]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-17T20:58:09.851 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:09 trial153 ceph-mon[25357]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial153", "root=default"]}]': finished 2026-02-17T20:58:09.851 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:09 trial153 ceph-mon[25357]: osdmap e28: 6 total, 4 up, 6 in 2026-02-17T20:58:09.852 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:09 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:58:09.852 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:09 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:09.852 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:09 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:58:09.852 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:09 trial153 ceph-mon[25357]: osd.4 [v2:10.20.193.153:6800/250110565,v1:10.20.193.153:6801/250110565] boot 2026-02-17T20:58:09.852 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:09 trial153 ceph-mon[25357]: osdmap e29: 6 total, 5 up, 6 in 2026-02-17T20:58:09.852 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:09 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:58:09.852 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:09 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:09.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:09 trial104 ceph-mon[20612]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial153", "root=default"]}]': finished 2026-02-17T20:58:09.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:09 trial104 ceph-mon[20612]: osdmap e28: 6 total, 4 up, 6 in 2026-02-17T20:58:09.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:09 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:58:09.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:09 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:09.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:09 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:58:09.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:09 trial104 ceph-mon[20612]: osd.4 [v2:10.20.193.153:6800/250110565,v1:10.20.193.153:6801/250110565] boot 2026-02-17T20:58:09.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:09 trial104 ceph-mon[20612]: osdmap e29: 6 total, 5 up, 6 in 2026-02-17T20:58:09.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:09 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2026-02-17T20:58:09.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:09 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:10.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:10 trial153 ceph-mon[25357]: purged_snaps scrub starts 2026-02-17T20:58:10.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:10 trial153 ceph-mon[25357]: purged_snaps scrub ok 2026-02-17T20:58:10.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:10 trial153 ceph-mon[25357]: pgmap v50: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-17T20:58:10.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:10 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-02-17T20:58:10.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:10 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:10.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:10 trial153 ceph-mon[25357]: Deploying daemon osd.5 on trial153 2026-02-17T20:58:10.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:10 trial153 ceph-mon[25357]: osdmap e30: 6 total, 5 up, 6 in 2026-02-17T20:58:10.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:10 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:10.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:10 trial104 ceph-mon[20612]: purged_snaps scrub starts 2026-02-17T20:58:10.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:10 trial104 ceph-mon[20612]: purged_snaps scrub ok 2026-02-17T20:58:10.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:10 trial104 ceph-mon[20612]: pgmap v50: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-17T20:58:10.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:10 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2026-02-17T20:58:10.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:10 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:10.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:10 trial104 ceph-mon[20612]: Deploying daemon osd.5 on trial153 2026-02-17T20:58:10.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:10 trial104 ceph-mon[20612]: osdmap e30: 6 total, 5 up, 6 in 2026-02-17T20:58:10.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:10 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:12.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:12 trial153 ceph-mon[25357]: osdmap e31: 6 total, 5 up, 6 in 2026-02-17T20:58:12.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:12 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:12.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:12 trial153 ceph-mon[25357]: pgmap v53: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-17T20:58:12.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:12 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:12.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:12 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:12.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:12 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:12.653 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:12 trial104 ceph-mon[20612]: osdmap e31: 6 total, 5 up, 6 in 2026-02-17T20:58:12.653 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:12 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:12.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:12 trial104 ceph-mon[20612]: pgmap v53: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-17T20:58:12.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:12 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:12.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:12 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:12.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:12 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:12.829 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:12.825+0000 7f9b8ffff640 1 -- 10.20.193.153:0/2397883837 <== mgr.14203 v2:10.20.193.104:6800/2484917436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f9bb00630c0 con 0x7f9b840775a0 2026-02-17T20:58:12.829 INFO:teuthology.orchestra.run.trial153.stdout:Created osd(s) 5 on host 'trial153' 2026-02-17T20:58:12.832 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:12.827+0000 7f9bb5547640 1 -- 10.20.193.153:0/2397883837 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9b840775a0 msgr2=0x7f9b84079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:12.832 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:12.827+0000 7f9bb5547640 1 --2- 10.20.193.153:0/2397883837 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9b840775a0 0x7f9b84079a60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9bb019d7f0 tx=0x7f9b98009290 comp rx=0 tx=0).stop 2026-02-17T20:58:12.832 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:12.827+0000 7f9bb5547640 1 -- 10.20.193.153:0/2397883837 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9bb0104920 msgr2=0x7f9bb019c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:12.832 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:12.827+0000 7f9bb5547640 1 --2- 10.20.193.153:0/2397883837 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9bb0104920 0x7f9bb019c340 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4002410 tx=0x7f9ba4002910 comp rx=0 tx=0).stop 2026-02-17T20:58:12.832 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:12.827+0000 7f9bb5547640 1 -- 10.20.193.153:0/2397883837 shutdown_connections 2026-02-17T20:58:12.832 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:12.827+0000 7f9bb5547640 1 --2- 10.20.193.153:0/2397883837 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9b840775a0 0x7f9b84079a60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:12.832 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:12.827+0000 7f9bb5547640 1 --2- 10.20.193.153:0/2397883837 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9bb0105b20 0x7f9bb019c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:12.833 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:12.827+0000 7f9bb5547640 1 --2- 10.20.193.153:0/2397883837 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9bb0104920 0x7f9bb019c340 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:12.833 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:12.827+0000 7f9bb5547640 1 -- 10.20.193.153:0/2397883837 >> 10.20.193.153:0/2397883837 conn(0x7f9bb01000b0 msgr2=0x7f9bb0109260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:12.833 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:12.827+0000 7f9bb5547640 1 -- 10.20.193.153:0/2397883837 shutdown_connections 2026-02-17T20:58:12.833 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:12.827+0000 7f9bb5547640 1 -- 10.20.193.153:0/2397883837 wait complete. 2026-02-17T20:58:12.867 DEBUG:teuthology.orchestra.run.trial153:osd.5> sudo journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.5.service 2026-02-17T20:58:12.869 INFO:tasks.cephadm:Deploying osd.6 on trial153 with /dev/vg_nvme/lv_2... 2026-02-17T20:58:12.869 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-17T20:58:13.066 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial153/config 2026-02-17T20:58:13.685 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:13 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:13.685 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:13 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:13.685 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:13 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:13.685 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:13 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:13.686 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:13 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:13.686 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:13 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:13.686 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:13 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:13.686 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:13 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:13.686 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 20:58:13 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5[36590]: 2026-02-17T20:58:13.521+0000 7f1a56c43740 -1 Falling back to public interface 2026-02-17T20:58:13.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:13 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:13.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:13 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:13.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:13 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:13.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:13 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:13.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:13 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:13.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:13 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:13.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:13 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:13.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:13 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:14.198 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:58:14.215 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph orch daemon add osd trial153:vg_nvme/lv_2 2026-02-17T20:58:14.365 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial153/config 2026-02-17T20:58:14.482 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1d58be640 1 -- 10.20.193.153:0/330030566 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1d01026b0 msgr2=0x7fc1d0102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:14.482 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1d58be640 1 --2- 10.20.193.153:0/330030566 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1d01026b0 0x7fc1d0102ab0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40099b0 tx=0x7fc1c402f220 comp rx=0 tx=0).stop 2026-02-17T20:58:14.482 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1d58be640 1 -- 10.20.193.153:0/330030566 shutdown_connections 2026-02-17T20:58:14.482 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1d58be640 1 --2- 10.20.193.153:0/330030566 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc1d01038b0 0x7fc1d0103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:14.483 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1d58be640 1 --2- 10.20.193.153:0/330030566 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1d01026b0 0x7fc1d0102ab0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:14.483 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1d58be640 1 -- 10.20.193.153:0/330030566 >> 10.20.193.153:0/330030566 conn(0x7fc1d00fde60 msgr2=0x7fc1d0100280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:14.483 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1d58be640 1 -- 10.20.193.153:0/330030566 shutdown_connections 2026-02-17T20:58:14.483 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1d58be640 1 -- 10.20.193.153:0/330030566 wait complete. 2026-02-17T20:58:14.483 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1d58be640 1 Processor -- start 2026-02-17T20:58:14.484 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1d58be640 1 -- start start 2026-02-17T20:58:14.484 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1d58be640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc1d01026b0 0x7fc1d019a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:14.484 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1d58be640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1d01038b0 0x7fc1d019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:14.484 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1d58be640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d010b260 con 0x7fc1d01026b0 2026-02-17T20:58:14.484 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1d58be640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d010b0e0 con 0x7fc1d01038b0 2026-02-17T20:58:14.484 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1ce7fc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1d01038b0 0x7fc1d019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:14.485 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1ce7fc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1d01038b0 0x7fc1d019a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.153:47576/0 (socket says 10.20.193.153:47576) 2026-02-17T20:58:14.485 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1ce7fc640 1 -- 10.20.193.153:0/1812175786 learned_addr learned my addr 10.20.193.153:0/1812175786 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:58:14.485 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.474+0000 7fc1ceffd640 1 --2- 10.20.193.153:0/1812175786 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc1d01026b0 0x7fc1d019a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:14.485 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.475+0000 7fc1ce7fc640 1 -- 10.20.193.153:0/1812175786 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc1d01026b0 msgr2=0x7fc1d019a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:14.485 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.475+0000 7fc1ce7fc640 1 --2- 10.20.193.153:0/1812175786 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc1d01026b0 0x7fc1d019a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:14.485 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.475+0000 7fc1ce7fc640 1 -- 10.20.193.153:0/1812175786 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d019acd0 con 0x7fc1d01038b0 2026-02-17T20:58:14.486 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.475+0000 7fc1ce7fc640 1 --2- 10.20.193.153:0/1812175786 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1d01038b0 0x7fc1d019a650 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800d900 tx=0x7fc1b800ddd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:14.486 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.475+0000 7fc1d48bc640 1 -- 10.20.193.153:0/1812175786 <== mon.1 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc1b8014070 con 0x7fc1d01038b0 2026-02-17T20:58:14.486 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.475+0000 7fc1d48bc640 1 -- 10.20.193.153:0/1812175786 <== mon.1 v2:10.20.193.153:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fc1b80044a0 con 0x7fc1d01038b0 2026-02-17T20:58:14.486 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.475+0000 7fc1d58be640 1 -- 10.20.193.153:0/1812175786 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d019f710 con 0x7fc1d01038b0 2026-02-17T20:58:14.486 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.475+0000 7fc1d48bc640 1 -- 10.20.193.153:0/1812175786 <== mon.1 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc1b8005020 con 0x7fc1d01038b0 2026-02-17T20:58:14.486 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.475+0000 7fc1d58be640 1 -- 10.20.193.153:0/1812175786 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d019fd20 con 0x7fc1d01038b0 2026-02-17T20:58:14.486 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.475+0000 7fc1d58be640 1 -- 10.20.193.153:0/1812175786 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1d0102ab0 con 0x7fc1d01038b0 2026-02-17T20:58:14.486 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.476+0000 7fc1d48bc640 1 -- 10.20.193.153:0/1812175786 <== mon.1 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7fc1b80047c0 con 0x7fc1d01038b0 2026-02-17T20:58:14.486 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.476+0000 7fc1d48bc640 1 --2- 10.20.193.153:0/1812175786 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc1a40775a0 0x7fc1a4079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:14.487 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.477+0000 7fc1d48bc640 1 -- 10.20.193.153:0/1812175786 <== mon.1 v2:10.20.193.153:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4317+0+0 (secure 0 0 0) 0x7fc1b8099600 con 0x7fc1d01038b0 2026-02-17T20:58:14.487 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.477+0000 7fc1ceffd640 1 --2- 10.20.193.153:0/1812175786 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc1a40775a0 0x7fc1a4079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:14.487 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.477+0000 7fc1ceffd640 1 --2- 10.20.193.153:0/1812175786 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc1a40775a0 0x7fc1a4079a60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40097c0 tx=0x7fc1c403a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:14.487 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.479+0000 7fc1d48bc640 1 -- 10.20.193.153:0/1812175786 <== mon.1 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc1b8066c70 con 0x7fc1d01038b0 2026-02-17T20:58:14.569 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:14.564+0000 7fc1d58be640 1 -- 10.20.193.153:0/1812175786 --> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc1d01a0090 con 0x7fc1a40775a0 2026-02-17T20:58:14.752 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:14 trial153 ceph-mon[25357]: Detected new or changed devices on trial153 2026-02-17T20:58:14.752 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:14 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:14.752 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:14 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:14.752 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:14 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:14.752 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:14 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:14.753 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:14 trial153 ceph-mon[25357]: Adjusting osd_memory_target on trial153 to 40935M 2026-02-17T20:58:14.753 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:14 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:14.753 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:14 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:14.753 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:14 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:14.753 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:14 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:14.753 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:14 trial153 ceph-mon[25357]: pgmap v54: 1 pgs: 1 remapped+peering; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-17T20:58:14.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:14 trial104 ceph-mon[20612]: Detected new or changed devices on trial153 2026-02-17T20:58:14.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:14 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:14.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:14 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:14.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:14 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:14.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:14 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:14.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:14 trial104 ceph-mon[20612]: Adjusting osd_memory_target on trial153 to 40935M 2026-02-17T20:58:14.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:14 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:14.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:14 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:14.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:14 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:14.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:14 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:14.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:14 trial104 ceph-mon[20612]: pgmap v54: 1 pgs: 1 remapped+peering; 577 KiB data, 134 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-17T20:58:15.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:15 trial153 ceph-mon[25357]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:15.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:15 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T20:58:15.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:15 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T20:58:15.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:15 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:15.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:15 trial153 ceph-mon[25357]: from='client.? 10.20.193.153:0/2275353689' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "070da905-eb86-4405-a53f-fc3414a1ca70"}]: dispatch 2026-02-17T20:58:15.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:15 trial153 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "070da905-eb86-4405-a53f-fc3414a1ca70"}]: dispatch 2026-02-17T20:58:15.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:15 trial153 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "070da905-eb86-4405-a53f-fc3414a1ca70"}]': finished 2026-02-17T20:58:15.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:15 trial153 ceph-mon[25357]: osdmap e32: 7 total, 5 up, 7 in 2026-02-17T20:58:15.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:15 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:15.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:15 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:15.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:15 trial153 ceph-mon[25357]: from='client.? 10.20.193.153:0/3678423824' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T20:58:15.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:15 trial104 ceph-mon[20612]: from='client.24179 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial153:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:15.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:15 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T20:58:15.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:15 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T20:58:15.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:15 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:15.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:15 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/2275353689' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "070da905-eb86-4405-a53f-fc3414a1ca70"}]: dispatch 2026-02-17T20:58:15.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:15 trial104 ceph-mon[20612]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "070da905-eb86-4405-a53f-fc3414a1ca70"}]: dispatch 2026-02-17T20:58:15.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:15 trial104 ceph-mon[20612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "070da905-eb86-4405-a53f-fc3414a1ca70"}]': finished 2026-02-17T20:58:15.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:15 trial104 ceph-mon[20612]: osdmap e32: 7 total, 5 up, 7 in 2026-02-17T20:58:15.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:15 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:15.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:15 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:15.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:15 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/3678423824' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T20:58:16.826 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:16 trial104 ceph-mon[20612]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-17T20:58:16.850 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:16 trial153 ceph-mon[25357]: pgmap v56: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-17T20:58:16.850 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 20:58:16 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5[36590]: 2026-02-17T20:58:16.554+0000 7f1a56c43740 -1 osd.5 0 log_to_monitors true 2026-02-17T20:58:17.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:17 trial104 ceph-mon[20612]: from='osd.5 [v2:10.20.193.153:6808/2951447967,v1:10.20.193.153:6809/2951447967]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-17T20:58:17.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:17 trial104 ceph-mon[20612]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-17T20:58:17.969 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:17 trial153 ceph-mon[25357]: from='osd.5 [v2:10.20.193.153:6808/2951447967,v1:10.20.193.153:6809/2951447967]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-17T20:58:17.969 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:17 trial153 ceph-mon[25357]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2026-02-17T20:58:18.825 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 20:58:18 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5[36590]: 2026-02-17T20:58:18.720+0000 7f1a52bc4640 -1 osd.5 0 waiting for initial osdmap 2026-02-17T20:58:18.825 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 20:58:18 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5[36590]: 2026-02-17T20:58:18.723+0000 7f1a4a9e6640 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T20:58:18.825 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:18 trial153 ceph-mon[25357]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-17T20:58:18.825 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:18 trial153 ceph-mon[25357]: from='osd.5 [v2:10.20.193.153:6808/2951447967,v1:10.20.193.153:6809/2951447967]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial153", "root=default"]}]: dispatch 2026-02-17T20:58:18.825 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:18 trial153 ceph-mon[25357]: osdmap e33: 7 total, 5 up, 7 in 2026-02-17T20:58:18.825 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:18.825 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:18.825 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:18 trial153 ceph-mon[25357]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial153", "root=default"]}]: dispatch 2026-02-17T20:58:18.825 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:18 trial153 ceph-mon[25357]: pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 90 KiB/s, 0 objects/s recovering 2026-02-17T20:58:18.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:18 trial104 ceph-mon[20612]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-17T20:58:18.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:18 trial104 ceph-mon[20612]: from='osd.5 [v2:10.20.193.153:6808/2951447967,v1:10.20.193.153:6809/2951447967]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial153", "root=default"]}]: dispatch 2026-02-17T20:58:18.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:18 trial104 ceph-mon[20612]: osdmap e33: 7 total, 5 up, 7 in 2026-02-17T20:58:18.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:18.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:18.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:18 trial104 ceph-mon[20612]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial153", "root=default"]}]: dispatch 2026-02-17T20:58:18.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:18 trial104 ceph-mon[20612]: pgmap v58: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 3.4 TiB / 3.4 TiB avail; 90 KiB/s, 0 objects/s recovering 2026-02-17T20:58:19.639 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:19 trial153 ceph-mon[25357]: purged_snaps scrub starts 2026-02-17T20:58:19.640 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:19 trial153 ceph-mon[25357]: purged_snaps scrub ok 2026-02-17T20:58:19.640 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:19 trial153 ceph-mon[25357]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial153", "root=default"]}]': finished 2026-02-17T20:58:19.640 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:19 trial153 ceph-mon[25357]: osdmap e34: 7 total, 5 up, 7 in 2026-02-17T20:58:19.640 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:19.640 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:19.640 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:19.640 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:58:19.640 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:19 trial153 ceph-mon[25357]: OSD bench result of 101315.374125 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.5. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T20:58:19.640 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2026-02-17T20:58:19.641 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:19.641 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:19 trial153 ceph-mon[25357]: Deploying daemon osd.6 on trial153 2026-02-17T20:58:19.641 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:19 trial153 ceph-mon[25357]: osd.5 [v2:10.20.193.153:6808/2951447967,v1:10.20.193.153:6809/2951447967] boot 2026-02-17T20:58:19.641 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:19 trial153 ceph-mon[25357]: osdmap e35: 7 total, 6 up, 7 in 2026-02-17T20:58:19.641 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:19.641 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:19.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:19 trial104 ceph-mon[20612]: purged_snaps scrub starts 2026-02-17T20:58:19.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:19 trial104 ceph-mon[20612]: purged_snaps scrub ok 2026-02-17T20:58:19.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:19 trial104 ceph-mon[20612]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial153", "root=default"]}]': finished 2026-02-17T20:58:19.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:19 trial104 ceph-mon[20612]: osdmap e34: 7 total, 5 up, 7 in 2026-02-17T20:58:19.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:19.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:19.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:19.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:58:19.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:19 trial104 ceph-mon[20612]: OSD bench result of 101315.374125 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.5. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T20:58:19.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2026-02-17T20:58:19.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:19.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:19 trial104 ceph-mon[20612]: Deploying daemon osd.6 on trial153 2026-02-17T20:58:19.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:19 trial104 ceph-mon[20612]: osd.5 [v2:10.20.193.153:6808/2951447967,v1:10.20.193.153:6809/2951447967] boot 2026-02-17T20:58:19.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:19 trial104 ceph-mon[20612]: osdmap e35: 7 total, 6 up, 7 in 2026-02-17T20:58:19.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2026-02-17T20:58:19.905 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:20.728 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:20 trial153 ceph-mon[25357]: pgmap v61: 1 pgs: 1 remapped; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-17T20:58:20.728 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:20 trial153 ceph-mon[25357]: osdmap e36: 7 total, 6 up, 7 in 2026-02-17T20:58:20.728 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:20 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:20.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:20 trial104 ceph-mon[20612]: pgmap v61: 1 pgs: 1 remapped; 577 KiB data, 161 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-17T20:58:20.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:20 trial104 ceph-mon[20612]: osdmap e36: 7 total, 6 up, 7 in 2026-02-17T20:58:20.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:20 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:21.806 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:21.803+0000 7fc1d48bc640 1 -- 10.20.193.153:0/1812175786 <== mgr.14203 v2:10.20.193.104:6800/2484917436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fc1d01a0090 con 0x7fc1a40775a0 2026-02-17T20:58:21.807 INFO:teuthology.orchestra.run.trial153.stdout:Created osd(s) 6 on host 'trial153' 2026-02-17T20:58:21.809 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:21.805+0000 7fc1d58be640 1 -- 10.20.193.153:0/1812175786 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc1a40775a0 msgr2=0x7fc1a4079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:21.809 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:21.805+0000 7fc1d58be640 1 --2- 10.20.193.153:0/1812175786 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc1a40775a0 0x7fc1a4079a60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc1c40097c0 tx=0x7fc1c403a040 comp rx=0 tx=0).stop 2026-02-17T20:58:21.809 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:21.805+0000 7fc1d58be640 1 -- 10.20.193.153:0/1812175786 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1d01038b0 msgr2=0x7fc1d019a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:21.809 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:21.805+0000 7fc1d58be640 1 --2- 10.20.193.153:0/1812175786 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1d01038b0 0x7fc1d019a650 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800d900 tx=0x7fc1b800ddd0 comp rx=0 tx=0).stop 2026-02-17T20:58:21.809 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:21.805+0000 7fc1d58be640 1 -- 10.20.193.153:0/1812175786 shutdown_connections 2026-02-17T20:58:21.809 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:21.805+0000 7fc1d58be640 1 --2- 10.20.193.153:0/1812175786 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc1a40775a0 0x7fc1a4079a60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:21.809 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:21.805+0000 7fc1d58be640 1 --2- 10.20.193.153:0/1812175786 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc1d01038b0 0x7fc1d019a650 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:21.810 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:21.805+0000 7fc1d58be640 1 --2- 10.20.193.153:0/1812175786 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc1d01026b0 0x7fc1d019a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:21.810 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:21.805+0000 7fc1d58be640 1 -- 10.20.193.153:0/1812175786 >> 10.20.193.153:0/1812175786 conn(0x7fc1d00fde60 msgr2=0x7fc1d0106ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:21.810 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:21.805+0000 7fc1d58be640 1 -- 10.20.193.153:0/1812175786 shutdown_connections 2026-02-17T20:58:21.810 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:21.805+0000 7fc1d58be640 1 -- 10.20.193.153:0/1812175786 wait complete. 2026-02-17T20:58:21.823 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:21 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:21.823 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:21 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:21.824 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:21 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:21.824 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:21 trial153 ceph-mon[25357]: osdmap e37: 7 total, 6 up, 7 in 2026-02-17T20:58:21.824 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:21 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:21.824 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:21 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:21.824 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:21 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:21.824 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:21 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:21.824 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:21 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:21.824 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:21 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:21.845 DEBUG:teuthology.orchestra.run.trial153:osd.6> sudo journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.6.service 2026-02-17T20:58:21.848 INFO:tasks.cephadm:Deploying osd.7 on trial153 with /dev/vg_nvme/lv_1... 2026-02-17T20:58:21.848 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-17T20:58:21.873 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:21 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:21.873 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:21 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:21.873 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:21 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:21.874 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:21 trial104 ceph-mon[20612]: osdmap e37: 7 total, 6 up, 7 in 2026-02-17T20:58:21.874 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:21 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:21.874 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:21 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:21.874 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:21 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:21.874 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:21 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:21.874 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:21 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:21.874 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:21 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:22.055 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial153/config 2026-02-17T20:58:22.525 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 20:58:22 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T20:58:22.304+0000 7fe9b692c740 -1 Falling back to public interface 2026-02-17T20:58:22.847 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:22 trial153 ceph-mon[25357]: pgmap v64: 1 pgs: 1 remapped; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-17T20:58:22.847 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:22 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:22.847 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:22 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:22.847 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:22 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:22.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:22 trial104 ceph-mon[20612]: pgmap v64: 1 pgs: 1 remapped; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-17T20:58:22.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:22 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:22.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:22 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:22.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:22 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:23.238 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T20:58:23.254 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph orch daemon add osd trial153:vg_nvme/lv_1 2026-02-17T20:58:23.406 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial153/config 2026-02-17T20:58:23.517 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.513+0000 7f1a09e22640 1 -- 10.20.193.153:0/1529526440 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1a04104940 msgr2=0x7f1a04104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:23.517 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.513+0000 7f1a09e22640 1 --2- 10.20.193.153:0/1529526440 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1a04104940 0x7f1a04104d40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f19f00099b0 tx=0x7f19f002f220 comp rx=0 tx=0).stop 2026-02-17T20:58:23.517 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.513+0000 7f1a09e22640 1 -- 10.20.193.153:0/1529526440 shutdown_connections 2026-02-17T20:58:23.517 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.513+0000 7f1a09e22640 1 --2- 10.20.193.153:0/1529526440 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1a04105b40 0x7f1a04105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:23.517 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.513+0000 7f1a09e22640 1 --2- 10.20.193.153:0/1529526440 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1a04104940 0x7f1a04104d40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:23.517 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.513+0000 7f1a09e22640 1 -- 10.20.193.153:0/1529526440 >> 10.20.193.153:0/1529526440 conn(0x7f1a041000f0 msgr2=0x7f1a04102510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:23.517 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.513+0000 7f1a09e22640 1 -- 10.20.193.153:0/1529526440 shutdown_connections 2026-02-17T20:58:23.517 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.513+0000 7f1a09e22640 1 -- 10.20.193.153:0/1529526440 wait complete. 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.513+0000 7f1a09e22640 1 Processor -- start 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.513+0000 7f1a09e22640 1 -- start start 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.514+0000 7f1a09e22640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1a04104940 0x7f1a0419c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.514+0000 7f1a09e22640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1a04105b40 0x7f1a0419c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.514+0000 7f1a09e22640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0410d4d0 con 0x7f1a04105b40 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.514+0000 7f1a09e22640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1a0410d350 con 0x7f1a04104940 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.514+0000 7f1a037fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1a04104940 0x7f1a0419c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.514+0000 7f1a037fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1a04104940 0x7f1a0419c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.153:33300/0 (socket says 10.20.193.153:33300) 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.514+0000 7f1a037fe640 1 -- 10.20.193.153:0/3283349341 learned_addr learned my addr 10.20.193.153:0/3283349341 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.514+0000 7f1a037fe640 1 -- 10.20.193.153:0/3283349341 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1a04105b40 msgr2=0x7f1a0419c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.514+0000 7f1a037fe640 1 --2- 10.20.193.153:0/3283349341 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1a04105b40 0x7f1a0419c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.514+0000 7f1a037fe640 1 -- 10.20.193.153:0/3283349341 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0419cf30 con 0x7f1a04104940 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.514+0000 7f1a037fe640 1 --2- 10.20.193.153:0/3283349341 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1a04104940 0x7f1a0419c370 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f19f0004850 tx=0x7f19f0002820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.514+0000 7f1a00ff9640 1 -- 10.20.193.153:0/3283349341 <== mon.1 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f19f00044e0 con 0x7f1a04104940 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.514+0000 7f1a09e22640 1 -- 10.20.193.153:0/3283349341 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a041a1910 con 0x7f1a04104940 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.514+0000 7f1a00ff9640 1 -- 10.20.193.153:0/3283349341 <== mon.1 v2:10.20.193.153:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f19f0038a40 con 0x7f1a04104940 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.514+0000 7f1a00ff9640 1 -- 10.20.193.153:0/3283349341 <== mon.1 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f19f00418e0 con 0x7f1a04104940 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.514+0000 7f1a09e22640 1 -- 10.20.193.153:0/3283349341 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a041a1f20 con 0x7f1a04104940 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.514+0000 7f1a09e22640 1 -- 10.20.193.153:0/3283349341 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a04104d40 con 0x7f1a04104940 2026-02-17T20:58:23.518 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.515+0000 7f1a00ff9640 1 -- 10.20.193.153:0/3283349341 <== mon.1 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f19f00385d0 con 0x7f1a04104940 2026-02-17T20:58:23.519 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.516+0000 7f1a00ff9640 1 --2- 10.20.193.153:0/3283349341 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f19d80775a0 0x7f19d8079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:23.519 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.516+0000 7f1a00ff9640 1 -- 10.20.193.153:0/3283349341 <== mon.1 v2:10.20.193.153:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4749+0+0 (secure 0 0 0) 0x7f19f003e070 con 0x7f1a04104940 2026-02-17T20:58:23.519 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.516+0000 7f1a02ffd640 1 --2- 10.20.193.153:0/3283349341 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f19d80775a0 0x7f19d8079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:23.519 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.516+0000 7f1a02ffd640 1 --2- 10.20.193.153:0/3283349341 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f19d80775a0 0x7f19d8079a60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f19f4005fd0 tx=0x7f19f4005950 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:23.521 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.518+0000 7f1a00ff9640 1 -- 10.20.193.153:0/3283349341 <== mon.1 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f19f008b890 con 0x7f1a04104940 2026-02-17T20:58:23.609 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:23.605+0000 7f1a09e22640 1 -- 10.20.193.153:0/3283349341 --> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f1a040630c0 con 0x7f19d80775a0 2026-02-17T20:58:23.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:23 trial153 ceph-mon[25357]: Detected new or changed devices on trial153 2026-02-17T20:58:23.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:23 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:23.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:23 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:23.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:23 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:23.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:23 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:23.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:23 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:23.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:23 trial153 ceph-mon[25357]: Adjusting osd_memory_target on trial153 to 27290M 2026-02-17T20:58:23.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:23 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:23.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:23 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:23.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:23 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:23.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:23 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:23.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:23 trial104 ceph-mon[20612]: Detected new or changed devices on trial153 2026-02-17T20:58:23.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:23 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:23.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:23 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:23.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:23 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:23.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:23 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:23.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:23 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:23.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:23 trial104 ceph-mon[20612]: Adjusting osd_memory_target on trial153 to 27290M 2026-02-17T20:58:23.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:23 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:23.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:23 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:23.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:23 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:23.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:23 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:24.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:24 trial153 ceph-mon[25357]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:24.775 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:24 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T20:58:24.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:24 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T20:58:24.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:24 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:24.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:24 trial153 ceph-mon[25357]: pgmap v65: 1 pgs: 1 remapped; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-17T20:58:24.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:24 trial153 ceph-mon[25357]: from='client.? 10.20.193.153:0/3768314349' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25d0a88d-9c35-4a39-809f-7adfc0833bef"}]: dispatch 2026-02-17T20:58:24.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:24 trial153 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25d0a88d-9c35-4a39-809f-7adfc0833bef"}]: dispatch 2026-02-17T20:58:24.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:24 trial153 ceph-mon[25357]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25d0a88d-9c35-4a39-809f-7adfc0833bef"}]': finished 2026-02-17T20:58:24.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:24 trial153 ceph-mon[25357]: osdmap e38: 8 total, 6 up, 8 in 2026-02-17T20:58:24.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:24 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:24.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:24 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:24.777 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:24 trial153 ceph-mon[25357]: from='client.? 10.20.193.153:0/949877328' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T20:58:24.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:24 trial104 ceph-mon[20612]: from='client.24197 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial153:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:24.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:24 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2026-02-17T20:58:24.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:24 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2026-02-17T20:58:24.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:24 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:24.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:24 trial104 ceph-mon[20612]: pgmap v65: 1 pgs: 1 remapped; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-17T20:58:24.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:24 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/3768314349' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25d0a88d-9c35-4a39-809f-7adfc0833bef"}]: dispatch 2026-02-17T20:58:24.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:24 trial104 ceph-mon[20612]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25d0a88d-9c35-4a39-809f-7adfc0833bef"}]: dispatch 2026-02-17T20:58:24.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:24 trial104 ceph-mon[20612]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25d0a88d-9c35-4a39-809f-7adfc0833bef"}]': finished 2026-02-17T20:58:24.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:24 trial104 ceph-mon[20612]: osdmap e38: 8 total, 6 up, 8 in 2026-02-17T20:58:24.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:24 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:24.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:24 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:24.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:24 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/949877328' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2026-02-17T20:58:25.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:25 trial104 ceph-mon[20612]: from='osd.6 [v2:10.20.193.153:6816/4066146238,v1:10.20.193.153:6817/4066146238]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-17T20:58:25.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:25 trial104 ceph-mon[20612]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-17T20:58:26.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:25 trial153 ceph-mon[25357]: from='osd.6 [v2:10.20.193.153:6816/4066146238,v1:10.20.193.153:6817/4066146238]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-17T20:58:26.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:25 trial153 ceph-mon[25357]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2026-02-17T20:58:26.026 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 20:58:25 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T20:58:25.593+0000 7fe9b692c740 -1 osd.6 0 log_to_monitors true 2026-02-17T20:58:26.920 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:26 trial104 ceph-mon[20612]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-17T20:58:26.920 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:26 trial104 ceph-mon[20612]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-17T20:58:26.920 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:26 trial104 ceph-mon[20612]: from='osd.6 [v2:10.20.193.153:6816/4066146238,v1:10.20.193.153:6817/4066146238]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial153", "root=default"]}]: dispatch 2026-02-17T20:58:26.920 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:26 trial104 ceph-mon[20612]: osdmap e39: 8 total, 6 up, 8 in 2026-02-17T20:58:26.920 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:26 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:26.921 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:26 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:26.921 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:26 trial104 ceph-mon[20612]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial153", "root=default"]}]: dispatch 2026-02-17T20:58:27.025 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 20:58:26 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T20:58:26.655+0000 7fe9b28ad640 -1 osd.6 0 waiting for initial osdmap 2026-02-17T20:58:27.025 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 20:58:26 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T20:58:26.657+0000 7fe9ae6d7640 -1 osd.6 40 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T20:58:27.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:26 trial153 ceph-mon[25357]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-17T20:58:27.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:26 trial153 ceph-mon[25357]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-17T20:58:27.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:26 trial153 ceph-mon[25357]: from='osd.6 [v2:10.20.193.153:6816/4066146238,v1:10.20.193.153:6817/4066146238]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial153", "root=default"]}]: dispatch 2026-02-17T20:58:27.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:26 trial153 ceph-mon[25357]: osdmap e39: 8 total, 6 up, 8 in 2026-02-17T20:58:27.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:26 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:27.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:26 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:27.026 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:26 trial153 ceph-mon[25357]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial153", "root=default"]}]: dispatch 2026-02-17T20:58:27.812 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:27 trial153 ceph-mon[25357]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial153", "root=default"]}]': finished 2026-02-17T20:58:27.813 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:27 trial153 ceph-mon[25357]: osdmap e40: 8 total, 6 up, 8 in 2026-02-17T20:58:27.813 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:27 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:27.813 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:27 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:27.813 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:27 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:28.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:27 trial104 ceph-mon[20612]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial153", "root=default"]}]': finished 2026-02-17T20:58:28.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:27 trial104 ceph-mon[20612]: osdmap e40: 8 total, 6 up, 8 in 2026-02-17T20:58:28.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:27 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:28.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:27 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:28.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:27 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:28.936 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:28 trial153 ceph-mon[25357]: purged_snaps scrub starts 2026-02-17T20:58:28.936 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:28 trial153 ceph-mon[25357]: purged_snaps scrub ok 2026-02-17T20:58:28.936 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:28 trial153 ceph-mon[25357]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-17T20:58:28.936 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:28 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:28.936 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:28 trial153 ceph-mon[25357]: osd.6 [v2:10.20.193.153:6816/4066146238,v1:10.20.193.153:6817/4066146238] boot 2026-02-17T20:58:28.936 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:28 trial153 ceph-mon[25357]: osdmap e41: 8 total, 7 up, 8 in 2026-02-17T20:58:28.936 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:28 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:28.937 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:28 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:28.937 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:28 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2026-02-17T20:58:28.937 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:28 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:29.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:28 trial104 ceph-mon[20612]: purged_snaps scrub starts 2026-02-17T20:58:29.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:28 trial104 ceph-mon[20612]: purged_snaps scrub ok 2026-02-17T20:58:29.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:28 trial104 ceph-mon[20612]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 4.1 TiB / 4.1 TiB avail; 96 KiB/s, 0 objects/s recovering 2026-02-17T20:58:29.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:28 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:29.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:28 trial104 ceph-mon[20612]: osd.6 [v2:10.20.193.153:6816/4066146238,v1:10.20.193.153:6817/4066146238] boot 2026-02-17T20:58:29.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:28 trial104 ceph-mon[20612]: osdmap e41: 8 total, 7 up, 8 in 2026-02-17T20:58:29.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:28 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2026-02-17T20:58:29.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:28 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:29.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:28 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2026-02-17T20:58:29.155 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:28 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:29.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:29 trial153 ceph-mon[25357]: Deploying daemon osd.7 on trial153 2026-02-17T20:58:29.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:29 trial153 ceph-mon[25357]: osdmap e42: 8 total, 7 up, 8 in 2026-02-17T20:58:29.776 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:29 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:30.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:29 trial104 ceph-mon[20612]: Deploying daemon osd.7 on trial153 2026-02-17T20:58:30.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:29 trial104 ceph-mon[20612]: osdmap e42: 8 total, 7 up, 8 in 2026-02-17T20:58:30.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:29 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:30.931 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:30 trial153 ceph-mon[25357]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T20:58:30.931 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:30 trial153 ceph-mon[25357]: osdmap e43: 8 total, 7 up, 8 in 2026-02-17T20:58:30.931 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:30 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:30.931 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:30 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:30.931 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:30 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:30.932 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:30 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:30.979 INFO:teuthology.orchestra.run.trial153.stdout:Created osd(s) 7 on host 'trial153' 2026-02-17T20:58:30.979 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:30.975+0000 7f1a00ff9640 1 -- 10.20.193.153:0/3283349341 <== mgr.14203 v2:10.20.193.104:6800/2484917436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f1a040630c0 con 0x7f19d80775a0 2026-02-17T20:58:30.981 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:30.977+0000 7f1a09e22640 1 -- 10.20.193.153:0/3283349341 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f19d80775a0 msgr2=0x7f19d8079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:30.981 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:30.977+0000 7f1a09e22640 1 --2- 10.20.193.153:0/3283349341 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f19d80775a0 0x7f19d8079a60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f19f4005fd0 tx=0x7f19f4005950 comp rx=0 tx=0).stop 2026-02-17T20:58:30.982 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:30.977+0000 7f1a09e22640 1 -- 10.20.193.153:0/3283349341 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1a04104940 msgr2=0x7f1a0419c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:30.982 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:30.977+0000 7f1a09e22640 1 --2- 10.20.193.153:0/3283349341 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1a04104940 0x7f1a0419c370 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f19f0004850 tx=0x7f19f0002820 comp rx=0 tx=0).stop 2026-02-17T20:58:30.982 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:30.977+0000 7f1a09e22640 1 -- 10.20.193.153:0/3283349341 shutdown_connections 2026-02-17T20:58:30.982 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:30.977+0000 7f1a09e22640 1 --2- 10.20.193.153:0/3283349341 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f19d80775a0 0x7f19d8079a60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:30.982 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:30.977+0000 7f1a09e22640 1 --2- 10.20.193.153:0/3283349341 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f1a04105b40 0x7f1a0419c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:30.982 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:30.977+0000 7f1a09e22640 1 --2- 10.20.193.153:0/3283349341 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f1a04104940 0x7f1a0419c370 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:30.982 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:30.977+0000 7f1a09e22640 1 -- 10.20.193.153:0/3283349341 >> 10.20.193.153:0/3283349341 conn(0x7f1a041000f0 msgr2=0x7f1a04109230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:30.982 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:30.978+0000 7f1a09e22640 1 -- 10.20.193.153:0/3283349341 shutdown_connections 2026-02-17T20:58:30.982 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:30.978+0000 7f1a09e22640 1 -- 10.20.193.153:0/3283349341 wait complete. 2026-02-17T20:58:31.019 DEBUG:teuthology.orchestra.run.trial153:osd.7> sudo journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.7.service 2026-02-17T20:58:31.021 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2026-02-17T20:58:31.021 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T20:58:31.045 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:30 trial104 ceph-mon[20612]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T20:58:31.045 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:30 trial104 ceph-mon[20612]: osdmap e43: 8 total, 7 up, 8 in 2026-02-17T20:58:31.045 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:30 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:31.045 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:30 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:31.045 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:30 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:31.045 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:30 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:31.181 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:31.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.283+0000 7f42d154f640 1 -- 10.20.193.104:0/3499928251 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f42cc1026d0 msgr2=0x7f42cc102ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:31.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.283+0000 7f42d154f640 1 --2- 10.20.193.104:0/3499928251 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f42cc1026d0 0x7f42cc102ad0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f42c00099b0 tx=0x7f42c002f220 comp rx=0 tx=0).stop 2026-02-17T20:58:31.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.283+0000 7f42d154f640 1 -- 10.20.193.104:0/3499928251 shutdown_connections 2026-02-17T20:58:31.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.283+0000 7f42d154f640 1 --2- 10.20.193.104:0/3499928251 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f42cc1038d0 0x7f42cc103d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:31.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.283+0000 7f42d154f640 1 --2- 10.20.193.104:0/3499928251 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f42cc1026d0 0x7f42cc102ad0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:31.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.283+0000 7f42d154f640 1 -- 10.20.193.104:0/3499928251 >> 10.20.193.104:0/3499928251 conn(0x7f42cc0fde60 msgr2=0x7f42cc1002a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:31.288 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.283+0000 7f42d154f640 1 -- 10.20.193.104:0/3499928251 shutdown_connections 2026-02-17T20:58:31.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.283+0000 7f42d154f640 1 -- 10.20.193.104:0/3499928251 wait complete. 2026-02-17T20:58:31.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.283+0000 7f42d154f640 1 Processor -- start 2026-02-17T20:58:31.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.283+0000 7f42d154f640 1 -- start start 2026-02-17T20:58:31.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42d154f640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f42cc1026d0 0x7f42cc076da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:31.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42d154f640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f42cc1038d0 0x7f42cc075460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:31.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42d154f640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc10b280 con 0x7f42cc1026d0 2026-02-17T20:58:31.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42d154f640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f42cc10b100 con 0x7f42cc1038d0 2026-02-17T20:58:31.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42caffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f42cc1026d0 0x7f42cc076da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:31.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42caffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f42cc1026d0 0x7f42cc076da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:58510/0 (socket says 10.20.193.104:58510) 2026-02-17T20:58:31.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42caffd640 1 -- 10.20.193.104:0/340063075 learned_addr learned my addr 10.20.193.104:0/340063075 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:31.289 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42ca7fc640 1 --2- 10.20.193.104:0/340063075 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f42cc1038d0 0x7f42cc075460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:31.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42caffd640 1 -- 10.20.193.104:0/340063075 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f42cc1038d0 msgr2=0x7f42cc075460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:31.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42caffd640 1 --2- 10.20.193.104:0/340063075 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f42cc1038d0 0x7f42cc075460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:31.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42caffd640 1 -- 10.20.193.104:0/340063075 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42cc0759a0 con 0x7f42cc1026d0 2026-02-17T20:58:31.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42ca7fc640 1 --2- 10.20.193.104:0/340063075 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f42cc1038d0 0x7f42cc075460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T20:58:31.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42caffd640 1 --2- 10.20.193.104:0/340063075 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f42cc1026d0 0x7f42cc076da0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f42c0002410 tx=0x7f42c002fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:31.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42abfff640 1 -- 10.20.193.104:0/340063075 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f42c0004420 con 0x7f42cc1026d0 2026-02-17T20:58:31.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42abfff640 1 -- 10.20.193.104:0/340063075 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f42c0038a40 con 0x7f42cc1026d0 2026-02-17T20:58:31.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42abfff640 1 -- 10.20.193.104:0/340063075 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f42c00418b0 con 0x7f42cc1026d0 2026-02-17T20:58:31.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42d154f640 1 -- 10.20.193.104:0/340063075 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42cc075c30 con 0x7f42cc1026d0 2026-02-17T20:58:31.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42d154f640 1 -- 10.20.193.104:0/340063075 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42cc0761e0 con 0x7f42cc1026d0 2026-02-17T20:58:31.290 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.284+0000 7f42d154f640 1 -- 10.20.193.104:0/340063075 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42cc102ad0 con 0x7f42cc1026d0 2026-02-17T20:58:31.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.285+0000 7f42abfff640 1 -- 10.20.193.104:0/340063075 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f42c0038bf0 con 0x7f42cc1026d0 2026-02-17T20:58:31.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.285+0000 7f42abfff640 1 --2- 10.20.193.104:0/340063075 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f42a00775a0 0x7f42a0079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:31.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.286+0000 7f42ca7fc640 1 --2- 10.20.193.104:0/340063075 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f42a00775a0 0x7f42a0079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:31.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.286+0000 7f42abfff640 1 -- 10.20.193.104:0/340063075 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5181+0+0 (secure 0 0 0) 0x7f42c003e070 con 0x7f42cc1026d0 2026-02-17T20:58:31.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.286+0000 7f42ca7fc640 1 --2- 10.20.193.104:0/340063075 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f42a00775a0 0x7f42a0079a60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f42cc076b20 tx=0x7f42b4005f50 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:31.291 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.288+0000 7f42abfff640 1 -- 10.20.193.104:0/340063075 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f42c008b910 con 0x7f42cc1026d0 2026-02-17T20:58:31.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.370+0000 7f42d154f640 1 -- 10.20.193.104:0/340063075 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f42cc193cd0 con 0x7f42cc1026d0 2026-02-17T20:58:31.372 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.370+0000 7f42abfff640 1 -- 10.20.193.104:0/340063075 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v43) ==== 74+0+130 (secure 0 0 0) 0x7f42c00907c0 con 0x7f42cc1026d0 2026-02-17T20:58:31.372 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:31.373 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.371+0000 7f42d154f640 1 -- 10.20.193.104:0/340063075 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f42a00775a0 msgr2=0x7f42a0079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:31.373 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.371+0000 7f42d154f640 1 --2- 10.20.193.104:0/340063075 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f42a00775a0 0x7f42a0079a60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f42cc076b20 tx=0x7f42b4005f50 comp rx=0 tx=0).stop 2026-02-17T20:58:31.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.371+0000 7f42d154f640 1 -- 10.20.193.104:0/340063075 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f42cc1026d0 msgr2=0x7f42cc076da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:31.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.371+0000 7f42d154f640 1 --2- 10.20.193.104:0/340063075 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f42cc1026d0 0x7f42cc076da0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f42c0002410 tx=0x7f42c002fe10 comp rx=0 tx=0).stop 2026-02-17T20:58:31.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.371+0000 7f42d154f640 1 -- 10.20.193.104:0/340063075 shutdown_connections 2026-02-17T20:58:31.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.371+0000 7f42d154f640 1 --2- 10.20.193.104:0/340063075 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f42a00775a0 0x7f42a0079a60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:31.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.371+0000 7f42d154f640 1 --2- 10.20.193.104:0/340063075 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f42cc1038d0 0x7f42cc075460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:31.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.371+0000 7f42d154f640 1 --2- 10.20.193.104:0/340063075 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f42cc1026d0 0x7f42cc076da0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:31.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.371+0000 7f42d154f640 1 -- 10.20.193.104:0/340063075 >> 10.20.193.104:0/340063075 conn(0x7f42cc0fde60 msgr2=0x7f42cc106f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:31.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.371+0000 7f42d154f640 1 -- 10.20.193.104:0/340063075 shutdown_connections 2026-02-17T20:58:31.374 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:31.371+0000 7f42d154f640 1 -- 10.20.193.104:0/340063075 wait complete. 2026-02-17T20:58:31.427 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":43,"num_osds":8,"num_up_osds":7,"osd_up_since":1771361907,"num_in_osds":8,"osd_in_since":1771361904,"num_remapped_pgs":0} 2026-02-17T20:58:31.952 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:31.952 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:31.952 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:31.952 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:31.952 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:31.952 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:31.952 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:31.953 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:31.953 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/340063075' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T20:58:31.953 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:31.953 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:31.953 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:31.953 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:31.953 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:31.953 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:31.953 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:31.953 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:31.954 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:31.954 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:31 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:32.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:32.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:32.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:32.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:32.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:32.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:32.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:32.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:32.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/340063075' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T20:58:32.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:32.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:32.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:32.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:32.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:32.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-17T20:58:32.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:32.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:32.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:32.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:31 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:32.275 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 20:58:31 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T20:58:31.948+0000 7f606f97a740 -1 Falling back to public interface 2026-02-17T20:58:32.428 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T20:58:32.586 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:32.692 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.688+0000 7f364cf5f640 1 -- 10.20.193.104:0/4278581253 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3648105b40 msgr2=0x7f3648105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:32.693 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.688+0000 7f364cf5f640 1 --2- 10.20.193.104:0/4278581253 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3648105b40 0x7f3648105fc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f36300099b0 tx=0x7f363002f220 comp rx=0 tx=0).stop 2026-02-17T20:58:32.693 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f364cf5f640 1 -- 10.20.193.104:0/4278581253 shutdown_connections 2026-02-17T20:58:32.693 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f364cf5f640 1 --2- 10.20.193.104:0/4278581253 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3648105b40 0x7f3648105fc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:32.693 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f364cf5f640 1 --2- 10.20.193.104:0/4278581253 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3648104940 0x7f3648104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:32.693 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f364cf5f640 1 -- 10.20.193.104:0/4278581253 >> 10.20.193.104:0/4278581253 conn(0x7f36481000f0 msgr2=0x7f3648102510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:32.693 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f364cf5f640 1 -- 10.20.193.104:0/4278581253 shutdown_connections 2026-02-17T20:58:32.693 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f364cf5f640 1 -- 10.20.193.104:0/4278581253 wait complete. 2026-02-17T20:58:32.693 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f364cf5f640 1 Processor -- start 2026-02-17T20:58:32.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f364cf5f640 1 -- start start 2026-02-17T20:58:32.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f364cf5f640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3648104940 0x7f364819c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:32.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f364cf5f640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3648105b40 0x7f364819c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:32.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f364cf5f640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f364810d4d0 con 0x7f3648104940 2026-02-17T20:58:32.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f364cf5f640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f364810d350 con 0x7f3648105b40 2026-02-17T20:58:32.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f3646575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3648104940 0x7f364819c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:32.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f3646575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3648104940 0x7f364819c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:58528/0 (socket says 10.20.193.104:58528) 2026-02-17T20:58:32.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f3646575640 1 -- 10.20.193.104:0/2551796174 learned_addr learned my addr 10.20.193.104:0/2551796174 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:32.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f3646575640 1 -- 10.20.193.104:0/2551796174 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3648105b40 msgr2=0x7f364819c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:32.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f3646575640 1 --2- 10.20.193.104:0/2551796174 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3648105b40 0x7f364819c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:32.694 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f3646575640 1 -- 10.20.193.104:0/2551796174 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f364819cf70 con 0x7f3648104940 2026-02-17T20:58:32.695 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f3646575640 1 --2- 10.20.193.104:0/2551796174 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3648104940 0x7f364819c3b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f363c00d900 tx=0x7f363c00ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:32.695 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f362f7fe640 1 -- 10.20.193.104:0/2551796174 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f363c014070 con 0x7f3648104940 2026-02-17T20:58:32.695 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f362f7fe640 1 -- 10.20.193.104:0/2551796174 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f363c0044a0 con 0x7f3648104940 2026-02-17T20:58:32.695 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f364cf5f640 1 -- 10.20.193.104:0/2551796174 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36481a19b0 con 0x7f3648104940 2026-02-17T20:58:32.695 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.689+0000 7f362f7fe640 1 -- 10.20.193.104:0/2551796174 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f363c002c40 con 0x7f3648104940 2026-02-17T20:58:32.695 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.690+0000 7f364cf5f640 1 -- 10.20.193.104:0/2551796174 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36481a1fc0 con 0x7f3648104940 2026-02-17T20:58:32.695 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.690+0000 7f364cf5f640 1 -- 10.20.193.104:0/2551796174 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3648104d40 con 0x7f3648104940 2026-02-17T20:58:32.695 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.691+0000 7f362f7fe640 1 -- 10.20.193.104:0/2551796174 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f363c00b840 con 0x7f3648104940 2026-02-17T20:58:32.696 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.691+0000 7f362f7fe640 1 --2- 10.20.193.104:0/2551796174 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3620077550 0x7f3620079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:32.696 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.691+0000 7f3645d74640 1 --2- 10.20.193.104:0/2551796174 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3620077550 0x7f3620079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:32.696 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.691+0000 7f362f7fe640 1 -- 10.20.193.104:0/2551796174 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5181+0+0 (secure 0 0 0) 0x7f363c099e50 con 0x7f3648104940 2026-02-17T20:58:32.696 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.691+0000 7f3645d74640 1 --2- 10.20.193.104:0/2551796174 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3620077550 0x7f3620079a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f36300097c0 tx=0x7f36300029f0 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:32.696 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.693+0000 7f362f7fe640 1 -- 10.20.193.104:0/2551796174 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f363c067020 con 0x7f3648104940 2026-02-17T20:58:32.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.775+0000 7f364cf5f640 1 -- 10.20.193.104:0/2551796174 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f3648195c90 con 0x7f3648104940 2026-02-17T20:58:32.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.775+0000 7f362f7fe640 1 -- 10.20.193.104:0/2551796174 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v43) ==== 74+0+130 (secure 0 0 0) 0x7f363c05e090 con 0x7f3648104940 2026-02-17T20:58:32.778 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:32.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.776+0000 7f364cf5f640 1 -- 10.20.193.104:0/2551796174 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3620077550 msgr2=0x7f3620079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:32.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.776+0000 7f364cf5f640 1 --2- 10.20.193.104:0/2551796174 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3620077550 0x7f3620079a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f36300097c0 tx=0x7f36300029f0 comp rx=0 tx=0).stop 2026-02-17T20:58:32.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.776+0000 7f364cf5f640 1 -- 10.20.193.104:0/2551796174 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3648104940 msgr2=0x7f364819c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:32.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.776+0000 7f364cf5f640 1 --2- 10.20.193.104:0/2551796174 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3648104940 0x7f364819c3b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f363c00d900 tx=0x7f363c00ddd0 comp rx=0 tx=0).stop 2026-02-17T20:58:32.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.776+0000 7f364cf5f640 1 -- 10.20.193.104:0/2551796174 shutdown_connections 2026-02-17T20:58:32.780 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.776+0000 7f364cf5f640 1 --2- 10.20.193.104:0/2551796174 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3620077550 0x7f3620079a10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:32.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.776+0000 7f364cf5f640 1 --2- 10.20.193.104:0/2551796174 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3648105b40 0x7f364819c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:32.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.776+0000 7f364cf5f640 1 --2- 10.20.193.104:0/2551796174 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3648104940 0x7f364819c3b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:32.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.776+0000 7f364cf5f640 1 -- 10.20.193.104:0/2551796174 >> 10.20.193.104:0/2551796174 conn(0x7f36481000f0 msgr2=0x7f36481091f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:32.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.776+0000 7f364cf5f640 1 -- 10.20.193.104:0/2551796174 shutdown_connections 2026-02-17T20:58:32.781 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:32.776+0000 7f364cf5f640 1 -- 10.20.193.104:0/2551796174 wait complete. 2026-02-17T20:58:32.815 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":43,"num_osds":8,"num_up_osds":7,"osd_up_since":1771361907,"num_in_osds":8,"osd_in_since":1771361904,"num_remapped_pgs":0} 2026-02-17T20:58:33.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:32 trial104 ceph-mon[20612]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T20:58:33.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:32 trial104 ceph-mon[20612]: Detected new or changed devices on trial153 2026-02-17T20:58:33.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:32 trial104 ceph-mon[20612]: Adjusting osd_memory_target on trial153 to 20467M 2026-02-17T20:58:33.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:32 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/2551796174' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T20:58:33.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:32 trial153 ceph-mon[25357]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T20:58:33.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:32 trial153 ceph-mon[25357]: Detected new or changed devices on trial153 2026-02-17T20:58:33.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:32 trial153 ceph-mon[25357]: Adjusting osd_memory_target on trial153 to 20467M 2026-02-17T20:58:33.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:32 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/2551796174' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T20:58:33.816 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T20:58:33.973 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:34.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.078+0000 7f7986df1640 1 -- 10.20.193.104:0/3091576279 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7980105b40 msgr2=0x7f7980105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:34.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.078+0000 7f7986df1640 1 --2- 10.20.193.104:0/3091576279 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7980105b40 0x7f7980105fc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f79680099b0 tx=0x7f796802f220 comp rx=0 tx=0).stop 2026-02-17T20:58:34.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7986df1640 1 -- 10.20.193.104:0/3091576279 shutdown_connections 2026-02-17T20:58:34.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7986df1640 1 --2- 10.20.193.104:0/3091576279 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7980105b40 0x7f7980105fc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:34.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7986df1640 1 --2- 10.20.193.104:0/3091576279 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7980104940 0x7f7980104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:34.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7986df1640 1 -- 10.20.193.104:0/3091576279 >> 10.20.193.104:0/3091576279 conn(0x7f79801000f0 msgr2=0x7f7980102510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:34.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7986df1640 1 -- 10.20.193.104:0/3091576279 shutdown_connections 2026-02-17T20:58:34.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7986df1640 1 -- 10.20.193.104:0/3091576279 wait complete. 2026-02-17T20:58:34.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7986df1640 1 Processor -- start 2026-02-17T20:58:34.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7986df1640 1 -- start start 2026-02-17T20:58:34.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7986df1640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7980104940 0x7f798019c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:34.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7986df1640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7980105b40 0x7f798019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:34.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7986df1640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f798010d4d0 con 0x7f7980105b40 2026-02-17T20:58:34.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7986df1640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f798010d350 con 0x7f7980104940 2026-02-17T20:58:34.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7977fff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7980105b40 0x7f798019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:34.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7977fff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7980105b40 0x7f798019c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:58532/0 (socket says 10.20.193.104:58532) 2026-02-17T20:58:34.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7977fff640 1 -- 10.20.193.104:0/2255367016 learned_addr learned my addr 10.20.193.104:0/2255367016 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:34.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7977fff640 1 -- 10.20.193.104:0/2255367016 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7980104940 msgr2=0x7f798019c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:34.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7977fff640 1 --2- 10.20.193.104:0/2255367016 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7980104940 0x7f798019c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:34.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7977fff640 1 -- 10.20.193.104:0/2255367016 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798019cf70 con 0x7f7980105b40 2026-02-17T20:58:34.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7977fff640 1 --2- 10.20.193.104:0/2255367016 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7980105b40 0x7f798019c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7968009ae0 tx=0x7f7968002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:34.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7975ffb640 1 -- 10.20.193.104:0/2255367016 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f79680044e0 con 0x7f7980105b40 2026-02-17T20:58:34.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7975ffb640 1 -- 10.20.193.104:0/2255367016 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f7968038a40 con 0x7f7980105b40 2026-02-17T20:58:34.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7986df1640 1 -- 10.20.193.104:0/2255367016 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79801a1950 con 0x7f7980105b40 2026-02-17T20:58:34.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7975ffb640 1 -- 10.20.193.104:0/2255367016 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f7968041950 con 0x7f7980105b40 2026-02-17T20:58:34.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.079+0000 7f7986df1640 1 -- 10.20.193.104:0/2255367016 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79801a1f60 con 0x7f7980105b40 2026-02-17T20:58:34.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.080+0000 7f7986df1640 1 -- 10.20.193.104:0/2255367016 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7980104d40 con 0x7f7980105b40 2026-02-17T20:58:34.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.080+0000 7f7975ffb640 1 -- 10.20.193.104:0/2255367016 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f7968038bf0 con 0x7f7980105b40 2026-02-17T20:58:34.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.081+0000 7f7975ffb640 1 --2- 10.20.193.104:0/2255367016 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f795c0775a0 0x7f795c079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:34.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.081+0000 7f7975ffb640 1 -- 10.20.193.104:0/2255367016 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5181+0+0 (secure 0 0 0) 0x7f796803e070 con 0x7f7980105b40 2026-02-17T20:58:34.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.081+0000 7f7984b66640 1 --2- 10.20.193.104:0/2255367016 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f795c0775a0 0x7f795c079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:34.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.081+0000 7f7984b66640 1 --2- 10.20.193.104:0/2255367016 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f795c0775a0 0x7f795c079a60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7970005fd0 tx=0x7f79700094f0 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:34.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.082+0000 7f7975ffb640 1 -- 10.20.193.104:0/2255367016 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f796808b840 con 0x7f7980105b40 2026-02-17T20:58:34.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:58:34.169 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.167+0000 7f7986df1640 1 -- 10.20.193.104:0/2255367016 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f7980195f00 con 0x7f7980105b40 2026-02-17T20:58:34.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.167+0000 7f7975ffb640 1 -- 10.20.193.104:0/2255367016 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v43) ==== 74+0+130 (secure 0 0 0) 0x7f79680bce20 con 0x7f7980105b40 2026-02-17T20:58:34.170 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:34.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.168+0000 7f7986df1640 1 -- 10.20.193.104:0/2255367016 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f795c0775a0 msgr2=0x7f795c079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:34.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.168+0000 7f7986df1640 1 --2- 10.20.193.104:0/2255367016 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f795c0775a0 0x7f795c079a60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7970005fd0 tx=0x7f79700094f0 comp rx=0 tx=0).stop 2026-02-17T20:58:34.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.168+0000 7f7986df1640 1 -- 10.20.193.104:0/2255367016 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7980105b40 msgr2=0x7f798019c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:34.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.168+0000 7f7986df1640 1 --2- 10.20.193.104:0/2255367016 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7980105b40 0x7f798019c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7968009ae0 tx=0x7f7968002820 comp rx=0 tx=0).stop 2026-02-17T20:58:34.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.168+0000 7f7986df1640 1 -- 10.20.193.104:0/2255367016 shutdown_connections 2026-02-17T20:58:34.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.168+0000 7f7986df1640 1 --2- 10.20.193.104:0/2255367016 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f795c0775a0 0x7f795c079a60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:34.171 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.168+0000 7f7986df1640 1 --2- 10.20.193.104:0/2255367016 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7980105b40 0x7f798019c8f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:34.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.168+0000 7f7986df1640 1 --2- 10.20.193.104:0/2255367016 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7980104940 0x7f798019c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:34.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.168+0000 7f7986df1640 1 -- 10.20.193.104:0/2255367016 >> 10.20.193.104:0/2255367016 conn(0x7f79801000f0 msgr2=0x7f79801091f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:34.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.168+0000 7f7986df1640 1 -- 10.20.193.104:0/2255367016 shutdown_connections 2026-02-17T20:58:34.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:34.168+0000 7f7986df1640 1 -- 10.20.193.104:0/2255367016 wait complete. 2026-02-17T20:58:34.205 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":43,"num_osds":8,"num_up_osds":7,"osd_up_since":1771361907,"num_in_osds":8,"osd_in_since":1771361904,"num_remapped_pgs":0} 2026-02-17T20:58:34.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:58:34.983 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 20:58:34 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T20:58:34.684+0000 7f606f97a740 -1 osd.7 0 log_to_monitors true 2026-02-17T20:58:35.206 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T20:58:35.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:34 trial153 ceph-mon[25357]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T20:58:35.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:34 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/2255367016' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T20:58:35.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:34 trial153 ceph-mon[25357]: from='osd.7 [v2:10.20.193.153:6824/1592752433,v1:10.20.193.153:6825/1592752433]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-17T20:58:35.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:34 trial153 ceph-mon[25357]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-17T20:58:35.361 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:35.383 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:34 trial104 ceph-mon[20612]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T20:58:35.384 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:34 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/2255367016' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T20:58:35.384 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:34 trial104 ceph-mon[20612]: from='osd.7 [v2:10.20.193.153:6824/1592752433,v1:10.20.193.153:6825/1592752433]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-17T20:58:35.384 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:34 trial104 ceph-mon[20612]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2026-02-17T20:58:35.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.465+0000 7f771cec3640 1 -- 10.20.193.104:0/3287361968 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7718105b40 msgr2=0x7f7718105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:35.470 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.465+0000 7f771cec3640 1 --2- 10.20.193.104:0/3287361968 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7718105b40 0x7f7718105fc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f77000099b0 tx=0x7f770002f220 comp rx=0 tx=0).stop 2026-02-17T20:58:35.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f771cec3640 1 -- 10.20.193.104:0/3287361968 shutdown_connections 2026-02-17T20:58:35.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f771cec3640 1 --2- 10.20.193.104:0/3287361968 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7718105b40 0x7f7718105fc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:35.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f771cec3640 1 --2- 10.20.193.104:0/3287361968 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7718104940 0x7f7718104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:35.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f771cec3640 1 -- 10.20.193.104:0/3287361968 >> 10.20.193.104:0/3287361968 conn(0x7f77181000f0 msgr2=0x7f7718102510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:35.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f771cec3640 1 -- 10.20.193.104:0/3287361968 shutdown_connections 2026-02-17T20:58:35.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f771cec3640 1 -- 10.20.193.104:0/3287361968 wait complete. 2026-02-17T20:58:35.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f771cec3640 1 Processor -- start 2026-02-17T20:58:35.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f771cec3640 1 -- start start 2026-02-17T20:58:35.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f771cec3640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7718104940 0x7f771819c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:35.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f771cec3640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7718105b40 0x7f771819c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:35.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f771cec3640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f771810d4d0 con 0x7f7718105b40 2026-02-17T20:58:35.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f771cec3640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f771810d350 con 0x7f7718104940 2026-02-17T20:58:35.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f7715d74640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7718105b40 0x7f771819c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:35.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f7715d74640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7718105b40 0x7f771819c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:58546/0 (socket says 10.20.193.104:58546) 2026-02-17T20:58:35.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f7715d74640 1 -- 10.20.193.104:0/4251839870 learned_addr learned my addr 10.20.193.104:0/4251839870 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:35.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f7716575640 1 --2- 10.20.193.104:0/4251839870 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7718104940 0x7f771819c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:35.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f7715d74640 1 -- 10.20.193.104:0/4251839870 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7718104940 msgr2=0x7f771819c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:35.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f7715d74640 1 --2- 10.20.193.104:0/4251839870 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7718104940 0x7f771819c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:35.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f7715d74640 1 -- 10.20.193.104:0/4251839870 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f771819cf70 con 0x7f7718105b40 2026-02-17T20:58:35.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.466+0000 7f7715d74640 1 --2- 10.20.193.104:0/4251839870 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7718105b40 0x7f771819c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7700002410 tx=0x7f770002fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:35.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.467+0000 7f76ff7fe640 1 -- 10.20.193.104:0/4251839870 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f7700004420 con 0x7f7718105b40 2026-02-17T20:58:35.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.467+0000 7f76ff7fe640 1 -- 10.20.193.104:0/4251839870 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f7700038a40 con 0x7f7718105b40 2026-02-17T20:58:35.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.467+0000 7f771cec3640 1 -- 10.20.193.104:0/4251839870 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77181a1950 con 0x7f7718105b40 2026-02-17T20:58:35.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.467+0000 7f76ff7fe640 1 -- 10.20.193.104:0/4251839870 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f7700041870 con 0x7f7718105b40 2026-02-17T20:58:35.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.467+0000 7f771cec3640 1 -- 10.20.193.104:0/4251839870 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77181a1f60 con 0x7f7718105b40 2026-02-17T20:58:35.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.467+0000 7f771cec3640 1 -- 10.20.193.104:0/4251839870 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7718104d40 con 0x7f7718105b40 2026-02-17T20:58:35.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.468+0000 7f76ff7fe640 1 -- 10.20.193.104:0/4251839870 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f7700038bf0 con 0x7f7718105b40 2026-02-17T20:58:35.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.468+0000 7f76ff7fe640 1 --2- 10.20.193.104:0/4251839870 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f76f00775a0 0x7f76f0079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:35.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.468+0000 7f7716575640 1 --2- 10.20.193.104:0/4251839870 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f76f00775a0 0x7f76f0079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:35.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.468+0000 7f76ff7fe640 1 -- 10.20.193.104:0/4251839870 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5202+0+0 (secure 0 0 0) 0x7f770003e070 con 0x7f7718105b40 2026-02-17T20:58:35.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.469+0000 7f7716575640 1 --2- 10.20.193.104:0/4251839870 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f76f00775a0 0x7f76f0079a60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77181059a0 tx=0x7f770c009290 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:35.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.470+0000 7f76ff7fe640 1 -- 10.20.193.104:0/4251839870 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f770008b490 con 0x7f7718105b40 2026-02-17T20:58:35.557 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.555+0000 7f771cec3640 1 -- 10.20.193.104:0/4251839870 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f7718195c90 con 0x7f7718105b40 2026-02-17T20:58:35.558 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.556+0000 7f76ff7fe640 1 -- 10.20.193.104:0/4251839870 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v44) ==== 74+0+130 (secure 0 0 0) 0x7f7700090340 con 0x7f7718105b40 2026-02-17T20:58:35.558 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:35.559 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.556+0000 7f771cec3640 1 -- 10.20.193.104:0/4251839870 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f76f00775a0 msgr2=0x7f76f0079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:35.559 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.556+0000 7f771cec3640 1 --2- 10.20.193.104:0/4251839870 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f76f00775a0 0x7f76f0079a60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77181059a0 tx=0x7f770c009290 comp rx=0 tx=0).stop 2026-02-17T20:58:35.559 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.556+0000 7f771cec3640 1 -- 10.20.193.104:0/4251839870 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7718105b40 msgr2=0x7f771819c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:35.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.556+0000 7f771cec3640 1 --2- 10.20.193.104:0/4251839870 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7718105b40 0x7f771819c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7700002410 tx=0x7f770002fe10 comp rx=0 tx=0).stop 2026-02-17T20:58:35.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.556+0000 7f771cec3640 1 -- 10.20.193.104:0/4251839870 shutdown_connections 2026-02-17T20:58:35.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.556+0000 7f771cec3640 1 --2- 10.20.193.104:0/4251839870 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f76f00775a0 0x7f76f0079a60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:35.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.556+0000 7f771cec3640 1 --2- 10.20.193.104:0/4251839870 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7718105b40 0x7f771819c8f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:35.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.556+0000 7f771cec3640 1 --2- 10.20.193.104:0/4251839870 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7718104940 0x7f771819c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:35.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.557+0000 7f771cec3640 1 -- 10.20.193.104:0/4251839870 >> 10.20.193.104:0/4251839870 conn(0x7f77181000f0 msgr2=0x7f77181091f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:35.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.557+0000 7f771cec3640 1 -- 10.20.193.104:0/4251839870 shutdown_connections 2026-02-17T20:58:35.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:35.557+0000 7f771cec3640 1 -- 10.20.193.104:0/4251839870 wait complete. 2026-02-17T20:58:35.594 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":44,"num_osds":8,"num_up_osds":7,"osd_up_since":1771361907,"num_in_osds":8,"osd_in_since":1771361904,"num_remapped_pgs":0} 2026-02-17T20:58:36.275 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 20:58:35 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T20:58:35.989+0000 7f606b8fb640 -1 osd.7 0 waiting for initial osdmap 2026-02-17T20:58:36.276 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 20:58:35 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T20:58:35.993+0000 7f6067725640 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-17T20:58:36.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:35 trial153 ceph-mon[25357]: from='osd.7 [v2:10.20.193.153:6824/1592752433,v1:10.20.193.153:6825/1592752433]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial153", "root=default"]}]: dispatch 2026-02-17T20:58:36.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:35 trial153 ceph-mon[25357]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-17T20:58:36.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:35 trial153 ceph-mon[25357]: osdmap e44: 8 total, 7 up, 8 in 2026-02-17T20:58:36.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:35 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:36.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:35 trial153 ceph-mon[25357]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial153", "root=default"]}]: dispatch 2026-02-17T20:58:36.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:35 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/4251839870' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T20:58:36.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:35 trial104 ceph-mon[20612]: from='osd.7 [v2:10.20.193.153:6824/1592752433,v1:10.20.193.153:6825/1592752433]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial153", "root=default"]}]: dispatch 2026-02-17T20:58:36.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:35 trial104 ceph-mon[20612]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-17T20:58:36.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:35 trial104 ceph-mon[20612]: osdmap e44: 8 total, 7 up, 8 in 2026-02-17T20:58:36.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:35 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:36.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:35 trial104 ceph-mon[20612]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial153", "root=default"]}]: dispatch 2026-02-17T20:58:36.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:35 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/4251839870' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T20:58:36.596 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T20:58:36.752 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:36.854 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.849+0000 7fcc4f03a640 1 -- 10.20.193.104:0/113829017 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcc48104940 msgr2=0x7fcc48104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:36.854 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.849+0000 7fcc4f03a640 1 --2- 10.20.193.104:0/113829017 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcc48104940 0x7fcc48104d40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcc380099b0 tx=0x7fcc3802f220 comp rx=0 tx=0).stop 2026-02-17T20:58:36.854 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.849+0000 7fcc4f03a640 1 -- 10.20.193.104:0/113829017 shutdown_connections 2026-02-17T20:58:36.854 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.849+0000 7fcc4f03a640 1 --2- 10.20.193.104:0/113829017 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcc48105b40 0x7fcc48105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:36.855 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.849+0000 7fcc4f03a640 1 --2- 10.20.193.104:0/113829017 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcc48104940 0x7fcc48104d40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:36.855 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.849+0000 7fcc4f03a640 1 -- 10.20.193.104:0/113829017 >> 10.20.193.104:0/113829017 conn(0x7fcc481000f0 msgr2=0x7fcc48102510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:36.855 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.849+0000 7fcc4f03a640 1 -- 10.20.193.104:0/113829017 shutdown_connections 2026-02-17T20:58:36.855 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.849+0000 7fcc4f03a640 1 -- 10.20.193.104:0/113829017 wait complete. 2026-02-17T20:58:36.855 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc4f03a640 1 Processor -- start 2026-02-17T20:58:36.855 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc4f03a640 1 -- start start 2026-02-17T20:58:36.855 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc4f03a640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcc48104940 0x7fcc4819c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:36.855 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc4f03a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcc48105b40 0x7fcc4819c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:36.855 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc4f03a640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4810d550 con 0x7fcc48104940 2026-02-17T20:58:36.855 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc4f03a640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4810d3d0 con 0x7fcc48105b40 2026-02-17T20:58:36.855 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc4cdaf640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcc48104940 0x7fcc4819c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:36.856 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc4cdaf640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcc48104940 0x7fcc4819c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:58572/0 (socket says 10.20.193.104:58572) 2026-02-17T20:58:36.856 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc4cdaf640 1 -- 10.20.193.104:0/2668376695 learned_addr learned my addr 10.20.193.104:0/2668376695 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:36.856 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc4cdaf640 1 -- 10.20.193.104:0/2668376695 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcc48105b40 msgr2=0x7fcc4819c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:36.856 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc4cdaf640 1 --2- 10.20.193.104:0/2668376695 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcc48105b40 0x7fcc4819c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:36.856 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc4cdaf640 1 -- 10.20.193.104:0/2668376695 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4819cfb0 con 0x7fcc48104940 2026-02-17T20:58:36.856 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc4cdaf640 1 --2- 10.20.193.104:0/2668376695 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcc48104940 0x7fcc4819c3f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcc3802f730 tx=0x7fcc38004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:36.856 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc3dffb640 1 -- 10.20.193.104:0/2668376695 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fcc38046070 con 0x7fcc48104940 2026-02-17T20:58:36.856 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc3dffb640 1 -- 10.20.193.104:0/2668376695 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fcc38038c00 con 0x7fcc48104940 2026-02-17T20:58:36.856 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc4f03a640 1 -- 10.20.193.104:0/2668376695 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc481a1990 con 0x7fcc48104940 2026-02-17T20:58:36.856 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc3dffb640 1 -- 10.20.193.104:0/2668376695 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fcc38041a60 con 0x7fcc48104940 2026-02-17T20:58:36.856 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.850+0000 7fcc4f03a640 1 -- 10.20.193.104:0/2668376695 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc481a1fa0 con 0x7fcc48104940 2026-02-17T20:58:36.856 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.851+0000 7fcc4f03a640 1 -- 10.20.193.104:0/2668376695 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc48104dc0 con 0x7fcc48104940 2026-02-17T20:58:36.857 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.851+0000 7fcc3dffb640 1 -- 10.20.193.104:0/2668376695 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7fcc38038790 con 0x7fcc48104940 2026-02-17T20:58:36.857 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.852+0000 7fcc3dffb640 1 --2- 10.20.193.104:0/2668376695 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fcc240775a0 0x7fcc24079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:36.857 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.852+0000 7fcc3dffb640 1 -- 10.20.193.104:0/2668376695 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5218+0+0 (secure 0 0 0) 0x7fcc3803e070 con 0x7fcc48104940 2026-02-17T20:58:36.858 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.852+0000 7fcc3ffff640 1 --2- 10.20.193.104:0/2668376695 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fcc240775a0 0x7fcc24079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:36.858 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.852+0000 7fcc3ffff640 1 --2- 10.20.193.104:0/2668376695 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fcc240775a0 0x7fcc24079a60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcc4819d8a0 tx=0x7fcc30006d90 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:36.858 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.853+0000 7fcc3dffb640 1 -- 10.20.193.104:0/2668376695 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fcc38050020 con 0x7fcc48104940 2026-02-17T20:58:36.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.935+0000 7fcc4f03a640 1 -- 10.20.193.104:0/2668376695 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fcc48195f60 con 0x7fcc48104940 2026-02-17T20:58:36.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.935+0000 7fcc3dffb640 1 -- 10.20.193.104:0/2668376695 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v45) ==== 74+0+130 (secure 0 0 0) 0x7fcc3808bf70 con 0x7fcc48104940 2026-02-17T20:58:36.938 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:36.940 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.936+0000 7fcc4f03a640 1 -- 10.20.193.104:0/2668376695 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fcc240775a0 msgr2=0x7fcc24079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:36.940 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.936+0000 7fcc4f03a640 1 --2- 10.20.193.104:0/2668376695 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fcc240775a0 0x7fcc24079a60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcc4819d8a0 tx=0x7fcc30006d90 comp rx=0 tx=0).stop 2026-02-17T20:58:36.940 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.936+0000 7fcc4f03a640 1 -- 10.20.193.104:0/2668376695 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcc48104940 msgr2=0x7fcc4819c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:36.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.936+0000 7fcc4f03a640 1 --2- 10.20.193.104:0/2668376695 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcc48104940 0x7fcc4819c3f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcc3802f730 tx=0x7fcc38004290 comp rx=0 tx=0).stop 2026-02-17T20:58:36.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.936+0000 7fcc4f03a640 1 -- 10.20.193.104:0/2668376695 shutdown_connections 2026-02-17T20:58:36.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.936+0000 7fcc4f03a640 1 --2- 10.20.193.104:0/2668376695 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fcc240775a0 0x7fcc24079a60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:36.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.936+0000 7fcc4f03a640 1 --2- 10.20.193.104:0/2668376695 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fcc48105b40 0x7fcc4819c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:36.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.936+0000 7fcc4f03a640 1 --2- 10.20.193.104:0/2668376695 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fcc48104940 0x7fcc4819c3f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:36.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.936+0000 7fcc4f03a640 1 -- 10.20.193.104:0/2668376695 >> 10.20.193.104:0/2668376695 conn(0x7fcc481000f0 msgr2=0x7fcc48109280 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:36.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.936+0000 7fcc4f03a640 1 -- 10.20.193.104:0/2668376695 shutdown_connections 2026-02-17T20:58:36.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:36.936+0000 7fcc4f03a640 1 -- 10.20.193.104:0/2668376695 wait complete. 2026-02-17T20:58:36.974 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":45,"num_osds":8,"num_up_osds":7,"osd_up_since":1771361907,"num_in_osds":8,"osd_in_since":1771361904,"num_remapped_pgs":0} 2026-02-17T20:58:37.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:36 trial153 ceph-mon[25357]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T20:58:37.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:36 trial153 ceph-mon[25357]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial153", "root=default"]}]': finished 2026-02-17T20:58:37.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:36 trial153 ceph-mon[25357]: osdmap e45: 8 total, 7 up, 8 in 2026-02-17T20:58:37.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:36 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:37.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:36 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:37.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:36 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/2668376695' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T20:58:37.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:36 trial104 ceph-mon[20612]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T20:58:37.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:36 trial104 ceph-mon[20612]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial153", "root=default"]}]': finished 2026-02-17T20:58:37.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:36 trial104 ceph-mon[20612]: osdmap e45: 8 total, 7 up, 8 in 2026-02-17T20:58:37.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:36 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:37.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:36 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:37.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:36 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/2668376695' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T20:58:37.974 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd stat -f json 2026-02-17T20:58:38.135 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:38.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e7577640 1 -- 10.20.193.104:0/3058689298 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8e8105950 msgr2=0x7fb8e8105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:38.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e7577640 1 --2- 10.20.193.104:0/3058689298 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8e8105950 0x7fb8e8105dd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb8d00099b0 tx=0x7fb8d002f220 comp rx=0 tx=0).stop 2026-02-17T20:58:38.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e7577640 1 -- 10.20.193.104:0/3058689298 shutdown_connections 2026-02-17T20:58:38.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e7577640 1 --2- 10.20.193.104:0/3058689298 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8e8105950 0x7fb8e8105dd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:38.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e7577640 1 --2- 10.20.193.104:0/3058689298 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb8e8104750 0x7fb8e8104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:38.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e7577640 1 -- 10.20.193.104:0/3058689298 >> 10.20.193.104:0/3058689298 conn(0x7fb8e80fff00 msgr2=0x7fb8e8102320 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:38.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e7577640 1 -- 10.20.193.104:0/3058689298 shutdown_connections 2026-02-17T20:58:38.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e7577640 1 -- 10.20.193.104:0/3058689298 wait complete. 2026-02-17T20:58:38.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e7577640 1 Processor -- start 2026-02-17T20:58:38.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e7577640 1 -- start start 2026-02-17T20:58:38.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e7577640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8e8104750 0x7fb8e819c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:38.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e7577640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb8e8105950 0x7fb8e819c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:38.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e7577640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e810d2e0 con 0x7fb8e8104750 2026-02-17T20:58:38.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e7577640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb8e810d160 con 0x7fb8e8105950 2026-02-17T20:58:38.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e6575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8e8104750 0x7fb8e819c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:38.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e6575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8e8104750 0x7fb8e819c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40958/0 (socket says 10.20.193.104:40958) 2026-02-17T20:58:38.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e6575640 1 -- 10.20.193.104:0/4195617798 learned_addr learned my addr 10.20.193.104:0/4195617798 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:38.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e5d74640 1 --2- 10.20.193.104:0/4195617798 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb8e8105950 0x7fb8e819c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:38.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e6575640 1 -- 10.20.193.104:0/4195617798 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb8e8105950 msgr2=0x7fb8e819c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:38.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e6575640 1 --2- 10.20.193.104:0/4195617798 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb8e8105950 0x7fb8e819c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:38.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.232+0000 7fb8e6575640 1 -- 10.20.193.104:0/4195617798 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8e819ccd0 con 0x7fb8e8104750 2026-02-17T20:58:38.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.233+0000 7fb8e6575640 1 --2- 10.20.193.104:0/4195617798 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8e8104750 0x7fb8e819c110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc00d900 tx=0x7fb8dc00ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:38.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.233+0000 7fb8cf7fe640 1 -- 10.20.193.104:0/4195617798 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb8dc014070 con 0x7fb8e8104750 2026-02-17T20:58:38.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.233+0000 7fb8e7577640 1 -- 10.20.193.104:0/4195617798 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8e81a1710 con 0x7fb8e8104750 2026-02-17T20:58:38.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.233+0000 7fb8cf7fe640 1 -- 10.20.193.104:0/4195617798 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fb8dc0044a0 con 0x7fb8e8104750 2026-02-17T20:58:38.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.233+0000 7fb8cf7fe640 1 -- 10.20.193.104:0/4195617798 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb8dc002c40 con 0x7fb8e8104750 2026-02-17T20:58:38.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.233+0000 7fb8e7577640 1 -- 10.20.193.104:0/4195617798 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8e81a1d20 con 0x7fb8e8104750 2026-02-17T20:58:38.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.233+0000 7fb8e7577640 1 -- 10.20.193.104:0/4195617798 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8e8104b50 con 0x7fb8e8104750 2026-02-17T20:58:38.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.234+0000 7fb8cf7fe640 1 -- 10.20.193.104:0/4195617798 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7fb8dc00b840 con 0x7fb8e8104750 2026-02-17T20:58:38.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.234+0000 7fb8cf7fe640 1 --2- 10.20.193.104:0/4195617798 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb8c00775a0 0x7fb8c0079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:38.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.234+0000 7fb8e5d74640 1 --2- 10.20.193.104:0/4195617798 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb8c00775a0 0x7fb8c0079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:38.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.235+0000 7fb8cf7fe640 1 -- 10.20.193.104:0/4195617798 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5498+0+0 (secure 0 0 0) 0x7fb8dc099e40 con 0x7fb8e8104750 2026-02-17T20:58:38.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.235+0000 7fb8e5d74640 1 --2- 10.20.193.104:0/4195617798 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb8c00775a0 0x7fb8c0079a60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0002af0 tx=0x7fb8d003a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:38.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.236+0000 7fb8cf7fe640 1 -- 10.20.193.104:0/4195617798 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb8dc067010 con 0x7fb8e8104750 2026-02-17T20:58:38.248 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:37 trial104 ceph-mon[20612]: purged_snaps scrub starts 2026-02-17T20:58:38.248 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:37 trial104 ceph-mon[20612]: purged_snaps scrub ok 2026-02-17T20:58:38.248 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:37 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:38.248 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:37 trial104 ceph-mon[20612]: osd.7 [v2:10.20.193.153:6824/1592752433,v1:10.20.193.153:6825/1592752433] boot 2026-02-17T20:58:38.249 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:37 trial104 ceph-mon[20612]: osdmap e46: 8 total, 8 up, 8 in 2026-02-17T20:58:38.249 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:37 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:38.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:37 trial153 ceph-mon[25357]: purged_snaps scrub starts 2026-02-17T20:58:38.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:37 trial153 ceph-mon[25357]: purged_snaps scrub ok 2026-02-17T20:58:38.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:37 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:38.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:37 trial153 ceph-mon[25357]: osd.7 [v2:10.20.193.153:6824/1592752433,v1:10.20.193.153:6825/1592752433] boot 2026-02-17T20:58:38.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:37 trial153 ceph-mon[25357]: osdmap e46: 8 total, 8 up, 8 in 2026-02-17T20:58:38.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:37 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2026-02-17T20:58:38.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.320+0000 7fb8e7577640 1 -- 10.20.193.104:0/4195617798 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb8e8195d10 con 0x7fb8e8104750 2026-02-17T20:58:38.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.320+0000 7fb8cf7fe640 1 -- 10.20.193.104:0/4195617798 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v47) ==== 74+0+130 (secure 0 0 0) 0x7fb8dc06bec0 con 0x7fb8e8104750 2026-02-17T20:58:38.323 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:38.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.321+0000 7fb8e7577640 1 -- 10.20.193.104:0/4195617798 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb8c00775a0 msgr2=0x7fb8c0079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:38.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.321+0000 7fb8e7577640 1 --2- 10.20.193.104:0/4195617798 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb8c00775a0 0x7fb8c0079a60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0002af0 tx=0x7fb8d003a040 comp rx=0 tx=0).stop 2026-02-17T20:58:38.324 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.321+0000 7fb8e7577640 1 -- 10.20.193.104:0/4195617798 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8e8104750 msgr2=0x7fb8e819c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:38.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.321+0000 7fb8e7577640 1 --2- 10.20.193.104:0/4195617798 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8e8104750 0x7fb8e819c110 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc00d900 tx=0x7fb8dc00ddd0 comp rx=0 tx=0).stop 2026-02-17T20:58:38.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.321+0000 7fb8e7577640 1 -- 10.20.193.104:0/4195617798 shutdown_connections 2026-02-17T20:58:38.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.321+0000 7fb8e7577640 1 --2- 10.20.193.104:0/4195617798 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb8c00775a0 0x7fb8c0079a60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:38.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.321+0000 7fb8e7577640 1 --2- 10.20.193.104:0/4195617798 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb8e8105950 0x7fb8e819c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:38.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.321+0000 7fb8e7577640 1 --2- 10.20.193.104:0/4195617798 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb8e8104750 0x7fb8e819c110 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:38.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.321+0000 7fb8e7577640 1 -- 10.20.193.104:0/4195617798 >> 10.20.193.104:0/4195617798 conn(0x7fb8e80fff00 msgr2=0x7fb8e8108fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:38.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.321+0000 7fb8e7577640 1 -- 10.20.193.104:0/4195617798 shutdown_connections 2026-02-17T20:58:38.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.321+0000 7fb8e7577640 1 -- 10.20.193.104:0/4195617798 wait complete. 2026-02-17T20:58:38.359 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":47,"num_osds":8,"num_up_osds":8,"osd_up_since":1771361916,"num_in_osds":8,"osd_in_since":1771361904,"num_remapped_pgs":0} 2026-02-17T20:58:38.360 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T20:58:38.513 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:38.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec811ec640 1 -- 10.20.193.104:0/3014062959 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fec7c1048c0 msgr2=0x7fec7c104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:38.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec811ec640 1 --2- 10.20.193.104:0/3014062959 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fec7c1048c0 0x7fec7c104d20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fec640099b0 tx=0x7fec6402f220 comp rx=0 tx=0).stop 2026-02-17T20:58:38.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec811ec640 1 -- 10.20.193.104:0/3014062959 shutdown_connections 2026-02-17T20:58:38.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec811ec640 1 --2- 10.20.193.104:0/3014062959 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fec7c1048c0 0x7fec7c104d20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:38.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec811ec640 1 --2- 10.20.193.104:0/3014062959 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fec7c10a8c0 0x7fec7c10aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:38.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec811ec640 1 -- 10.20.193.104:0/3014062959 >> 10.20.193.104:0/3014062959 conn(0x7fec7c1005c0 msgr2=0x7fec7c1029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:38.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec811ec640 1 -- 10.20.193.104:0/3014062959 shutdown_connections 2026-02-17T20:58:38.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec811ec640 1 -- 10.20.193.104:0/3014062959 wait complete. 2026-02-17T20:58:38.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec811ec640 1 Processor -- start 2026-02-17T20:58:38.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec811ec640 1 -- start start 2026-02-17T20:58:38.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec811ec640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fec7c1048c0 0x7fec7c1a25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:38.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec811ec640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fec7c10a8c0 0x7fec7c1a2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:38.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec811ec640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c111ae0 con 0x7fec7c10a8c0 2026-02-17T20:58:38.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec811ec640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c111960 con 0x7fec7c1048c0 2026-02-17T20:58:38.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec7a575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fec7c10a8c0 0x7fec7c1a2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:38.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec7a575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fec7c10a8c0 0x7fec7c1a2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40968/0 (socket says 10.20.193.104:40968) 2026-02-17T20:58:38.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec7a575640 1 -- 10.20.193.104:0/1444903693 learned_addr learned my addr 10.20.193.104:0/1444903693 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:38.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.610+0000 7fec7ad76640 1 --2- 10.20.193.104:0/1444903693 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fec7c1048c0 0x7fec7c1a25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:38.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.611+0000 7fec7a575640 1 -- 10.20.193.104:0/1444903693 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fec7c1048c0 msgr2=0x7fec7c1a25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:38.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.611+0000 7fec7a575640 1 --2- 10.20.193.104:0/1444903693 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fec7c1048c0 0x7fec7c1a25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:38.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.611+0000 7fec7a575640 1 -- 10.20.193.104:0/1444903693 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c19c6b0 con 0x7fec7c10a8c0 2026-02-17T20:58:38.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.611+0000 7fec7a575640 1 --2- 10.20.193.104:0/1444903693 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fec7c10a8c0 0x7fec7c1a2b20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fec64038500 tx=0x7fec6402fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:38.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.611+0000 7fec5bfff640 1 -- 10.20.193.104:0/1444903693 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fec64004420 con 0x7fec7c10a8c0 2026-02-17T20:58:38.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.611+0000 7fec811ec640 1 -- 10.20.193.104:0/1444903693 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7c19c940 con 0x7fec7c10a8c0 2026-02-17T20:58:38.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.611+0000 7fec5bfff640 1 -- 10.20.193.104:0/1444903693 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fec64038a40 con 0x7fec7c10a8c0 2026-02-17T20:58:38.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.611+0000 7fec5bfff640 1 -- 10.20.193.104:0/1444903693 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fec64041740 con 0x7fec7c10a8c0 2026-02-17T20:58:38.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.611+0000 7fec811ec640 1 -- 10.20.193.104:0/1444903693 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec7c19ce40 con 0x7fec7c10a8c0 2026-02-17T20:58:38.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.611+0000 7fec811ec640 1 -- 10.20.193.104:0/1444903693 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec7c106000 con 0x7fec7c10a8c0 2026-02-17T20:58:38.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.612+0000 7fec5bfff640 1 -- 10.20.193.104:0/1444903693 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7fec640385d0 con 0x7fec7c10a8c0 2026-02-17T20:58:38.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.612+0000 7fec5bfff640 1 --2- 10.20.193.104:0/1444903693 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fec50077550 0x7fec50079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:38.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.612+0000 7fec5bfff640 1 -- 10.20.193.104:0/1444903693 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5498+0+0 (secure 0 0 0) 0x7fec6403e070 con 0x7fec7c10a8c0 2026-02-17T20:58:38.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.612+0000 7fec7ad76640 1 --2- 10.20.193.104:0/1444903693 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fec50077550 0x7fec50079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:38.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.613+0000 7fec7ad76640 1 --2- 10.20.193.104:0/1444903693 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fec50077550 0x7fec50079a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fec70004700 tx=0x7fec70009290 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:38.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.614+0000 7fec5bfff640 1 -- 10.20.193.104:0/1444903693 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fec6408b690 con 0x7fec7c10a8c0 2026-02-17T20:58:38.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.699+0000 7fec811ec640 1 -- 10.20.193.104:0/1444903693 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec7c19d0f0 con 0x7fec7c10a8c0 2026-02-17T20:58:38.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.699+0000 7fec5bfff640 1 -- 10.20.193.104:0/1444903693 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+13931 (secure 0 0 0) 0x7fec64090540 con 0x7fec7c10a8c0 2026-02-17T20:58:38.703 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:38.703 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":47,"fsid":"19072504-0c43-11f1-93a3-d404e6e7d460","created":"2026-02-17T20:56:28.383257+0000","modified":"2026-02-17T20:58:37.994973+0000","last_up_change":"2026-02-17T20:58:36.991631+0000","last_in_change":"2026-02-17T20:58:24.285994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T20:57:51.660976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a22ae774-55bf-4c61-9328-96f1ad2a6a62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6802","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6803","nonce":438222704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6804","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6805","nonce":438222704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6808","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6809","nonce":438222704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6806","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6807","nonce":438222704}]},"public_addr":"10.20.193.104:6803/438222704","cluster_addr":"10.20.193.104:6805/438222704","heartbeat_back_addr":"10.20.193.104:6809/438222704","heartbeat_front_addr":"10.20.193.104:6807/438222704","state":["exists","up"]},{"osd":1,"uuid":"e221e89a-fd48-4e6f-a73d-a109718c9b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6810","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6811","nonce":1955490859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6812","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6813","nonce":1955490859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6816","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6817","nonce":1955490859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6814","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6815","nonce":1955490859}]},"public_addr":"10.20.193.104:6811/1955490859","cluster_addr":"10.20.193.104:6813/1955490859","heartbeat_back_addr":"10.20.193.104:6817/1955490859","heartbeat_front_addr":"10.20.193.104:6815/1955490859","state":["exists","up"]},{"osd":2,"uuid":"e0266db8-19cd-4ddb-a96a-cb84d2b0c4c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6818","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6819","nonce":3131863919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6820","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6821","nonce":3131863919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6824","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6825","nonce":3131863919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6822","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6823","nonce":3131863919}]},"public_addr":"10.20.193.104:6819/3131863919","cluster_addr":"10.20.193.104:6821/3131863919","heartbeat_back_addr":"10.20.193.104:6825/3131863919","heartbeat_front_addr":"10.20.193.104:6823/3131863919","state":["exists","up"]},{"osd":3,"uuid":"3b10ab50-7d78-4eea-b768-34534959a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6826","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6827","nonce":1948872135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6828","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6829","nonce":1948872135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6832","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6833","nonce":1948872135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6830","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6831","nonce":1948872135}]},"public_addr":"10.20.193.104:6827/1948872135","cluster_addr":"10.20.193.104:6829/1948872135","heartbeat_back_addr":"10.20.193.104:6833/1948872135","heartbeat_front_addr":"10.20.193.104:6831/1948872135","state":["exists","up"]},{"osd":4,"uuid":"d713875a-a825-474b-9ea5-cf8935174190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6800","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6801","nonce":250110565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6802","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6803","nonce":250110565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6806","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6807","nonce":250110565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6804","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6805","nonce":250110565}]},"public_addr":"10.20.193.153:6801/250110565","cluster_addr":"10.20.193.153:6803/250110565","heartbeat_back_addr":"10.20.193.153:6807/250110565","heartbeat_front_addr":"10.20.193.153:6805/250110565","state":["exists","up"]},{"osd":5,"uuid":"65f4195f-0129-41e5-931f-4b0a53ee6868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6808","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6809","nonce":2951447967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6810","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6811","nonce":2951447967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6814","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6815","nonce":2951447967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6812","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6813","nonce":2951447967}]},"public_addr":"10.20.193.153:6809/2951447967","cluster_addr":"10.20.193.153:6811/2951447967","heartbeat_back_addr":"10.20.193.153:6815/2951447967","heartbeat_front_addr":"10.20.193.153:6813/2951447967","state":["exists","up"]},{"osd":6,"uuid":"070da905-eb86-4405-a53f-fc3414a1ca70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6816","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6817","nonce":4066146238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6818","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6819","nonce":4066146238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6822","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6823","nonce":4066146238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6820","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6821","nonce":4066146238}]},"public_addr":"10.20.193.153:6817/4066146238","cluster_addr":"10.20.193.153:6819/4066146238","heartbeat_back_addr":"10.20.193.153:6823/4066146238","heartbeat_front_addr":"10.20.193.153:6821/4066146238","state":["exists","up"]},{"osd":7,"uuid":"25d0a88d-9c35-4a39-809f-7adfc0833bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6824","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6825","nonce":1592752433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6826","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6827","nonce":1592752433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6830","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6831","nonce":1592752433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6828","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6829","nonce":1592752433}]},"public_addr":"10.20.193.153:6825/1592752433","cluster_addr":"10.20.193.153:6827/1592752433","heartbeat_back_addr":"10.20.193.153:6831/1592752433","heartbeat_front_addr":"10.20.193.153:6829/1592752433","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:31.826317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:41.551881+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:50.391122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:59.141852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:17.517921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:26.636353+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:35.670150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.104:0/2181220307":"2026-02-18T20:57:03.624371+0000","10.20.193.104:0/1441972685":"2026-02-18T20:57:03.624371+0000","10.20.193.104:0/1658112270":"2026-02-18T20:56:38.012869+0000","10.20.193.104:0/501037198":"2026-02-18T20:56:38.012869+0000","10.20.193.104:6801/3247908774":"2026-02-18T20:56:38.012869+0000","10.20.193.104:0/2902766949":"2026-02-18T20:56:38.012869+0000","10.20.193.104:0/1424534119":"2026-02-18T20:56:47.530062+0000","10.20.193.104:0/413298199":"2026-02-18T20:56:47.530062+0000","10.20.193.104:6800/95322277":"2026-02-18T20:56:47.530062+0000","10.20.193.104:0/1013639580":"2026-02-18T20:57:03.624371+0000","10.20.193.104:6801/1034073782":"2026-02-18T20:57:03.624371+0000","10.20.193.104:6800/3247908774":"2026-02-18T20:56:38.012869+0000","10.20.193.104:6801/95322277":"2026-02-18T20:56:47.530062+0000","10.20.193.104:0/1181662162":"2026-02-18T20:56:47.530062+0000","10.20.193.104:6800/1034073782":"2026-02-18T20:57:03.624371+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:58:38.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.700+0000 7fec811ec640 1 -- 10.20.193.104:0/1444903693 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fec50077550 msgr2=0x7fec50079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:38.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.700+0000 7fec811ec640 1 --2- 10.20.193.104:0/1444903693 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fec50077550 0x7fec50079a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fec70004700 tx=0x7fec70009290 comp rx=0 tx=0).stop 2026-02-17T20:58:38.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.700+0000 7fec811ec640 1 -- 10.20.193.104:0/1444903693 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fec7c10a8c0 msgr2=0x7fec7c1a2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:38.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.700+0000 7fec811ec640 1 --2- 10.20.193.104:0/1444903693 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fec7c10a8c0 0x7fec7c1a2b20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fec64038500 tx=0x7fec6402fd20 comp rx=0 tx=0).stop 2026-02-17T20:58:38.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.700+0000 7fec811ec640 1 -- 10.20.193.104:0/1444903693 shutdown_connections 2026-02-17T20:58:38.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.700+0000 7fec811ec640 1 --2- 10.20.193.104:0/1444903693 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fec50077550 0x7fec50079a10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:38.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.700+0000 7fec811ec640 1 --2- 10.20.193.104:0/1444903693 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fec7c10a8c0 0x7fec7c1a2b20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:38.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.700+0000 7fec811ec640 1 --2- 10.20.193.104:0/1444903693 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fec7c1048c0 0x7fec7c1a25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:38.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.700+0000 7fec811ec640 1 -- 10.20.193.104:0/1444903693 >> 10.20.193.104:0/1444903693 conn(0x7fec7c1005c0 msgr2=0x7fec7c101710 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:38.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.700+0000 7fec811ec640 1 -- 10.20.193.104:0/1444903693 shutdown_connections 2026-02-17T20:58:38.705 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.700+0000 7fec811ec640 1 -- 10.20.193.104:0/1444903693 wait complete. 2026-02-17T20:58:38.739 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-17T20:57:51.660976+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 7.889999866485596, 'score_stable': 7.889999866485596, 'optimal_score': 0.3799999952316284, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-17T20:58:38.740 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-17T20:58:38.892 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:39.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.999+0000 7f1823982640 1 -- 10.20.193.104:0/4224223584 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f181c10a8b0 msgr2=0x7f181c10ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:39.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.999+0000 7f1823982640 1 --2- 10.20.193.104:0/4224223584 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f181c10a8b0 0x7f181c10ac90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f180c0099b0 tx=0x7f180c02f220 comp rx=0 tx=0).stop 2026-02-17T20:58:39.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.999+0000 7f1823982640 1 -- 10.20.193.104:0/4224223584 shutdown_connections 2026-02-17T20:58:39.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.999+0000 7f1823982640 1 --2- 10.20.193.104:0/4224223584 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f181c1048b0 0x7f181c104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:39.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.999+0000 7f1823982640 1 --2- 10.20.193.104:0/4224223584 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f181c10a8b0 0x7f181c10ac90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:39.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.999+0000 7f1823982640 1 -- 10.20.193.104:0/4224223584 >> 10.20.193.104:0/4224223584 conn(0x7f181c100590 msgr2=0x7f181c1029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:39.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.999+0000 7f1823982640 1 -- 10.20.193.104:0/4224223584 shutdown_connections 2026-02-17T20:58:39.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:38.999+0000 7f1823982640 1 -- 10.20.193.104:0/4224223584 wait complete. 2026-02-17T20:58:39.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.000+0000 7f1823982640 1 Processor -- start 2026-02-17T20:58:39.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.000+0000 7f1823982640 1 -- start start 2026-02-17T20:58:39.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.000+0000 7f1823982640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f181c1048b0 0x7f181c1a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:39.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.000+0000 7f1823982640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f181c10a8b0 0x7f181c1a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:39.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.000+0000 7f1823982640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f181c111af0 con 0x7f181c1048b0 2026-02-17T20:58:39.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.000+0000 7f1823982640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f181c111970 con 0x7f181c10a8b0 2026-02-17T20:58:39.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.000+0000 7f18216f7640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f181c1048b0 0x7f181c1a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:39.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.000+0000 7f18216f7640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f181c1048b0 0x7f181c1a25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:40980/0 (socket says 10.20.193.104:40980) 2026-02-17T20:58:39.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.000+0000 7f18216f7640 1 -- 10.20.193.104:0/1872619305 learned_addr learned my addr 10.20.193.104:0/1872619305 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:39.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.000+0000 7f1820ef6640 1 --2- 10.20.193.104:0/1872619305 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f181c10a8b0 0x7f181c1a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:39.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.000+0000 7f18216f7640 1 -- 10.20.193.104:0/1872619305 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f181c10a8b0 msgr2=0x7f181c1a2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:39.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.000+0000 7f18216f7640 1 --2- 10.20.193.104:0/1872619305 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f181c10a8b0 0x7f181c1a2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:39.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.000+0000 7f18216f7640 1 -- 10.20.193.104:0/1872619305 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181c19c6a0 con 0x7f181c1048b0 2026-02-17T20:58:39.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.000+0000 7f1820ef6640 1 --2- 10.20.193.104:0/1872619305 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f181c10a8b0 0x7f181c1a2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T20:58:39.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.000+0000 7f18216f7640 1 --2- 10.20.193.104:0/1872619305 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f181c1048b0 0x7f181c1a25d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f180c009980 tx=0x7f180c02fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:39.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.000+0000 7f180a7fc640 1 -- 10.20.193.104:0/1872619305 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f180c004420 con 0x7f181c1048b0 2026-02-17T20:58:39.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.001+0000 7f1823982640 1 -- 10.20.193.104:0/1872619305 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181c19c930 con 0x7f181c1048b0 2026-02-17T20:58:39.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.001+0000 7f180a7fc640 1 -- 10.20.193.104:0/1872619305 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f180c038a40 con 0x7f181c1048b0 2026-02-17T20:58:39.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.001+0000 7f180a7fc640 1 -- 10.20.193.104:0/1872619305 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f180c0417e0 con 0x7f181c1048b0 2026-02-17T20:58:39.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.001+0000 7f1823982640 1 -- 10.20.193.104:0/1872619305 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f181c19ce30 con 0x7f181c1048b0 2026-02-17T20:58:39.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.001+0000 7f1823982640 1 -- 10.20.193.104:0/1872619305 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f181c105ff0 con 0x7f181c1048b0 2026-02-17T20:58:39.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.002+0000 7f180a7fc640 1 -- 10.20.193.104:0/1872619305 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f180c038bf0 con 0x7f181c1048b0 2026-02-17T20:58:39.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.002+0000 7f180a7fc640 1 --2- 10.20.193.104:0/1872619305 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f17f8077550 0x7f17f8079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:39.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.002+0000 7f1820ef6640 1 --2- 10.20.193.104:0/1872619305 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f17f8077550 0x7f17f8079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:39.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.002+0000 7f180a7fc640 1 -- 10.20.193.104:0/1872619305 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f180c03e070 con 0x7f181c1048b0 2026-02-17T20:58:39.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.002+0000 7f1820ef6640 1 --2- 10.20.193.104:0/1872619305 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f17f8077550 0x7f17f8079a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f181c19def0 tx=0x7f1810005f50 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:39.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.004+0000 7f180a7fc640 1 -- 10.20.193.104:0/1872619305 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f180c08b910 con 0x7f181c1048b0 2026-02-17T20:58:39.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.085+0000 7f1823982640 1 -- 10.20.193.104:0/1872619305 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f181c19d1a0 con 0x7f181c1048b0 2026-02-17T20:58:39.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.085+0000 7f180a7fc640 1 -- 10.20.193.104:0/1872619305 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) ==== 93+0+10 (secure 0 0 0) 0x7f180c0907c0 con 0x7f181c1048b0 2026-02-17T20:58:39.089 INFO:teuthology.orchestra.run.trial104.stdout:pg_num: 1 2026-02-17T20:58:39.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.086+0000 7f1823982640 1 -- 10.20.193.104:0/1872619305 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f17f8077550 msgr2=0x7f17f8079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:39.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.086+0000 7f1823982640 1 --2- 10.20.193.104:0/1872619305 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f17f8077550 0x7f17f8079a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f181c19def0 tx=0x7f1810005f50 comp rx=0 tx=0).stop 2026-02-17T20:58:39.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.086+0000 7f1823982640 1 -- 10.20.193.104:0/1872619305 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f181c1048b0 msgr2=0x7f181c1a25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:39.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.086+0000 7f1823982640 1 --2- 10.20.193.104:0/1872619305 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f181c1048b0 0x7f181c1a25d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f180c009980 tx=0x7f180c02fdf0 comp rx=0 tx=0).stop 2026-02-17T20:58:39.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.086+0000 7f1823982640 1 -- 10.20.193.104:0/1872619305 shutdown_connections 2026-02-17T20:58:39.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.086+0000 7f1823982640 1 --2- 10.20.193.104:0/1872619305 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f17f8077550 0x7f17f8079a10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:39.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.086+0000 7f1823982640 1 --2- 10.20.193.104:0/1872619305 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f181c10a8b0 0x7f181c1a2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:39.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.086+0000 7f1823982640 1 --2- 10.20.193.104:0/1872619305 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f181c1048b0 0x7f181c1a25d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:39.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.086+0000 7f1823982640 1 -- 10.20.193.104:0/1872619305 >> 10.20.193.104:0/1872619305 conn(0x7f181c100590 msgr2=0x7f181c1016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:39.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.086+0000 7f1823982640 1 -- 10.20.193.104:0/1872619305 shutdown_connections 2026-02-17T20:58:39.091 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.086+0000 7f1823982640 1 -- 10.20.193.104:0/1872619305 wait complete. 2026-02-17T20:58:39.126 INFO:tasks.cephadm:Setting up client nodes... 2026-02-17T20:58:39.126 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-17T20:58:39.159 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:38 trial104 ceph-mon[20612]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T20:58:39.159 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:38 trial104 ceph-mon[20612]: osdmap e47: 8 total, 8 up, 8 in 2026-02-17T20:58:39.160 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:38 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/4195617798' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T20:58:39.160 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:38 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/1444903693' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T20:58:39.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:38 trial153 ceph-mon[25357]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-17T20:58:39.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:38 trial153 ceph-mon[25357]: osdmap e47: 8 total, 8 up, 8 in 2026-02-17T20:58:39.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:38 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/4195617798' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2026-02-17T20:58:39.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:38 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/1444903693' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T20:58:39.277 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:39.389 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b1ae43640 1 -- 10.20.193.104:0/3074354221 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3b14104940 msgr2=0x7f3b14104d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:39.389 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b1ae43640 1 --2- 10.20.193.104:0/3074354221 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3b14104940 0x7f3b14104d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3b040099b0 tx=0x7f3b0402f220 comp rx=0 tx=0).stop 2026-02-17T20:58:39.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b1ae43640 1 -- 10.20.193.104:0/3074354221 shutdown_connections 2026-02-17T20:58:39.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b1ae43640 1 --2- 10.20.193.104:0/3074354221 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3b14105b40 0x7f3b14105fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:39.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b1ae43640 1 --2- 10.20.193.104:0/3074354221 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3b14104940 0x7f3b14104d40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:39.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b1ae43640 1 -- 10.20.193.104:0/3074354221 >> 10.20.193.104:0/3074354221 conn(0x7f3b141000d0 msgr2=0x7f3b14102510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:39.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b1ae43640 1 -- 10.20.193.104:0/3074354221 shutdown_connections 2026-02-17T20:58:39.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b1ae43640 1 -- 10.20.193.104:0/3074354221 wait complete. 2026-02-17T20:58:39.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b1ae43640 1 Processor -- start 2026-02-17T20:58:39.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b1ae43640 1 -- start start 2026-02-17T20:58:39.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b1ae43640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3b14104940 0x7f3b1419c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:39.390 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b1ae43640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3b14105b40 0x7f3b1419c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:39.391 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b1ae43640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1410d4f0 con 0x7f3b14105b40 2026-02-17T20:58:39.391 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b1ae43640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1410d370 con 0x7f3b14104940 2026-02-17T20:58:39.391 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b0bfff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3b14105b40 0x7f3b1419c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:39.391 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b0bfff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3b14105b40 0x7f3b1419c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41002/0 (socket says 10.20.193.104:41002) 2026-02-17T20:58:39.391 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b0bfff640 1 -- 10.20.193.104:0/2505541028 learned_addr learned my addr 10.20.193.104:0/2505541028 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:39.391 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b18bb8640 1 --2- 10.20.193.104:0/2505541028 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3b14104940 0x7f3b1419c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:39.391 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b0bfff640 1 -- 10.20.193.104:0/2505541028 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3b14104940 msgr2=0x7f3b1419c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:39.391 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b0bfff640 1 --2- 10.20.193.104:0/2505541028 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3b14104940 0x7f3b1419c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:39.392 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.384+0000 7f3b0bfff640 1 -- 10.20.193.104:0/2505541028 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1419cf00 con 0x7f3b14105b40 2026-02-17T20:58:39.392 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.385+0000 7f3b0bfff640 1 --2- 10.20.193.104:0/2505541028 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3b14105b40 0x7f3b1419c880 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00e9b0 tx=0x7f3afc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:39.392 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.385+0000 7f3b09ffb640 1 -- 10.20.193.104:0/2505541028 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f3afc00cbe0 con 0x7f3b14105b40 2026-02-17T20:58:39.392 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.385+0000 7f3b09ffb640 1 -- 10.20.193.104:0/2505541028 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f3afc004540 con 0x7f3b14105b40 2026-02-17T20:58:39.392 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.385+0000 7f3b1ae43640 1 -- 10.20.193.104:0/2505541028 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b141a1940 con 0x7f3b14105b40 2026-02-17T20:58:39.392 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.385+0000 7f3b09ffb640 1 -- 10.20.193.104:0/2505541028 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f3afc010430 con 0x7f3b14105b40 2026-02-17T20:58:39.392 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.385+0000 7f3b1ae43640 1 -- 10.20.193.104:0/2505541028 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b141a1f50 con 0x7f3b14105b40 2026-02-17T20:58:39.392 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.385+0000 7f3b1ae43640 1 -- 10.20.193.104:0/2505541028 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b14104d40 con 0x7f3b14105b40 2026-02-17T20:58:39.393 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.386+0000 7f3b09ffb640 1 -- 10.20.193.104:0/2505541028 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f3afc0040d0 con 0x7f3b14105b40 2026-02-17T20:58:39.393 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.386+0000 7f3b09ffb640 1 --2- 10.20.193.104:0/2505541028 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3af00775a0 0x7f3af0079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:39.393 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.386+0000 7f3b18bb8640 1 --2- 10.20.193.104:0/2505541028 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3af00775a0 0x7f3af0079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:39.393 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.386+0000 7f3b09ffb640 1 -- 10.20.193.104:0/2505541028 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f3afc099c90 con 0x7f3b14105b40 2026-02-17T20:58:39.393 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.387+0000 7f3b18bb8640 1 --2- 10.20.193.104:0/2505541028 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3af00775a0 0x7f3af0079a60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3b04002af0 tx=0x7f3b0403a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:39.393 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.388+0000 7f3b09ffb640 1 -- 10.20.193.104:0/2505541028 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f3afc066e60 con 0x7f3b14105b40 2026-02-17T20:58:39.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.500+0000 7f3b1ae43640 1 -- 10.20.193.104:0/2505541028 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f3b141a22e0 con 0x7f3b14105b40 2026-02-17T20:58:39.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.502+0000 7f3b09ffb640 1 -- 10.20.193.104:0/2505541028 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v18) ==== 170+0+59 (secure 0 0 0) 0x7f3afc06bd10 con 0x7f3b14105b40 2026-02-17T20:58:39.505 INFO:teuthology.orchestra.run.trial104.stdout:[client.0] 2026-02-17T20:58:39.505 INFO:teuthology.orchestra.run.trial104.stdout: key = AQB/1pRpUhH4HRAAjXYBSxxuhabeQAF2JPflaA== 2026-02-17T20:58:39.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.503+0000 7f3b1ae43640 1 -- 10.20.193.104:0/2505541028 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3af00775a0 msgr2=0x7f3af0079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:39.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.503+0000 7f3b1ae43640 1 --2- 10.20.193.104:0/2505541028 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3af00775a0 0x7f3af0079a60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3b04002af0 tx=0x7f3b0403a040 comp rx=0 tx=0).stop 2026-02-17T20:58:39.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.503+0000 7f3b1ae43640 1 -- 10.20.193.104:0/2505541028 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3b14105b40 msgr2=0x7f3b1419c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:39.506 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.503+0000 7f3b1ae43640 1 --2- 10.20.193.104:0/2505541028 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3b14105b40 0x7f3b1419c880 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3afc00e9b0 tx=0x7f3afc00ee80 comp rx=0 tx=0).stop 2026-02-17T20:58:39.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.503+0000 7f3b1ae43640 1 -- 10.20.193.104:0/2505541028 shutdown_connections 2026-02-17T20:58:39.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.503+0000 7f3b1ae43640 1 --2- 10.20.193.104:0/2505541028 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f3af00775a0 0x7f3af0079a60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:39.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.503+0000 7f3b1ae43640 1 --2- 10.20.193.104:0/2505541028 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f3b14105b40 0x7f3b1419c880 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:39.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.503+0000 7f3b1ae43640 1 --2- 10.20.193.104:0/2505541028 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f3b14104940 0x7f3b1419c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:39.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.503+0000 7f3b1ae43640 1 -- 10.20.193.104:0/2505541028 >> 10.20.193.104:0/2505541028 conn(0x7f3b141000d0 msgr2=0x7f3b14102510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:39.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.503+0000 7f3b1ae43640 1 -- 10.20.193.104:0/2505541028 shutdown_connections 2026-02-17T20:58:39.507 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:39.503+0000 7f3b1ae43640 1 -- 10.20.193.104:0/2505541028 wait complete. 2026-02-17T20:58:39.542 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:58:39.543 DEBUG:teuthology.orchestra.run.trial104:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-17T20:58:39.543 DEBUG:teuthology.orchestra.run.trial104:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-17T20:58:39.617 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-17T20:58:39.774 INFO:teuthology.orchestra.run.trial153.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial153/config 2026-02-17T20:58:39.882 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.877+0000 7fb5d22c2640 1 -- 10.20.193.153:0/2862139633 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb5cc1038c0 msgr2=0x7fb5cc103d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:39.883 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.877+0000 7fb5d22c2640 1 --2- 10.20.193.153:0/2862139633 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb5cc1038c0 0x7fb5cc103d40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc0099b0 tx=0x7fb5bc02f220 comp rx=0 tx=0).stop 2026-02-17T20:58:39.883 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.877+0000 7fb5d22c2640 1 -- 10.20.193.153:0/2862139633 shutdown_connections 2026-02-17T20:58:39.883 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.877+0000 7fb5d22c2640 1 --2- 10.20.193.153:0/2862139633 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb5cc1038c0 0x7fb5cc103d40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:39.883 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.877+0000 7fb5d22c2640 1 --2- 10.20.193.153:0/2862139633 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb5cc1026c0 0x7fb5cc102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:39.883 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.877+0000 7fb5d22c2640 1 -- 10.20.193.153:0/2862139633 >> 10.20.193.153:0/2862139633 conn(0x7fb5cc0fde90 msgr2=0x7fb5cc1002b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:39.883 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.877+0000 7fb5d22c2640 1 -- 10.20.193.153:0/2862139633 shutdown_connections 2026-02-17T20:58:39.883 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.877+0000 7fb5d22c2640 1 -- 10.20.193.153:0/2862139633 wait complete. 2026-02-17T20:58:39.883 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.877+0000 7fb5d22c2640 1 Processor -- start 2026-02-17T20:58:39.883 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5d22c2640 1 -- start start 2026-02-17T20:58:39.884 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5d22c2640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb5cc1026c0 0x7fb5cc19c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:39.884 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5d22c2640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb5cc1038c0 0x7fb5cc19c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:39.884 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5d22c2640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc10b2f0 con 0x7fb5cc1026c0 2026-02-17T20:58:39.884 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5d22c2640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb5cc10b170 con 0x7fb5cc1038c0 2026-02-17T20:58:39.884 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5cb7fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb5cc1038c0 0x7fb5cc19c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:39.884 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5cb7fe640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb5cc1038c0 0x7fb5cc19c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.153:35966/0 (socket says 10.20.193.153:35966) 2026-02-17T20:58:39.884 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5cb7fe640 1 -- 10.20.193.153:0/3223051417 learned_addr learned my addr 10.20.193.153:0/3223051417 (peer_addr_for_me v2:10.20.193.153:0/0) 2026-02-17T20:58:39.884 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5cb7fe640 1 -- 10.20.193.153:0/3223051417 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb5cc1026c0 msgr2=0x7fb5cc19c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:39.884 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5cb7fe640 1 --2- 10.20.193.153:0/3223051417 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb5cc1026c0 0x7fb5cc19c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:39.885 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5cb7fe640 1 -- 10.20.193.153:0/3223051417 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5cc19d000 con 0x7fb5cc1038c0 2026-02-17T20:58:39.885 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5cb7fe640 1 --2- 10.20.193.153:0/3223051417 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb5cc1038c0 0x7fb5cc19c980 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc004290 tx=0x7fb5bc0042c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:39.885 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5c97fa640 1 -- 10.20.193.153:0/3223051417 <== mon.1 v2:10.20.193.153:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb5bc046070 con 0x7fb5cc1038c0 2026-02-17T20:58:39.885 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5c97fa640 1 -- 10.20.193.153:0/3223051417 <== mon.1 v2:10.20.193.153:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fb5bc038c00 con 0x7fb5cc1038c0 2026-02-17T20:58:39.885 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5d22c2640 1 -- 10.20.193.153:0/3223051417 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5cc1a19e0 con 0x7fb5cc1038c0 2026-02-17T20:58:39.885 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5c97fa640 1 -- 10.20.193.153:0/3223051417 <== mon.1 v2:10.20.193.153:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb5bc041af0 con 0x7fb5cc1038c0 2026-02-17T20:58:39.885 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5d22c2640 1 -- 10.20.193.153:0/3223051417 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5cc1a1ff0 con 0x7fb5cc1038c0 2026-02-17T20:58:39.885 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.878+0000 7fb5d22c2640 1 -- 10.20.193.153:0/3223051417 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5cc102b40 con 0x7fb5cc1038c0 2026-02-17T20:58:39.885 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.879+0000 7fb5c97fa640 1 -- 10.20.193.153:0/3223051417 <== mon.1 v2:10.20.193.153:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7fb5bc038790 con 0x7fb5cc1038c0 2026-02-17T20:58:39.886 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.879+0000 7fb5c97fa640 1 --2- 10.20.193.153:0/3223051417 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb5a0077550 0x7fb5a0079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:39.886 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.879+0000 7fb5c97fa640 1 -- 10.20.193.153:0/3223051417 <== mon.1 v2:10.20.193.153:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7fb5bc03e070 con 0x7fb5cc1038c0 2026-02-17T20:58:39.887 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.880+0000 7fb5cbfff640 1 --2- 10.20.193.153:0/3223051417 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb5a0077550 0x7fb5a0079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:39.887 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.880+0000 7fb5cbfff640 1 --2- 10.20.193.153:0/3223051417 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb5a0077550 0x7fb5a0079a10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc103720 tx=0x7fb5b8006d90 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:39.887 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.882+0000 7fb5c97fa640 1 -- 10.20.193.153:0/3223051417 <== mon.1 v2:10.20.193.153:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fb5bc050020 con 0x7fb5cc1038c0 2026-02-17T20:58:39.998 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.994+0000 7fb5d22c2640 1 -- 10.20.193.153:0/3223051417 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fb5cc107ba0 con 0x7fb5cc1038c0 2026-02-17T20:58:40.001 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.997+0000 7fb5c97fa640 1 -- 10.20.193.153:0/3223051417 <== mon.1 v2:10.20.193.153:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v19) ==== 170+0+59 (secure 0 0 0) 0x7fb5cc107ba0 con 0x7fb5cc1038c0 2026-02-17T20:58:40.002 INFO:teuthology.orchestra.run.trial153.stdout:[client.1] 2026-02-17T20:58:40.002 INFO:teuthology.orchestra.run.trial153.stdout: key = AQB/1pRpxcFsOxAAINxnHGyPSkAWRYFy/Rml2w== 2026-02-17T20:58:40.004 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.997+0000 7fb5d22c2640 1 -- 10.20.193.153:0/3223051417 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb5a0077550 msgr2=0x7fb5a0079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:40.005 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.997+0000 7fb5d22c2640 1 --2- 10.20.193.153:0/3223051417 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb5a0077550 0x7fb5a0079a10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc103720 tx=0x7fb5b8006d90 comp rx=0 tx=0).stop 2026-02-17T20:58:40.005 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.997+0000 7fb5d22c2640 1 -- 10.20.193.153:0/3223051417 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb5cc1038c0 msgr2=0x7fb5cc19c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:40.005 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.997+0000 7fb5d22c2640 1 --2- 10.20.193.153:0/3223051417 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb5cc1038c0 0x7fb5cc19c980 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc004290 tx=0x7fb5bc0042c0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.006 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.997+0000 7fb5d22c2640 1 -- 10.20.193.153:0/3223051417 shutdown_connections 2026-02-17T20:58:40.006 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.997+0000 7fb5d22c2640 1 --2- 10.20.193.153:0/3223051417 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb5a0077550 0x7fb5a0079a10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.006 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.997+0000 7fb5d22c2640 1 --2- 10.20.193.153:0/3223051417 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb5cc1038c0 0x7fb5cc19c980 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.006 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.997+0000 7fb5d22c2640 1 --2- 10.20.193.153:0/3223051417 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb5cc1026c0 0x7fb5cc19c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.006 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.998+0000 7fb5d22c2640 1 -- 10.20.193.153:0/3223051417 >> 10.20.193.153:0/3223051417 conn(0x7fb5cc0fde90 msgr2=0x7fb5cc104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:40.007 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.998+0000 7fb5d22c2640 1 -- 10.20.193.153:0/3223051417 shutdown_connections 2026-02-17T20:58:40.007 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:58:39.998+0000 7fb5d22c2640 1 -- 10.20.193.153:0/3223051417 wait complete. 2026-02-17T20:58:40.037 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T20:58:40.037 DEBUG:teuthology.orchestra.run.trial153:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2026-02-17T20:58:40.038 DEBUG:teuthology.orchestra.run.trial153:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2026-02-17T20:58:40.072 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-17T20:58:40.072 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-17T20:58:40.072 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-17T20:58:40.223 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:40.266 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:40 trial104 ceph-mon[20612]: osdmap e48: 8 total, 8 up, 8 in 2026-02-17T20:58:40.266 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:40 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/1872619305' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-17T20:58:40.266 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:40 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/2505541028' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T20:58:40.266 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:40 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/2505541028' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-17T20:58:40.267 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:40 trial104 ceph-mon[20612]: from='client.? 10.20.193.153:0/3223051417' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T20:58:40.267 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:40 trial104 ceph-mon[20612]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T20:58:40.267 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:40 trial104 ceph-mon[20612]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-17T20:58:40.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:40 trial153 ceph-mon[25357]: osdmap e48: 8 total, 8 up, 8 in 2026-02-17T20:58:40.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:40 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/1872619305' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2026-02-17T20:58:40.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:40 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/2505541028' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T20:58:40.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:40 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/2505541028' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-17T20:58:40.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:40 trial153 ceph-mon[25357]: from='client.? 10.20.193.153:0/3223051417' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T20:58:40.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:40 trial153 ceph-mon[25357]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2026-02-17T20:58:40.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:40 trial153 ceph-mon[25357]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-17T20:58:40.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0742d16640 1 -- 10.20.193.104:0/4258177174 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f073c10a7f0 msgr2=0x7f073c10abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:40.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0742d16640 1 --2- 10.20.193.104:0/4258177174 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f073c10a7f0 0x7f073c10abd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f072c0099b0 tx=0x7f072c02f220 comp rx=0 tx=0).stop 2026-02-17T20:58:40.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0742d16640 1 -- 10.20.193.104:0/4258177174 shutdown_connections 2026-02-17T20:58:40.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0742d16640 1 --2- 10.20.193.104:0/4258177174 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f073c1046e0 0x7f073c104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0742d16640 1 --2- 10.20.193.104:0/4258177174 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f073c10a7f0 0x7f073c10abd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0742d16640 1 -- 10.20.193.104:0/4258177174 >> 10.20.193.104:0/4258177174 conn(0x7f073c1003e0 msgr2=0x7f073c102800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:40.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0742d16640 1 -- 10.20.193.104:0/4258177174 shutdown_connections 2026-02-17T20:58:40.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0742d16640 1 -- 10.20.193.104:0/4258177174 wait complete. 2026-02-17T20:58:40.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0742d16640 1 Processor -- start 2026-02-17T20:58:40.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0742d16640 1 -- start start 2026-02-17T20:58:40.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0742d16640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f073c1046e0 0x7f073c1a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:40.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0742d16640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f073c10a7f0 0x7f073c1a2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:40.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0742d16640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f073c111a30 con 0x7f073c10a7f0 2026-02-17T20:58:40.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0742d16640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f073c1118b0 con 0x7f073c1046e0 2026-02-17T20:58:40.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0741513640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f073c10a7f0 0x7f073c1a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:40.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0741513640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f073c10a7f0 0x7f073c1a2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41024/0 (socket says 10.20.193.104:41024) 2026-02-17T20:58:40.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0741513640 1 -- 10.20.193.104:0/1729231348 learned_addr learned my addr 10.20.193.104:0/1729231348 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:40.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0741d14640 1 --2- 10.20.193.104:0/1729231348 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f073c1046e0 0x7f073c1a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:40.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0741513640 1 -- 10.20.193.104:0/1729231348 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f073c1046e0 msgr2=0x7f073c1a23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:40.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0741513640 1 --2- 10.20.193.104:0/1729231348 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f073c1046e0 0x7f073c1a23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.323+0000 7f0741513640 1 -- 10.20.193.104:0/1729231348 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073c19c5a0 con 0x7f073c10a7f0 2026-02-17T20:58:40.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.324+0000 7f0741513640 1 --2- 10.20.193.104:0/1729231348 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f073c10a7f0 0x7f073c1a2920 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f073000d900 tx=0x7f073000ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:40.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.324+0000 7f072affd640 1 -- 10.20.193.104:0/1729231348 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0730014070 con 0x7f073c10a7f0 2026-02-17T20:58:40.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.324+0000 7f072affd640 1 -- 10.20.193.104:0/1729231348 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f07300044a0 con 0x7f073c10a7f0 2026-02-17T20:58:40.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.324+0000 7f0742d16640 1 -- 10.20.193.104:0/1729231348 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f073c19c890 con 0x7f073c10a7f0 2026-02-17T20:58:40.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.324+0000 7f072affd640 1 -- 10.20.193.104:0/1729231348 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f073000be00 con 0x7f073c10a7f0 2026-02-17T20:58:40.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.324+0000 7f0742d16640 1 -- 10.20.193.104:0/1729231348 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f073c19ce20 con 0x7f073c10a7f0 2026-02-17T20:58:40.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.324+0000 7f0742d16640 1 -- 10.20.193.104:0/1729231348 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f073c104b40 con 0x7f073c10a7f0 2026-02-17T20:58:40.330 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.325+0000 7f072affd640 1 -- 10.20.193.104:0/1729231348 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f07300047c0 con 0x7f073c10a7f0 2026-02-17T20:58:40.331 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.325+0000 7f072affd640 1 --2- 10.20.193.104:0/1729231348 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f07180775a0 0x7f0718079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:40.331 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.325+0000 7f072affd640 1 -- 10.20.193.104:0/1729231348 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f0730099980 con 0x7f073c10a7f0 2026-02-17T20:58:40.331 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.325+0000 7f0741d14640 1 --2- 10.20.193.104:0/1729231348 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f07180775a0 0x7f0718079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:40.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.326+0000 7f0741d14640 1 --2- 10.20.193.104:0/1729231348 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f07180775a0 0x7f0718079a60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f072c005ec0 tx=0x7f072c005e50 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:40.332 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.327+0000 7f072affd640 1 -- 10.20.193.104:0/1729231348 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0730066b50 con 0x7f073c10a7f0 2026-02-17T20:58:40.434 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.432+0000 7f0742d16640 1 -- 10.20.193.104:0/1729231348 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f073c105e50 con 0x7f073c10a7f0 2026-02-17T20:58:40.436 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.433+0000 7f072affd640 1 -- 10.20.193.104:0/1729231348 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+192110 (secure 0 0 0) 0x7f073006ba00 con 0x7f073c10a7f0 2026-02-17T20:58:40.438 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:40.440 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.435+0000 7f0742d16640 1 -- 10.20.193.104:0/1729231348 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f07180775a0 msgr2=0x7f0718079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:40.440 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.435+0000 7f0742d16640 1 --2- 10.20.193.104:0/1729231348 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f07180775a0 0x7f0718079a60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f072c005ec0 tx=0x7f072c005e50 comp rx=0 tx=0).stop 2026-02-17T20:58:40.440 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.435+0000 7f0742d16640 1 -- 10.20.193.104:0/1729231348 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f073c10a7f0 msgr2=0x7f073c1a2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:40.440 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.435+0000 7f0742d16640 1 --2- 10.20.193.104:0/1729231348 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f073c10a7f0 0x7f073c1a2920 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f073000d900 tx=0x7f073000ddd0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.435+0000 7f0742d16640 1 -- 10.20.193.104:0/1729231348 shutdown_connections 2026-02-17T20:58:40.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.435+0000 7f0742d16640 1 --2- 10.20.193.104:0/1729231348 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f07180775a0 0x7f0718079a60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.435+0000 7f0742d16640 1 --2- 10.20.193.104:0/1729231348 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f073c10a7f0 0x7f073c1a2920 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.435+0000 7f0742d16640 1 --2- 10.20.193.104:0/1729231348 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f073c1046e0 0x7f073c1a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.435+0000 7f0742d16640 1 -- 10.20.193.104:0/1729231348 >> 10.20.193.104:0/1729231348 conn(0x7f073c1003e0 msgr2=0x7f073c101180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:40.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.435+0000 7f0742d16640 1 -- 10.20.193.104:0/1729231348 shutdown_connections 2026-02-17T20:58:40.441 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.435+0000 7f0742d16640 1 -- 10.20.193.104:0/1729231348 wait complete. 2026-02-17T20:58:40.475 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":19,"flags":0,"active_gid":14203,"active_name":"trial104.irrhmt","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6800","nonce":2484917436},{"type":"v1","addr":"10.20.193.104:6801","nonce":2484917436}]},"active_addr":"10.20.193.104:6801/2484917436","active_change":"2026-02-17T20:57:03.624471+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14224,"name":"trial153.ivmqog","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number. if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://10.20.193.104:8443/","prometheus":"http://10.20.193.104:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.104:0","nonce":3350476027}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.104:0","nonce":315839719}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.104:0","nonce":2269836508}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.104:0","nonce":4196917720}]}]} 2026-02-17T20:58:40.488 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-17T20:58:40.488 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-17T20:58:40.489 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T20:58:40.643 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:40.745 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.740+0000 7f159d83c640 1 -- 10.20.193.104:0/3550008471 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f159810a8c0 msgr2=0x7f159810aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:40.745 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.740+0000 7f159d83c640 1 --2- 10.20.193.104:0/3550008471 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f159810a8c0 0x7f159810aca0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f158c0099b0 tx=0x7f158c02f220 comp rx=0 tx=0).stop 2026-02-17T20:58:40.746 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.740+0000 7f159d83c640 1 -- 10.20.193.104:0/3550008471 shutdown_connections 2026-02-17T20:58:40.746 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.740+0000 7f159d83c640 1 --2- 10.20.193.104:0/3550008471 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f15981048c0 0x7f1598104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.746 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.740+0000 7f159d83c640 1 --2- 10.20.193.104:0/3550008471 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f159810a8c0 0x7f159810aca0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.746 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.740+0000 7f159d83c640 1 -- 10.20.193.104:0/3550008471 >> 10.20.193.104:0/3550008471 conn(0x7f15981005c0 msgr2=0x7f15981029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:40.746 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.740+0000 7f159d83c640 1 -- 10.20.193.104:0/3550008471 shutdown_connections 2026-02-17T20:58:40.746 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.740+0000 7f159d83c640 1 -- 10.20.193.104:0/3550008471 wait complete. 2026-02-17T20:58:40.746 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.740+0000 7f159d83c640 1 Processor -- start 2026-02-17T20:58:40.747 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.740+0000 7f159d83c640 1 -- start start 2026-02-17T20:58:40.747 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f159d83c640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f15981048c0 0x7f15981a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:40.747 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f159d83c640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f159810a8c0 0x7f15981a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:40.747 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f159d83c640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1598111ae0 con 0x7f159810a8c0 2026-02-17T20:58:40.747 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f159d83c640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1598111960 con 0x7f15981048c0 2026-02-17T20:58:40.747 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f15967fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f159810a8c0 0x7f15981a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:40.748 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f15967fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f159810a8c0 0x7f15981a2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41038/0 (socket says 10.20.193.104:41038) 2026-02-17T20:58:40.748 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f15967fc640 1 -- 10.20.193.104:0/410110189 learned_addr learned my addr 10.20.193.104:0/410110189 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:40.748 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f1596ffd640 1 --2- 10.20.193.104:0/410110189 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f15981048c0 0x7f15981a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:40.748 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f15967fc640 1 -- 10.20.193.104:0/410110189 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f15981048c0 msgr2=0x7f15981a2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:40.748 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f15967fc640 1 --2- 10.20.193.104:0/410110189 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f15981048c0 0x7f15981a2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.748 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f15967fc640 1 -- 10.20.193.104:0/410110189 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159819c650 con 0x7f159810a8c0 2026-02-17T20:58:40.748 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f1596ffd640 1 --2- 10.20.193.104:0/410110189 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f15981048c0 0x7f15981a2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T20:58:40.748 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f15967fc640 1 --2- 10.20.193.104:0/410110189 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f159810a8c0 0x7f15981a2ac0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f158000d8d0 tx=0x7f158000dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:40.748 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f159c83a640 1 -- 10.20.193.104:0/410110189 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1580014070 con 0x7f159810a8c0 2026-02-17T20:58:40.748 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f159c83a640 1 -- 10.20.193.104:0/410110189 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f15800044a0 con 0x7f159810a8c0 2026-02-17T20:58:40.748 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f159d83c640 1 -- 10.20.193.104:0/410110189 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f159819c940 con 0x7f159810a8c0 2026-02-17T20:58:40.749 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f159c83a640 1 -- 10.20.193.104:0/410110189 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f1580005020 con 0x7f159810a8c0 2026-02-17T20:58:40.749 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f159d83c640 1 -- 10.20.193.104:0/410110189 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f159819cea0 con 0x7f159810a8c0 2026-02-17T20:58:40.749 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.741+0000 7f159d83c640 1 -- 10.20.193.104:0/410110189 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1598106000 con 0x7f159810a8c0 2026-02-17T20:58:40.749 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.742+0000 7f159c83a640 1 -- 10.20.193.104:0/410110189 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f15800052d0 con 0x7f159810a8c0 2026-02-17T20:58:40.749 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.743+0000 7f159c83a640 1 --2- 10.20.193.104:0/410110189 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f156c077550 0x7f156c079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:40.749 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.743+0000 7f159c83a640 1 -- 10.20.193.104:0/410110189 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f1580099b10 con 0x7f159810a8c0 2026-02-17T20:58:40.749 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.743+0000 7f1596ffd640 1 --2- 10.20.193.104:0/410110189 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f156c077550 0x7f156c079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:40.750 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.743+0000 7f1596ffd640 1 --2- 10.20.193.104:0/410110189 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f156c077550 0x7f156c079a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f158c004870 tx=0x7f158c0047e0 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:40.750 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.744+0000 7f159c83a640 1 -- 10.20.193.104:0/410110189 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f1580066c40 con 0x7f159810a8c0 2026-02-17T20:58:40.829 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.825+0000 7f159d83c640 1 -- 10.20.193.104:0/410110189 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1598104d20 con 0x7f159810a8c0 2026-02-17T20:58:40.829 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.826+0000 7f159c83a640 1 -- 10.20.193.104:0/410110189 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+13954 (secure 0 0 0) 0x7f158006baf0 con 0x7f159810a8c0 2026-02-17T20:58:40.830 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:40.830 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":48,"fsid":"19072504-0c43-11f1-93a3-d404e6e7d460","created":"2026-02-17T20:56:28.383257+0000","modified":"2026-02-17T20:58:38.997820+0000","last_up_change":"2026-02-17T20:58:36.991631+0000","last_in_change":"2026-02-17T20:58:24.285994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T20:57:51.660976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a22ae774-55bf-4c61-9328-96f1ad2a6a62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6802","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6803","nonce":438222704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6804","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6805","nonce":438222704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6808","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6809","nonce":438222704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6806","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6807","nonce":438222704}]},"public_addr":"10.20.193.104:6803/438222704","cluster_addr":"10.20.193.104:6805/438222704","heartbeat_back_addr":"10.20.193.104:6809/438222704","heartbeat_front_addr":"10.20.193.104:6807/438222704","state":["exists","up"]},{"osd":1,"uuid":"e221e89a-fd48-4e6f-a73d-a109718c9b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6810","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6811","nonce":1955490859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6812","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6813","nonce":1955490859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6816","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6817","nonce":1955490859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6814","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6815","nonce":1955490859}]},"public_addr":"10.20.193.104:6811/1955490859","cluster_addr":"10.20.193.104:6813/1955490859","heartbeat_back_addr":"10.20.193.104:6817/1955490859","heartbeat_front_addr":"10.20.193.104:6815/1955490859","state":["exists","up"]},{"osd":2,"uuid":"e0266db8-19cd-4ddb-a96a-cb84d2b0c4c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6818","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6819","nonce":3131863919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6820","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6821","nonce":3131863919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6824","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6825","nonce":3131863919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6822","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6823","nonce":3131863919}]},"public_addr":"10.20.193.104:6819/3131863919","cluster_addr":"10.20.193.104:6821/3131863919","heartbeat_back_addr":"10.20.193.104:6825/3131863919","heartbeat_front_addr":"10.20.193.104:6823/3131863919","state":["exists","up"]},{"osd":3,"uuid":"3b10ab50-7d78-4eea-b768-34534959a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6826","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6827","nonce":1948872135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6828","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6829","nonce":1948872135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6832","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6833","nonce":1948872135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6830","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6831","nonce":1948872135}]},"public_addr":"10.20.193.104:6827/1948872135","cluster_addr":"10.20.193.104:6829/1948872135","heartbeat_back_addr":"10.20.193.104:6833/1948872135","heartbeat_front_addr":"10.20.193.104:6831/1948872135","state":["exists","up"]},{"osd":4,"uuid":"d713875a-a825-474b-9ea5-cf8935174190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6800","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6801","nonce":250110565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6802","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6803","nonce":250110565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6806","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6807","nonce":250110565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6804","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6805","nonce":250110565}]},"public_addr":"10.20.193.153:6801/250110565","cluster_addr":"10.20.193.153:6803/250110565","heartbeat_back_addr":"10.20.193.153:6807/250110565","heartbeat_front_addr":"10.20.193.153:6805/250110565","state":["exists","up"]},{"osd":5,"uuid":"65f4195f-0129-41e5-931f-4b0a53ee6868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6808","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6809","nonce":2951447967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6810","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6811","nonce":2951447967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6814","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6815","nonce":2951447967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6812","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6813","nonce":2951447967}]},"public_addr":"10.20.193.153:6809/2951447967","cluster_addr":"10.20.193.153:6811/2951447967","heartbeat_back_addr":"10.20.193.153:6815/2951447967","heartbeat_front_addr":"10.20.193.153:6813/2951447967","state":["exists","up"]},{"osd":6,"uuid":"070da905-eb86-4405-a53f-fc3414a1ca70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6816","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6817","nonce":4066146238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6818","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6819","nonce":4066146238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6822","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6823","nonce":4066146238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6820","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6821","nonce":4066146238}]},"public_addr":"10.20.193.153:6817/4066146238","cluster_addr":"10.20.193.153:6819/4066146238","heartbeat_back_addr":"10.20.193.153:6823/4066146238","heartbeat_front_addr":"10.20.193.153:6821/4066146238","state":["exists","up"]},{"osd":7,"uuid":"25d0a88d-9c35-4a39-809f-7adfc0833bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6824","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6825","nonce":1592752433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6826","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6827","nonce":1592752433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6830","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6831","nonce":1592752433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6828","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6829","nonce":1592752433}]},"public_addr":"10.20.193.153:6825/1592752433","cluster_addr":"10.20.193.153:6827/1592752433","heartbeat_back_addr":"10.20.193.153:6831/1592752433","heartbeat_front_addr":"10.20.193.153:6829/1592752433","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:31.826317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:41.551881+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:50.391122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:59.141852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:08.326015+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:17.517921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:26.636353+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:35.670150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.104:0/2181220307":"2026-02-18T20:57:03.624371+0000","10.20.193.104:0/1441972685":"2026-02-18T20:57:03.624371+0000","10.20.193.104:0/1658112270":"2026-02-18T20:56:38.012869+0000","10.20.193.104:0/501037198":"2026-02-18T20:56:38.012869+0000","10.20.193.104:6801/3247908774":"2026-02-18T20:56:38.012869+0000","10.20.193.104:0/2902766949":"2026-02-18T20:56:38.012869+0000","10.20.193.104:0/1424534119":"2026-02-18T20:56:47.530062+0000","10.20.193.104:0/413298199":"2026-02-18T20:56:47.530062+0000","10.20.193.104:6800/95322277":"2026-02-18T20:56:47.530062+0000","10.20.193.104:0/1013639580":"2026-02-18T20:57:03.624371+0000","10.20.193.104:6801/1034073782":"2026-02-18T20:57:03.624371+0000","10.20.193.104:6800/3247908774":"2026-02-18T20:56:38.012869+0000","10.20.193.104:6801/95322277":"2026-02-18T20:56:47.530062+0000","10.20.193.104:0/1181662162":"2026-02-18T20:56:47.530062+0000","10.20.193.104:6800/1034073782":"2026-02-18T20:57:03.624371+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:58:40.831 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.826+0000 7f159d83c640 1 -- 10.20.193.104:0/410110189 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f156c077550 msgr2=0x7f156c079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:40.831 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.826+0000 7f159d83c640 1 --2- 10.20.193.104:0/410110189 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f156c077550 0x7f156c079a10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f158c004870 tx=0x7f158c0047e0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.831 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.826+0000 7f159d83c640 1 -- 10.20.193.104:0/410110189 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f159810a8c0 msgr2=0x7f15981a2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:40.831 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.826+0000 7f159d83c640 1 --2- 10.20.193.104:0/410110189 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f159810a8c0 0x7f15981a2ac0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f158000d8d0 tx=0x7f158000dda0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.832 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.826+0000 7f159d83c640 1 -- 10.20.193.104:0/410110189 shutdown_connections 2026-02-17T20:58:40.832 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.826+0000 7f159d83c640 1 --2- 10.20.193.104:0/410110189 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f156c077550 0x7f156c079a10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.832 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.826+0000 7f159d83c640 1 --2- 10.20.193.104:0/410110189 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f159810a8c0 0x7f15981a2ac0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.832 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.826+0000 7f159d83c640 1 --2- 10.20.193.104:0/410110189 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f15981048c0 0x7f15981a2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:40.832 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.826+0000 7f159d83c640 1 -- 10.20.193.104:0/410110189 >> 10.20.193.104:0/410110189 conn(0x7f15981005c0 msgr2=0x7f1598102770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:40.832 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.826+0000 7f159d83c640 1 -- 10.20.193.104:0/410110189 shutdown_connections 2026-02-17T20:58:40.832 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:40.827+0000 7f159d83c640 1 -- 10.20.193.104:0/410110189 wait complete. 2026-02-17T20:58:40.866 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-17T20:58:40.866 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T20:58:41.019 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:41.122 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036f3e8640 1 -- 10.20.193.104:0/1274878861 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0368077620 msgr2=0x7f0368077a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.122 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036f3e8640 1 --2- 10.20.193.104:0/1274878861 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0368077620 0x7f0368077a00 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f03580099b0 tx=0x7f035802f220 comp rx=0 tx=0).stop 2026-02-17T20:58:41.122 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036f3e8640 1 -- 10.20.193.104:0/1274878861 shutdown_connections 2026-02-17T20:58:41.122 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036f3e8640 1 --2- 10.20.193.104:0/1274878861 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0368077f40 0x7f0368113220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.122 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036f3e8640 1 --2- 10.20.193.104:0/1274878861 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0368077620 0x7f0368077a00 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.122 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036f3e8640 1 -- 10.20.193.104:0/1274878861 >> 10.20.193.104:0/1274878861 conn(0x7f03681005c0 msgr2=0x7f03681029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.122 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036f3e8640 1 -- 10.20.193.104:0/1274878861 shutdown_connections 2026-02-17T20:58:41.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036f3e8640 1 -- 10.20.193.104:0/1274878861 wait complete. 2026-02-17T20:58:41.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036f3e8640 1 Processor -- start 2026-02-17T20:58:41.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036f3e8640 1 -- start start 2026-02-17T20:58:41.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036f3e8640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0368077620 0x7f03681a0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036f3e8640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0368077f40 0x7f03681a1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036f3e8640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0368116020 con 0x7f0368077620 2026-02-17T20:58:41.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036f3e8640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0368115ea0 con 0x7f0368077f40 2026-02-17T20:58:41.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036d15d640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0368077620 0x7f03681a0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.123 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036d15d640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0368077620 0x7f03681a0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41046/0 (socket says 10.20.193.104:41046) 2026-02-17T20:58:41.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036d15d640 1 -- 10.20.193.104:0/973751783 learned_addr learned my addr 10.20.193.104:0/973751783 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:41.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.116+0000 7f036d15d640 1 -- 10.20.193.104:0/973751783 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0368077f40 msgr2=0x7f03681a1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.117+0000 7f036d15d640 1 --2- 10.20.193.104:0/973751783 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0368077f40 0x7f03681a1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.117+0000 7f036d15d640 1 -- 10.20.193.104:0/973751783 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03681a5610 con 0x7f0368077620 2026-02-17T20:58:41.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.117+0000 7f036d15d640 1 --2- 10.20.193.104:0/973751783 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0368077620 0x7f03681a0d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0358009980 tx=0x7f035802fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.117+0000 7f03567fc640 1 -- 10.20.193.104:0/973751783 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0358004420 con 0x7f0368077620 2026-02-17T20:58:41.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.117+0000 7f03567fc640 1 -- 10.20.193.104:0/973751783 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f0358038a40 con 0x7f0368077620 2026-02-17T20:58:41.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.117+0000 7f036f3e8640 1 -- 10.20.193.104:0/973751783 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03681a58a0 con 0x7f0368077620 2026-02-17T20:58:41.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.117+0000 7f03567fc640 1 -- 10.20.193.104:0/973751783 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f03580417e0 con 0x7f0368077620 2026-02-17T20:58:41.124 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.117+0000 7f036f3e8640 1 -- 10.20.193.104:0/973751783 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03681a5dd0 con 0x7f0368077620 2026-02-17T20:58:41.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.117+0000 7f036f3e8640 1 -- 10.20.193.104:0/973751783 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0368078d60 con 0x7f0368077620 2026-02-17T20:58:41.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.118+0000 7f03567fc640 1 -- 10.20.193.104:0/973751783 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f0358038bf0 con 0x7f0368077620 2026-02-17T20:58:41.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.118+0000 7f03567fc640 1 --2- 10.20.193.104:0/973751783 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0344077550 0x7f0344079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.118+0000 7f036c95c640 1 --2- 10.20.193.104:0/973751783 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0344077550 0x7f0344079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.118+0000 7f03567fc640 1 -- 10.20.193.104:0/973751783 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f035803e070 con 0x7f0368077620 2026-02-17T20:58:41.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.119+0000 7f036c95c640 1 --2- 10.20.193.104:0/973751783 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0344077550 0x7f0344079a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f035c005e00 tx=0x7f035c005d70 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.125 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.120+0000 7f03567fc640 1 -- 10.20.193.104:0/973751783 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f035808b530 con 0x7f0368077620 2026-02-17T20:58:41.206 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.204+0000 7f036f3e8640 1 -- 10.20.193.104:0/973751783 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03681a6080 con 0x7f0368077620 2026-02-17T20:58:41.207 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.204+0000 7f03567fc640 1 -- 10.20.193.104:0/973751783 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+13954 (secure 0 0 0) 0x7f03580903e0 con 0x7f0368077620 2026-02-17T20:58:41.208 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:41.208 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":48,"fsid":"19072504-0c43-11f1-93a3-d404e6e7d460","created":"2026-02-17T20:56:28.383257+0000","modified":"2026-02-17T20:58:38.997820+0000","last_up_change":"2026-02-17T20:58:36.991631+0000","last_in_change":"2026-02-17T20:58:24.285994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T20:57:51.660976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a22ae774-55bf-4c61-9328-96f1ad2a6a62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6802","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6803","nonce":438222704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6804","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6805","nonce":438222704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6808","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6809","nonce":438222704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6806","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6807","nonce":438222704}]},"public_addr":"10.20.193.104:6803/438222704","cluster_addr":"10.20.193.104:6805/438222704","heartbeat_back_addr":"10.20.193.104:6809/438222704","heartbeat_front_addr":"10.20.193.104:6807/438222704","state":["exists","up"]},{"osd":1,"uuid":"e221e89a-fd48-4e6f-a73d-a109718c9b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6810","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6811","nonce":1955490859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6812","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6813","nonce":1955490859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6816","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6817","nonce":1955490859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6814","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6815","nonce":1955490859}]},"public_addr":"10.20.193.104:6811/1955490859","cluster_addr":"10.20.193.104:6813/1955490859","heartbeat_back_addr":"10.20.193.104:6817/1955490859","heartbeat_front_addr":"10.20.193.104:6815/1955490859","state":["exists","up"]},{"osd":2,"uuid":"e0266db8-19cd-4ddb-a96a-cb84d2b0c4c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6818","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6819","nonce":3131863919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6820","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6821","nonce":3131863919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6824","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6825","nonce":3131863919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6822","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6823","nonce":3131863919}]},"public_addr":"10.20.193.104:6819/3131863919","cluster_addr":"10.20.193.104:6821/3131863919","heartbeat_back_addr":"10.20.193.104:6825/3131863919","heartbeat_front_addr":"10.20.193.104:6823/3131863919","state":["exists","up"]},{"osd":3,"uuid":"3b10ab50-7d78-4eea-b768-34534959a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6826","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6827","nonce":1948872135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6828","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6829","nonce":1948872135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6832","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6833","nonce":1948872135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6830","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6831","nonce":1948872135}]},"public_addr":"10.20.193.104:6827/1948872135","cluster_addr":"10.20.193.104:6829/1948872135","heartbeat_back_addr":"10.20.193.104:6833/1948872135","heartbeat_front_addr":"10.20.193.104:6831/1948872135","state":["exists","up"]},{"osd":4,"uuid":"d713875a-a825-474b-9ea5-cf8935174190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6800","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6801","nonce":250110565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6802","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6803","nonce":250110565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6806","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6807","nonce":250110565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6804","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6805","nonce":250110565}]},"public_addr":"10.20.193.153:6801/250110565","cluster_addr":"10.20.193.153:6803/250110565","heartbeat_back_addr":"10.20.193.153:6807/250110565","heartbeat_front_addr":"10.20.193.153:6805/250110565","state":["exists","up"]},{"osd":5,"uuid":"65f4195f-0129-41e5-931f-4b0a53ee6868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6808","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6809","nonce":2951447967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6810","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6811","nonce":2951447967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6814","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6815","nonce":2951447967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6812","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6813","nonce":2951447967}]},"public_addr":"10.20.193.153:6809/2951447967","cluster_addr":"10.20.193.153:6811/2951447967","heartbeat_back_addr":"10.20.193.153:6815/2951447967","heartbeat_front_addr":"10.20.193.153:6813/2951447967","state":["exists","up"]},{"osd":6,"uuid":"070da905-eb86-4405-a53f-fc3414a1ca70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6816","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6817","nonce":4066146238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6818","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6819","nonce":4066146238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6822","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6823","nonce":4066146238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6820","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6821","nonce":4066146238}]},"public_addr":"10.20.193.153:6817/4066146238","cluster_addr":"10.20.193.153:6819/4066146238","heartbeat_back_addr":"10.20.193.153:6823/4066146238","heartbeat_front_addr":"10.20.193.153:6821/4066146238","state":["exists","up"]},{"osd":7,"uuid":"25d0a88d-9c35-4a39-809f-7adfc0833bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6824","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6825","nonce":1592752433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6826","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6827","nonce":1592752433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6830","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6831","nonce":1592752433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6828","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6829","nonce":1592752433}]},"public_addr":"10.20.193.153:6825/1592752433","cluster_addr":"10.20.193.153:6827/1592752433","heartbeat_back_addr":"10.20.193.153:6831/1592752433","heartbeat_front_addr":"10.20.193.153:6829/1592752433","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:31.826317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:41.551881+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:50.391122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:59.141852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:08.326015+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:17.517921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:26.636353+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:35.670150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.104:0/2181220307":"2026-02-18T20:57:03.624371+0000","10.20.193.104:0/1441972685":"2026-02-18T20:57:03.624371+0000","10.20.193.104:0/1658112270":"2026-02-18T20:56:38.012869+0000","10.20.193.104:0/501037198":"2026-02-18T20:56:38.012869+0000","10.20.193.104:6801/3247908774":"2026-02-18T20:56:38.012869+0000","10.20.193.104:0/2902766949":"2026-02-18T20:56:38.012869+0000","10.20.193.104:0/1424534119":"2026-02-18T20:56:47.530062+0000","10.20.193.104:0/413298199":"2026-02-18T20:56:47.530062+0000","10.20.193.104:6800/95322277":"2026-02-18T20:56:47.530062+0000","10.20.193.104:0/1013639580":"2026-02-18T20:57:03.624371+0000","10.20.193.104:6801/1034073782":"2026-02-18T20:57:03.624371+0000","10.20.193.104:6800/3247908774":"2026-02-18T20:56:38.012869+0000","10.20.193.104:6801/95322277":"2026-02-18T20:56:47.530062+0000","10.20.193.104:0/1181662162":"2026-02-18T20:56:47.530062+0000","10.20.193.104:6800/1034073782":"2026-02-18T20:57:03.624371+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:58:41.209 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.205+0000 7f036f3e8640 1 -- 10.20.193.104:0/973751783 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0344077550 msgr2=0x7f0344079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.209 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.205+0000 7f036f3e8640 1 --2- 10.20.193.104:0/973751783 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0344077550 0x7f0344079a10 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f035c005e00 tx=0x7f035c005d70 comp rx=0 tx=0).stop 2026-02-17T20:58:41.209 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.205+0000 7f036f3e8640 1 -- 10.20.193.104:0/973751783 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0368077620 msgr2=0x7f03681a0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.209 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.205+0000 7f036f3e8640 1 --2- 10.20.193.104:0/973751783 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0368077620 0x7f03681a0d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0358009980 tx=0x7f035802fdf0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.209 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.205+0000 7f036f3e8640 1 -- 10.20.193.104:0/973751783 shutdown_connections 2026-02-17T20:58:41.209 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.205+0000 7f036f3e8640 1 --2- 10.20.193.104:0/973751783 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0344077550 0x7f0344079a10 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.210 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.205+0000 7f036f3e8640 1 --2- 10.20.193.104:0/973751783 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0368077f40 0x7f03681a1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.210 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.205+0000 7f036f3e8640 1 --2- 10.20.193.104:0/973751783 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0368077620 0x7f03681a0d40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.210 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.205+0000 7f036f3e8640 1 -- 10.20.193.104:0/973751783 >> 10.20.193.104:0/973751783 conn(0x7f03681005c0 msgr2=0x7f0368101250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.210 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.205+0000 7f036f3e8640 1 -- 10.20.193.104:0/973751783 shutdown_connections 2026-02-17T20:58:41.210 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.205+0000 7f036f3e8640 1 -- 10.20.193.104:0/973751783 wait complete. 2026-02-17T20:58:41.244 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-17T20:58:41.245 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-17T20:58:41.245 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-17T20:58:41.246 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-17T20:58:41.246 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-17T20:58:41.246 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-17T20:58:41.247 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-17T20:58:41.247 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-17T20:58:41.271 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:41 trial104 ceph-mon[20612]: pgmap v84: 1 pgs: 1 peering; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T20:58:41.272 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:41 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/1729231348' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-17T20:58:41.272 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:41 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/410110189' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T20:58:41.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:41 trial153 ceph-mon[25357]: pgmap v84: 1 pgs: 1 peering; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T20:58:41.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:41 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/1729231348' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2026-02-17T20:58:41.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:41 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/410110189' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T20:58:41.457 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:41.458 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:41.458 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:41.469 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:41.470 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:41.470 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:41.471 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:41.472 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:41.572 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.568+0000 7f1008e27640 1 -- 10.20.193.104:0/25441932 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f100410a8c0 msgr2=0x7f100410aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.572 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.568+0000 7f1008e27640 1 --2- 10.20.193.104:0/25441932 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f100410a8c0 0x7f100410aca0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0ff80099b0 tx=0x7f0ff802f220 comp rx=0 tx=0).stop 2026-02-17T20:58:41.572 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.568+0000 7f1008e27640 1 -- 10.20.193.104:0/25441932 shutdown_connections 2026-02-17T20:58:41.573 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.568+0000 7f1008e27640 1 --2- 10.20.193.104:0/25441932 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f10041048c0 0x7f1004104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.573 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.568+0000 7f1008e27640 1 --2- 10.20.193.104:0/25441932 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f100410a8c0 0x7f100410aca0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.573 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f1008e27640 1 -- 10.20.193.104:0/25441932 >> 10.20.193.104:0/25441932 conn(0x7f10041005c0 msgr2=0x7f10041029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.573 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f1008e27640 1 -- 10.20.193.104:0/25441932 shutdown_connections 2026-02-17T20:58:41.573 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f1008e27640 1 -- 10.20.193.104:0/25441932 wait complete. 2026-02-17T20:58:41.573 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.568+0000 7fb9bcef1640 1 -- 10.20.193.104:0/247537744 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb9b810a8b0 msgr2=0x7fb9b810ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.573 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.568+0000 7fb9bcef1640 1 --2- 10.20.193.104:0/247537744 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb9b810a8b0 0x7fb9b810ac90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac0099b0 tx=0x7fb9ac02f220 comp rx=0 tx=0).stop 2026-02-17T20:58:41.574 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.568+0000 7fb9bcef1640 1 -- 10.20.193.104:0/247537744 shutdown_connections 2026-02-17T20:58:41.574 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.568+0000 7fb9bcef1640 1 --2- 10.20.193.104:0/247537744 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb9b81048b0 0x7fb9b8104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.574 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.568+0000 7fb9bcef1640 1 --2- 10.20.193.104:0/247537744 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb9b810a8b0 0x7fb9b810ac90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.574 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.568+0000 7fb9bcef1640 1 -- 10.20.193.104:0/247537744 >> 10.20.193.104:0/247537744 conn(0x7fb9b8100590 msgr2=0x7fb9b81029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.574 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.568+0000 7fb9bcef1640 1 -- 10.20.193.104:0/247537744 shutdown_connections 2026-02-17T20:58:41.574 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.568+0000 7fb9bcef1640 1 -- 10.20.193.104:0/247537744 wait complete. 2026-02-17T20:58:41.574 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7fb9bcef1640 1 Processor -- start 2026-02-17T20:58:41.574 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7fb9bcef1640 1 -- start start 2026-02-17T20:58:41.575 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f661a205640 1 -- 10.20.193.104:0/187572451 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6614108660 msgr2=0x7f6614108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.575 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f661a205640 1 --2- 10.20.193.104:0/187572451 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6614108660 0x7f6614108a40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f66000099b0 tx=0x7f660002f220 comp rx=0 tx=0).stop 2026-02-17T20:58:41.575 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f661a205640 1 -- 10.20.193.104:0/187572451 shutdown_connections 2026-02-17T20:58:41.575 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f661a205640 1 --2- 10.20.193.104:0/187572451 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6614102660 0x7f6614102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.575 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f661a205640 1 --2- 10.20.193.104:0/187572451 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6614108660 0x7f6614108a40 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.575 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f661a205640 1 -- 10.20.193.104:0/187572451 >> 10.20.193.104:0/187572451 conn(0x7f66140fe380 msgr2=0x7f66141007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.575 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f661a205640 1 -- 10.20.193.104:0/187572451 shutdown_connections 2026-02-17T20:58:41.575 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f661a205640 1 -- 10.20.193.104:0/187572451 wait complete. 2026-02-17T20:58:41.576 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f1008e27640 1 Processor -- start 2026-02-17T20:58:41.576 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f1008e27640 1 -- start start 2026-02-17T20:58:41.576 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7fb9bcef1640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb9b81048b0 0x7fb9b81a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f1008e27640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f10041048c0 0x7f1004077600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f1008e27640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f100410a8c0 0x7f1004077b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f1008e27640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f1004111b00 con 0x7f10041048c0 2026-02-17T20:58:41.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f1008e27640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f1004111980 con 0x7f100410a8c0 2026-02-17T20:58:41.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f1002575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f10041048c0 0x7f1004077600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7fb9bcef1640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb9b810a8b0 0x7fb9b81a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7fb9bcef1640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b8111ad0 con 0x7fb9b810a8b0 2026-02-17T20:58:41.577 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7fb9bcef1640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fb9b8111950 con 0x7fb9b81048b0 2026-02-17T20:58:41.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f1002575640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f10041048c0 0x7f1004077600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41076/0 (socket says 10.20.193.104:41076) 2026-02-17T20:58:41.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f1002575640 1 -- 10.20.193.104:0/3157915095 learned_addr learned my addr 10.20.193.104:0/3157915095 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:41.578 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7fb9b5d74640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb9b810a8b0 0x7fb9b81a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7fb9b5d74640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb9b810a8b0 0x7fb9b81a2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41078/0 (socket says 10.20.193.104:41078) 2026-02-17T20:58:41.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7fb9b5d74640 1 -- 10.20.193.104:0/4268515595 learned_addr learned my addr 10.20.193.104:0/4268515595 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:41.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f1001d74640 1 --2- 10.20.193.104:0/3157915095 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f100410a8c0 0x7f1004077b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f1002575640 1 -- 10.20.193.104:0/3157915095 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f100410a8c0 msgr2=0x7f1004077b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.569+0000 7f1002575640 1 --2- 10.20.193.104:0/3157915095 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f100410a8c0 0x7f1004077b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.579 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f1002575640 1 -- 10.20.193.104:0/3157915095 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100407b7b0 con 0x7f10041048c0 2026-02-17T20:58:41.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f661a205640 1 Processor -- start 2026-02-17T20:58:41.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7fb9b6575640 1 --2- 10.20.193.104:0/4268515595 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb9b81048b0 0x7fb9b81a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.580 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f661a205640 1 -- start start 2026-02-17T20:58:41.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f1002575640 1 --2- 10.20.193.104:0/3157915095 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f10041048c0 0x7f1004077600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0ff802f730 tx=0x7f0ff802fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7fb9b5d74640 1 -- 10.20.193.104:0/4268515595 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb9b81048b0 msgr2=0x7fb9b81a25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.581 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7fb9b5d74640 1 --2- 10.20.193.104:0/4268515595 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb9b81048b0 0x7fb9b81a25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7fb9b5d74640 1 -- 10.20.193.104:0/4268515595 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9b819c6a0 con 0x7fb9b810a8b0 2026-02-17T20:58:41.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f0feb7fe640 1 -- 10.20.193.104:0/3157915095 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0ff8004260 con 0x7f10041048c0 2026-02-17T20:58:41.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f661a205640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6614102660 0x7f6614075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.582 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f661a205640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6614108660 0x7f66140758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f661a205640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f661410f900 con 0x7f6614102660 2026-02-17T20:58:41.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f661a205640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f661410f780 con 0x7f6614108660 2026-02-17T20:58:41.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f1008e27640 1 -- 10.20.193.104:0/3157915095 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1004078080 con 0x7f10041048c0 2026-02-17T20:58:41.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7fb9b5d74640 1 --2- 10.20.193.104:0/4268515595 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb9b810a8b0 0x7fb9b81a2b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000d8d0 tx=0x7fb9a000dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f1008e27640 1 -- 10.20.193.104:0/3157915095 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10041ab020 con 0x7f10041048c0 2026-02-17T20:58:41.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f0feb7fe640 1 -- 10.20.193.104:0/3157915095 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f0ff8004400 con 0x7f10041048c0 2026-02-17T20:58:41.584 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f0feb7fe640 1 -- 10.20.193.104:0/3157915095 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0ff8041770 con 0x7f10041048c0 2026-02-17T20:58:41.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f66137fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6614102660 0x7f6614075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f66137fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6614102660 0x7f6614075370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41090/0 (socket says 10.20.193.104:41090) 2026-02-17T20:58:41.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f66137fe640 1 -- 10.20.193.104:0/1587280656 learned_addr learned my addr 10.20.193.104:0/1587280656 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:41.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f6612ffd640 1 --2- 10.20.193.104:0/1587280656 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6614108660 0x7f66140758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7fb99f7fe640 1 -- 10.20.193.104:0/4268515595 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb9a0014070 con 0x7fb9b810a8b0 2026-02-17T20:58:41.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7fb9bcef1640 1 -- 10.20.193.104:0/4268515595 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9b819c990 con 0x7fb9b810a8b0 2026-02-17T20:58:41.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7fb99f7fe640 1 -- 10.20.193.104:0/4268515595 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fb9a00044a0 con 0x7fb9b810a8b0 2026-02-17T20:58:41.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7fb99f7fe640 1 -- 10.20.193.104:0/4268515595 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fb9a0002dc0 con 0x7fb9b810a8b0 2026-02-17T20:58:41.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7fb9bcef1640 1 -- 10.20.193.104:0/4268515595 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9b819cef0 con 0x7fb9b810a8b0 2026-02-17T20:58:41.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f66137fe640 1 -- 10.20.193.104:0/1587280656 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6614108660 msgr2=0x7f66140758b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f66137fe640 1 --2- 10.20.193.104:0/1587280656 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6614108660 0x7f66140758b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f66137fe640 1 -- 10.20.193.104:0/1587280656 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6614075df0 con 0x7f6614102660 2026-02-17T20:58:41.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f1008e27640 1 -- 10.20.193.104:0/3157915095 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f10040633d0 con 0x7f10041048c0 2026-02-17T20:58:41.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f66137fe640 1 --2- 10.20.193.104:0/1587280656 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6614102660 0x7f6614075370 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f660002f730 tx=0x7f6600002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f82bd74b640 1 -- 10.20.193.104:0/1616833350 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f82b8104150 msgr2=0x7f82b810c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f82bd74b640 1 --2- 10.20.193.104:0/1616833350 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f82b8104150 0x7f82b810c640 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f82a00099e0 tx=0x7f82a002f2f0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f82bd74b640 1 -- 10.20.193.104:0/1616833350 shutdown_connections 2026-02-17T20:58:41.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f82bd74b640 1 --2- 10.20.193.104:0/1616833350 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f82b8104150 0x7f82b810c640 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f82bd74b640 1 --2- 10.20.193.104:0/1616833350 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f82b8103830 0x7f82b8103c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f82bd74b640 1 -- 10.20.193.104:0/1616833350 >> 10.20.193.104:0/1616833350 conn(0x7f82b80fd1f0 msgr2=0x7f82b80ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f82bd74b640 1 -- 10.20.193.104:0/1616833350 shutdown_connections 2026-02-17T20:58:41.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.570+0000 7f82bd74b640 1 -- 10.20.193.104:0/1616833350 wait complete. 2026-02-17T20:58:41.590 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7fb9bcef1640 1 -- 10.20.193.104:0/4268515595 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb9b819d450 con 0x7fb9b810a8b0 2026-02-17T20:58:41.591 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f82bd74b640 1 Processor -- start 2026-02-17T20:58:41.591 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f82bd74b640 1 -- start start 2026-02-17T20:58:41.591 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f82bd74b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f82b8103830 0x7f82b81a2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f82bd74b640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f82b8104150 0x7f82b81a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f82bd74b640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f82b810f870 con 0x7f82b8103830 2026-02-17T20:58:41.592 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f82bd74b640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f82b810f6f0 con 0x7f82b8104150 2026-02-17T20:58:41.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f6610ff9640 1 -- 10.20.193.104:0/1587280656 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6600038470 con 0x7f6614102660 2026-02-17T20:58:41.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f661a205640 1 -- 10.20.193.104:0/1587280656 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6614076080 con 0x7f6614102660 2026-02-17T20:58:41.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f82b6ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f82b8103830 0x7f82b81a2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.593 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f661a205640 1 -- 10.20.193.104:0/1587280656 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66141a6bb0 con 0x7f6614102660 2026-02-17T20:58:41.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f6610ff9640 1 -- 10.20.193.104:0/1587280656 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f6600038a80 con 0x7f6614102660 2026-02-17T20:58:41.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f82b6ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f82b8103830 0x7f82b81a2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41102/0 (socket says 10.20.193.104:41102) 2026-02-17T20:58:41.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f82b6ffd640 1 -- 10.20.193.104:0/1827968765 learned_addr learned my addr 10.20.193.104:0/1827968765 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:41.594 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f6610ff9640 1 -- 10.20.193.104:0/1587280656 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6600041950 con 0x7f6614102660 2026-02-17T20:58:41.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f82b67fc640 1 --2- 10.20.193.104:0/1827968765 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f82b8104150 0x7f82b81a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f82b6ffd640 1 -- 10.20.193.104:0/1827968765 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f82b8104150 msgr2=0x7f82b81a2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f82b6ffd640 1 --2- 10.20.193.104:0/1827968765 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f82b8104150 0x7f82b81a2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f82b6ffd640 1 -- 10.20.193.104:0/1827968765 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b819c660 con 0x7f82b8103830 2026-02-17T20:58:41.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f82b67fc640 1 --2- 10.20.193.104:0/1827968765 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f82b8104150 0x7f82b81a2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-17T20:58:41.595 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f82b6ffd640 1 --2- 10.20.193.104:0/1827968765 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f82b8103830 0x7f82b81a2590 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00d8d0 tx=0x7f82ac00dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.596 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.571+0000 7f0feb7fe640 1 -- 10.20.193.104:0/3157915095 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f0ff80385d0 con 0x7f10041048c0 2026-02-17T20:58:41.596 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7fb99f7fe640 1 -- 10.20.193.104:0/4268515595 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7fb9a000b840 con 0x7fb9b810a8b0 2026-02-17T20:58:41.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7f0feb7fe640 1 --2- 10.20.193.104:0/3157915095 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0fdc077550 0x7f0fdc079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7f0feb7fe640 1 -- 10.20.193.104:0/3157915095 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f0ff803e070 con 0x7f10041048c0 2026-02-17T20:58:41.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7f1001d74640 1 --2- 10.20.193.104:0/3157915095 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0fdc077550 0x7f0fdc079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7f0feb7fe640 1 --2- 10.20.193.104:0/3157915095 >> [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919] conn(0x7f0fdc07d910 0x7f0fdc07fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7f0feb7fe640 1 -- 10.20.193.104:0/3157915095 --> [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ff803ae90 con 0x7f0fdc07d910 2026-02-17T20:58:41.597 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7f0feb7fe640 1 -- 10.20.193.104:0/3157915095 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f0ff80bed10 con 0x7f10041048c0 2026-02-17T20:58:41.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7f661a205640 1 -- 10.20.193.104:0/1587280656 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6614063350 con 0x7f6614102660 2026-02-17T20:58:41.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7f1002d76640 1 --2- 10.20.193.104:0/3157915095 >> [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919] conn(0x7f0fdc07d910 0x7f0fdc07fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7f1001d74640 1 --2- 10.20.193.104:0/3157915095 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0fdc077550 0x7f0fdc079a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0fec005fd0 tx=0x7f0fec005950 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7fb99f7fe640 1 --2- 10.20.193.104:0/4268515595 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb9900775a0 0x7fb990079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7fb99f7fe640 1 -- 10.20.193.104:0/4268515595 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7fb9a0099e50 con 0x7fb9b810a8b0 2026-02-17T20:58:41.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7f8297fff640 1 -- 10.20.193.104:0/1827968765 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f82ac014070 con 0x7f82b8103830 2026-02-17T20:58:41.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7fb9b6575640 1 --2- 10.20.193.104:0/4268515595 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb9900775a0 0x7fb990079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7fb99f7fe640 1 --2- 10.20.193.104:0/4268515595 >> [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135] conn(0x7fb99007d960 0x7fb99007fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.600 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7f6610ff9640 1 -- 10.20.193.104:0/1587280656 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f6600038c30 con 0x7f6614102660 2026-02-17T20:58:41.600 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7f1002d76640 1 --2- 10.20.193.104:0/3157915095 >> [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919] conn(0x7f0fdc07d910 0x7f0fdc07fd30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.600 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7fb99f7fe640 1 -- 10.20.193.104:0/4268515595 --> [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb9a0017e50 con 0x7fb99007d960 2026-02-17T20:58:41.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7f8297fff640 1 -- 10.20.193.104:0/1827968765 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f82ac0044a0 con 0x7f82b8103830 2026-02-17T20:58:41.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7fb99f7fe640 1 -- 10.20.193.104:0/4268515595 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fb9a009a280 con 0x7fb9b810a8b0 2026-02-17T20:58:41.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7f82bd74b640 1 -- 10.20.193.104:0/1827968765 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82b819c950 con 0x7f82b8103830 2026-02-17T20:58:41.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.573+0000 7f82bd74b640 1 -- 10.20.193.104:0/1827968765 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82b819ceb0 con 0x7f82b8103830 2026-02-17T20:58:41.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.572+0000 7fb9b6d76640 1 --2- 10.20.193.104:0/4268515595 >> [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135] conn(0x7fb99007d960 0x7fb99007fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.573+0000 7f8297fff640 1 -- 10.20.193.104:0/1827968765 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f82ac002dc0 con 0x7f82b8103830 2026-02-17T20:58:41.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.573+0000 7fb9b6575640 1 --2- 10.20.193.104:0/4268515595 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb9900775a0 0x7fb990079a60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac002410 tx=0x7fb9ac03a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.573+0000 7f6610ff9640 1 --2- 10.20.193.104:0/1587280656 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f65e80775a0 0x7f65e8079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.603 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.573+0000 7fb9b6d76640 1 --2- 10.20.193.104:0/4268515595 >> [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135] conn(0x7fb99007d960 0x7fb99007fd80 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.573+0000 7f6610ff9640 1 -- 10.20.193.104:0/1587280656 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f660003e070 con 0x7f6614102660 2026-02-17T20:58:41.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.573+0000 7f6610ff9640 1 --2- 10.20.193.104:0/1587280656 >> [v2:10.20.193.153:6816/4066146238,v1:10.20.193.153:6817/4066146238] conn(0x7f65e807d960 0x7f65e807fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.573+0000 7f6610ff9640 1 -- 10.20.193.104:0/1587280656 --> [v2:10.20.193.153:6816/4066146238,v1:10.20.193.153:6817/4066146238] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6600033e80 con 0x7f65e807d960 2026-02-17T20:58:41.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.573+0000 7f6610ff9640 1 -- 10.20.193.104:0/1587280656 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f66000c5050 con 0x7f6614102660 2026-02-17T20:58:41.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.573+0000 7f6612ffd640 1 --2- 10.20.193.104:0/1587280656 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f65e80775a0 0x7f65e8079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.604 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.573+0000 7f82bd74b640 1 -- 10.20.193.104:0/1827968765 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f82b806b720 con 0x7f82b8103830 2026-02-17T20:58:41.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.573+0000 7f0feb7fe640 1 -- 10.20.193.104:0/3157915095 <== osd.2 v2:10.20.193.104:6818/3131863919 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f0ff803ae90 con 0x7f0fdc07d910 2026-02-17T20:58:41.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.573+0000 7f6613fff640 1 --2- 10.20.193.104:0/1587280656 >> [v2:10.20.193.153:6816/4066146238,v1:10.20.193.153:6817/4066146238] conn(0x7f65e807d960 0x7f65e807fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.605 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.573+0000 7f6612ffd640 1 --2- 10.20.193.104:0/1587280656 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f65e80775a0 0x7f65e8079a60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6614076e00 tx=0x7f6604009210 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.573+0000 7fb99f7fe640 1 -- 10.20.193.104:0/4268515595 <== osd.3 v2:10.20.193.104:6826/1948872135 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fb9a0017e50 con 0x7fb99007d960 2026-02-17T20:58:41.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.574+0000 7f6613fff640 1 --2- 10.20.193.104:0/1587280656 >> [v2:10.20.193.153:6816/4066146238,v1:10.20.193.153:6817/4066146238] conn(0x7f65e807d960 0x7f65e807fd80 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.574+0000 7f8297fff640 1 -- 10.20.193.104:0/1827968765 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f82ac00b840 con 0x7f82b8103830 2026-02-17T20:58:41.606 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.574+0000 7f8297fff640 1 --2- 10.20.193.104:0/1827968765 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f828c0775a0 0x7f828c079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.607 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.574+0000 7f6610ff9640 1 -- 10.20.193.104:0/1587280656 <== osd.6 v2:10.20.193.153:6816/4066146238 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f6600033e80 con 0x7f65e807d960 2026-02-17T20:58:41.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.574+0000 7f82b67fc640 1 --2- 10.20.193.104:0/1827968765 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f828c0775a0 0x7f828c079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.575+0000 7f8297fff640 1 -- 10.20.193.104:0/1827968765 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f82ac099ee0 con 0x7f82b8103830 2026-02-17T20:58:41.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.575+0000 7f82b67fc640 1 --2- 10.20.193.104:0/1827968765 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f828c0775a0 0x7f828c079a60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f82a00097c0 tx=0x7f82a003a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.575+0000 7f8297fff640 1 --2- 10.20.193.104:0/1827968765 >> [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704] conn(0x7f828c07d960 0x7f828c07fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.575+0000 7f8297fff640 1 -- 10.20.193.104:0/1827968765 --> [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f828c080430 con 0x7f828c07d960 2026-02-17T20:58:41.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.575+0000 7f8297fff640 1 -- 10.20.193.104:0/1827968765 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f82ac09a380 con 0x7f82b8103830 2026-02-17T20:58:41.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.575+0000 7f82b77fe640 1 --2- 10.20.193.104:0/1827968765 >> [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704] conn(0x7f828c07d960 0x7f828c07fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.575+0000 7f82b77fe640 1 --2- 10.20.193.104:0/1827968765 >> [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704] conn(0x7f828c07d960 0x7f828c07fd80 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.608 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.575+0000 7f8297fff640 1 -- 10.20.193.104:0/1827968765 <== osd.0 v2:10.20.193.104:6802/438222704 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f828c080430 con 0x7f828c07d960 2026-02-17T20:58:41.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.579+0000 7fe47085a640 1 -- 10.20.193.104:0/192669859 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe468108660 msgr2=0x7fe468108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.579+0000 7fe47085a640 1 --2- 10.20.193.104:0/192669859 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe468108660 0x7fe468108a40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe4600099b0 tx=0x7fe46002f220 comp rx=0 tx=0).stop 2026-02-17T20:58:41.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.579+0000 7fe47085a640 1 -- 10.20.193.104:0/192669859 shutdown_connections 2026-02-17T20:58:41.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.579+0000 7fe47085a640 1 --2- 10.20.193.104:0/192669859 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe468102660 0x7fe468102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.579+0000 7fe47085a640 1 --2- 10.20.193.104:0/192669859 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe468108660 0x7fe468108a40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.610 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.579+0000 7fe47085a640 1 -- 10.20.193.104:0/192669859 >> 10.20.193.104:0/192669859 conn(0x7fe4680fe380 msgr2=0x7fe4681007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.579+0000 7fe47085a640 1 -- 10.20.193.104:0/192669859 shutdown_connections 2026-02-17T20:58:41.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.579+0000 7fe47085a640 1 -- 10.20.193.104:0/192669859 wait complete. 2026-02-17T20:58:41.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe47085a640 1 Processor -- start 2026-02-17T20:58:41.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe47085a640 1 -- start start 2026-02-17T20:58:41.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe47085a640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe468102660 0x7fe46819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe47085a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe468108660 0x7fe46819ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe46e5cf640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe468102660 0x7fe46819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe46e5cf640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe468102660 0x7fe46819a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41134/0 (socket says 10.20.193.104:41134) 2026-02-17T20:58:41.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe47085a640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe46810f880 con 0x7fe468102660 2026-02-17T20:58:41.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe47085a640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe46810f700 con 0x7fe468108660 2026-02-17T20:58:41.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe46e5cf640 1 -- 10.20.193.104:0/2285131841 learned_addr learned my addr 10.20.193.104:0/2285131841 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:41.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe46ddce640 1 --2- 10.20.193.104:0/2285131841 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe468108660 0x7fe46819ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe46e5cf640 1 -- 10.20.193.104:0/2285131841 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe468108660 msgr2=0x7fe46819ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe46e5cf640 1 --2- 10.20.193.104:0/2285131841 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe468108660 0x7fe46819ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.611 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe46e5cf640 1 -- 10.20.193.104:0/2285131841 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe46819eef0 con 0x7fe468102660 2026-02-17T20:58:41.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe46ddce640 1 --2- 10.20.193.104:0/2285131841 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe468108660 0x7fe46819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T20:58:41.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7f8529f86640 1 -- 10.20.193.104:0/1483977120 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f85241048c0 msgr2=0x7f8524104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7f8529f86640 1 --2- 10.20.193.104:0/1483977120 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f85241048c0 0x7f8524104d20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f85140099b0 tx=0x7f851402f220 comp rx=0 tx=0).stop 2026-02-17T20:58:41.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7f8529f86640 1 -- 10.20.193.104:0/1483977120 shutdown_connections 2026-02-17T20:58:41.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7f8529f86640 1 --2- 10.20.193.104:0/1483977120 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f85241048c0 0x7f8524104d20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7f8529f86640 1 --2- 10.20.193.104:0/1483977120 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f852410a8c0 0x7f852410aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7f8529f86640 1 -- 10.20.193.104:0/1483977120 >> 10.20.193.104:0/1483977120 conn(0x7f85241005c0 msgr2=0x7f85241029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7f8529f86640 1 -- 10.20.193.104:0/1483977120 shutdown_connections 2026-02-17T20:58:41.612 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7f8529f86640 1 -- 10.20.193.104:0/1483977120 wait complete. 2026-02-17T20:58:41.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe46e5cf640 1 --2- 10.20.193.104:0/2285131841 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe468102660 0x7fe46819a620 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe460002410 tx=0x7fe4600028b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7f1008e27640 1 -- 10.20.193.104:0/3157915095 --> [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1004063860 con 0x7f0fdc07d910 2026-02-17T20:58:41.613 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe4537fe640 1 -- 10.20.193.104:0/2285131841 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fe460004420 con 0x7fe468102660 2026-02-17T20:58:41.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe4537fe640 1 -- 10.20.193.104:0/2285131841 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fe460038a40 con 0x7fe468102660 2026-02-17T20:58:41.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.580+0000 7fe47085a640 1 -- 10.20.193.104:0/2285131841 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe46819f180 con 0x7fe468102660 2026-02-17T20:58:41.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7fe4537fe640 1 -- 10.20.193.104:0/2285131841 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fe460041880 con 0x7fe468102660 2026-02-17T20:58:41.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7fe47085a640 1 -- 10.20.193.104:0/2285131841 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe46819f520 con 0x7fe468102660 2026-02-17T20:58:41.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7f0feb7fe640 1 -- 10.20.193.104:0/3157915095 <== osd.2 v2:10.20.193.104:6818/3131863919 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1004063860 con 0x7f0fdc07d910 2026-02-17T20:58:41.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7f8529f86640 1 Processor -- start 2026-02-17T20:58:41.614 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7f8529f86640 1 -- start start 2026-02-17T20:58:41.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7fe47085a640 1 -- 10.20.193.104:0/2285131841 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe46819fb30 con 0x7fe468102660 2026-02-17T20:58:41.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7f8529f86640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f85241048c0 0x7f8524111600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.615 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7f8529f86640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f852410a8c0 0x7f8524111b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7f8529f86640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8524079050 con 0x7f85241048c0 2026-02-17T20:58:41.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7f1008e27640 1 -- 10.20.193.104:0/3157915095 >> [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919] conn(0x7f0fdc07d910 msgr2=0x7f0fdc07fd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7f1008e27640 1 --2- 10.20.193.104:0/3157915095 >> [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919] conn(0x7f0fdc07d910 0x7f0fdc07fd30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7f1008e27640 1 -- 10.20.193.104:0/3157915095 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0fdc077550 msgr2=0x7f0fdc079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7f1008e27640 1 --2- 10.20.193.104:0/3157915095 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0fdc077550 0x7f0fdc079a10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0fec005fd0 tx=0x7f0fec005950 comp rx=0 tx=0).stop 2026-02-17T20:58:41.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7f1008e27640 1 -- 10.20.193.104:0/3157915095 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f10041048c0 msgr2=0x7f1004077600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7f1008e27640 1 --2- 10.20.193.104:0/3157915095 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f10041048c0 0x7f1004077600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0ff802f730 tx=0x7f0ff802fd20 comp rx=0 tx=0).stop 2026-02-17T20:58:41.616 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7f85237fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f85241048c0 0x7f8524111600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7f85237fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f85241048c0 0x7f8524111600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41140/0 (socket says 10.20.193.104:41140) 2026-02-17T20:58:41.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7f85237fe640 1 -- 10.20.193.104:0/2955897097 learned_addr learned my addr 10.20.193.104:0/2955897097 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:41.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7f8529f86640 1 -- 10.20.193.104:0/2955897097 --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8524078ed0 con 0x7f852410a8c0 2026-02-17T20:58:41.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7fb9bcef1640 1 -- 10.20.193.104:0/4268515595 --> [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb9b8063310 con 0x7fb99007d960 2026-02-17T20:58:41.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.581+0000 7f8522ffd640 1 --2- 10.20.193.104:0/2955897097 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f852410a8c0 0x7f8524111b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.617 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fb99f7fe640 1 -- 10.20.193.104:0/4268515595 <== osd.3 v2:10.20.193.104:6826/1948872135 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb9b8063310 con 0x7fb99007d960 2026-02-17T20:58:41.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f661a205640 1 -- 10.20.193.104:0/1587280656 --> [v2:10.20.193.153:6816/4066146238,v1:10.20.193.153:6817/4066146238] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f66140637d0 con 0x7f65e807d960 2026-02-17T20:58:41.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f85237fe640 1 -- 10.20.193.104:0/2955897097 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f852410a8c0 msgr2=0x7f8524111b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f85237fe640 1 --2- 10.20.193.104:0/2955897097 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f852410a8c0 0x7f8524111b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f85237fe640 1 -- 10.20.193.104:0/2955897097 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8524118770 con 0x7f85241048c0 2026-02-17T20:58:41.618 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fe4537fe640 1 -- 10.20.193.104:0/2285131841 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7fe460038bf0 con 0x7fe468102660 2026-02-17T20:58:41.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f1008e27640 1 -- 10.20.193.104:0/3157915095 shutdown_connections 2026-02-17T20:58:41.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f1008e27640 1 --2- 10.20.193.104:0/3157915095 >> [v2:10.20.193.104:6818/3131863919,v1:10.20.193.104:6819/3131863919] conn(0x7f0fdc07d910 0x7f0fdc07fd30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f1008e27640 1 --2- 10.20.193.104:0/3157915095 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0fdc077550 0x7f0fdc079a10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f1008e27640 1 --2- 10.20.193.104:0/3157915095 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f100410a8c0 0x7f1004077b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f1008e27640 1 --2- 10.20.193.104:0/3157915095 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f10041048c0 0x7f1004077600 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f1008e27640 1 -- 10.20.193.104:0/3157915095 >> 10.20.193.104:0/3157915095 conn(0x7f10041005c0 msgr2=0x7f10041017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f1008e27640 1 -- 10.20.193.104:0/3157915095 shutdown_connections 2026-02-17T20:58:41.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f85237fe640 1 --2- 10.20.193.104:0/2955897097 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f85241048c0 0x7f8524111600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f851000b700 tx=0x7f851000bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.619 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f6610ff9640 1 -- 10.20.193.104:0/1587280656 <== osd.6 v2:10.20.193.153:6816/4066146238 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f66140637d0 con 0x7f65e807d960 2026-02-17T20:58:41.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f8520ff9640 1 -- 10.20.193.104:0/2955897097 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8510004440 con 0x7f85241048c0 2026-02-17T20:58:41.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f1008e27640 1 -- 10.20.193.104:0/3157915095 wait complete. 2026-02-17T20:58:41.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fe4537fe640 1 --2- 10.20.193.104:0/2285131841 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe4440775f0 0x7fe444079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.620 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f8520ff9640 1 -- 10.20.193.104:0/2955897097 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f8510010070 con 0x7f85241048c0 2026-02-17T20:58:41.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f8529f86640 1 -- 10.20.193.104:0/2955897097 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85241120e0 con 0x7f85241048c0 2026-02-17T20:58:41.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fb9bcef1640 1 -- 10.20.193.104:0/4268515595 >> [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135] conn(0x7fb99007d960 msgr2=0x7fb99007fd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fb9bcef1640 1 --2- 10.20.193.104:0/4268515595 >> [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135] conn(0x7fb99007d960 0x7fb99007fd80 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fe4537fe640 1 -- 10.20.193.104:0/2285131841 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7fe46003e070 con 0x7fe468102660 2026-02-17T20:58:41.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fe46ddce640 1 --2- 10.20.193.104:0/2285131841 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe4440775f0 0x7fe444079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.621 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f661a205640 1 -- 10.20.193.104:0/1587280656 >> [v2:10.20.193.153:6816/4066146238,v1:10.20.193.153:6817/4066146238] conn(0x7f65e807d960 msgr2=0x7f65e807fd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f661a205640 1 --2- 10.20.193.104:0/1587280656 >> [v2:10.20.193.153:6816/4066146238,v1:10.20.193.153:6817/4066146238] conn(0x7f65e807d960 0x7f65e807fd80 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fe4537fe640 1 --2- 10.20.193.104:0/2285131841 >> [v2:10.20.193.153:6808/2951447967,v1:10.20.193.153:6809/2951447967] conn(0x7fe44407d9b0 0x7fe44407fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fe4537fe640 1 -- 10.20.193.104:0/2285131841 --> [v2:10.20.193.153:6808/2951447967,v1:10.20.193.153:6809/2951447967] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe46000b0b0 con 0x7fe44407d9b0 2026-02-17T20:58:41.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fe4537fe640 1 -- 10.20.193.104:0/2285131841 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fe4600beab0 con 0x7fe468102660 2026-02-17T20:58:41.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f8520ff9640 1 -- 10.20.193.104:0/2955897097 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f851000c9b0 con 0x7f85241048c0 2026-02-17T20:58:41.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f8529f86640 1 -- 10.20.193.104:0/2955897097 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8524116270 con 0x7f85241048c0 2026-02-17T20:58:41.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f661a205640 1 -- 10.20.193.104:0/1587280656 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f65e80775a0 msgr2=0x7f65e8079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.622 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f661a205640 1 --2- 10.20.193.104:0/1587280656 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f65e80775a0 0x7f65e8079a60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6614076e00 tx=0x7f6604009210 comp rx=0 tx=0).stop 2026-02-17T20:58:41.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f661a205640 1 -- 10.20.193.104:0/1587280656 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6614102660 msgr2=0x7f6614075370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f661a205640 1 --2- 10.20.193.104:0/1587280656 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6614102660 0x7f6614075370 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f660002f730 tx=0x7f6600002910 comp rx=0 tx=0).stop 2026-02-17T20:58:41.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fb9bcef1640 1 -- 10.20.193.104:0/4268515595 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb9900775a0 msgr2=0x7fb990079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fb9bcef1640 1 --2- 10.20.193.104:0/4268515595 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb9900775a0 0x7fb990079a60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac002410 tx=0x7fb9ac03a040 comp rx=0 tx=0).stop 2026-02-17T20:58:41.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fb9bcef1640 1 -- 10.20.193.104:0/4268515595 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb9b810a8b0 msgr2=0x7fb9b81a2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fb9bcef1640 1 --2- 10.20.193.104:0/4268515595 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb9b810a8b0 0x7fb9b81a2b10 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000d8d0 tx=0x7fb9a000dda0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.623 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f82bd74b640 1 -- 10.20.193.104:0/1827968765 --> [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f82b8063310 con 0x7f828c07d960 2026-02-17T20:58:41.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fb9bcef1640 1 -- 10.20.193.104:0/4268515595 shutdown_connections 2026-02-17T20:58:41.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fb9bcef1640 1 --2- 10.20.193.104:0/4268515595 >> [v2:10.20.193.104:6826/1948872135,v1:10.20.193.104:6827/1948872135] conn(0x7fb99007d960 0x7fb99007fd80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fb9bcef1640 1 --2- 10.20.193.104:0/4268515595 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fb9900775a0 0x7fb990079a60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fb9bcef1640 1 --2- 10.20.193.104:0/4268515595 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fb9b810a8b0 0x7fb9b81a2b10 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fb9bcef1640 1 --2- 10.20.193.104:0/4268515595 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fb9b81048b0 0x7fb9b81a25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fe46edd0640 1 --2- 10.20.193.104:0/2285131841 >> [v2:10.20.193.153:6808/2951447967,v1:10.20.193.153:6809/2951447967] conn(0x7fe44407d9b0 0x7fe44407fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fb9bcef1640 1 -- 10.20.193.104:0/4268515595 >> 10.20.193.104:0/4268515595 conn(0x7fb9b8100590 msgr2=0x7fb9b8102730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.624 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7fe46ddce640 1 --2- 10.20.193.104:0/2285131841 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe4440775f0 0x7fe444079ab0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe4680ff860 tx=0x7fe454005e30 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f661a205640 1 -- 10.20.193.104:0/1587280656 shutdown_connections 2026-02-17T20:58:41.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f661a205640 1 --2- 10.20.193.104:0/1587280656 >> [v2:10.20.193.153:6816/4066146238,v1:10.20.193.153:6817/4066146238] conn(0x7f65e807d960 0x7f65e807fd80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f661a205640 1 --2- 10.20.193.104:0/1587280656 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f65e80775a0 0x7f65e8079a60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f661a205640 1 --2- 10.20.193.104:0/1587280656 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6614108660 0x7f66140758b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f661a205640 1 --2- 10.20.193.104:0/1587280656 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6614102660 0x7f6614075370 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.582+0000 7f661a205640 1 -- 10.20.193.104:0/1587280656 >> 10.20.193.104:0/1587280656 conn(0x7f66140fe380 msgr2=0x7f66140ff610 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7fb9bcef1640 1 -- 10.20.193.104:0/4268515595 shutdown_connections 2026-02-17T20:58:41.625 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f661a205640 1 -- 10.20.193.104:0/1587280656 shutdown_connections 2026-02-17T20:58:41.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f8297fff640 1 -- 10.20.193.104:0/1827968765 <== osd.0 v2:10.20.193.104:6802/438222704 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f82b8063310 con 0x7f828c07d960 2026-02-17T20:58:41.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7fb9bcef1640 1 -- 10.20.193.104:0/4268515595 wait complete. 2026-02-17T20:58:41.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f661a205640 1 -- 10.20.193.104:0/1587280656 wait complete. 2026-02-17T20:58:41.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f8529f86640 1 -- 10.20.193.104:0/2955897097 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8524116810 con 0x7f85241048c0 2026-02-17T20:58:41.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f82bd74b640 1 -- 10.20.193.104:0/1827968765 >> [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704] conn(0x7f828c07d960 msgr2=0x7f828c07fd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f82bd74b640 1 --2- 10.20.193.104:0/1827968765 >> [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704] conn(0x7f828c07d960 0x7f828c07fd80 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.626 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f82bd74b640 1 -- 10.20.193.104:0/1827968765 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f828c0775a0 msgr2=0x7f828c079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f82bd74b640 1 --2- 10.20.193.104:0/1827968765 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f828c0775a0 0x7f828c079a60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f82a00097c0 tx=0x7f82a003a040 comp rx=0 tx=0).stop 2026-02-17T20:58:41.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f82bd74b640 1 -- 10.20.193.104:0/1827968765 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f82b8103830 msgr2=0x7f82b81a2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f82bd74b640 1 --2- 10.20.193.104:0/1827968765 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f82b8103830 0x7f82b81a2590 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f82ac00d8d0 tx=0x7f82ac00dda0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f8520ff9640 1 -- 10.20.193.104:0/2955897097 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f851001d030 con 0x7f85241048c0 2026-02-17T20:58:41.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f82bd74b640 1 -- 10.20.193.104:0/1827968765 shutdown_connections 2026-02-17T20:58:41.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f82bd74b640 1 --2- 10.20.193.104:0/1827968765 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f828c0775a0 0x7f828c079a60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f82bd74b640 1 --2- 10.20.193.104:0/1827968765 >> [v2:10.20.193.104:6802/438222704,v1:10.20.193.104:6803/438222704] conn(0x7f828c07d960 0x7f828c07fd80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f82bd74b640 1 --2- 10.20.193.104:0/1827968765 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f82b8104150 0x7f82b81a2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f82bd74b640 1 --2- 10.20.193.104:0/1827968765 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f82b8103830 0x7f82b81a2590 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f82bd74b640 1 -- 10.20.193.104:0/1827968765 >> 10.20.193.104:0/1827968765 conn(0x7f82b80fd1f0 msgr2=0x7f82b8102c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.627 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f82bd74b640 1 -- 10.20.193.104:0/1827968765 shutdown_connections 2026-02-17T20:58:41.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7fe46edd0640 1 --2- 10.20.193.104:0/2285131841 >> [v2:10.20.193.153:6808/2951447967,v1:10.20.193.153:6809/2951447967] conn(0x7fe44407d9b0 0x7fe44407fdd0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.583+0000 7f82bd74b640 1 -- 10.20.193.104:0/1827968765 wait complete. 2026-02-17T20:58:41.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.584+0000 7f8520ff9640 1 --2- 10.20.193.104:0/2955897097 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f84f80775f0 0x7f84f8079ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.584+0000 7f8520ff9640 1 -- 10.20.193.104:0/2955897097 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f8510098610 con 0x7f85241048c0 2026-02-17T20:58:41.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.584+0000 7f8522ffd640 1 --2- 10.20.193.104:0/2955897097 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f84f80775f0 0x7f84f8079ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.584+0000 7f8520ff9640 1 --2- 10.20.193.104:0/2955897097 >> [v2:10.20.193.153:6824/1592752433,v1:10.20.193.153:6825/1592752433] conn(0x7f84f807d9b0 0x7f84f807fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.584+0000 7f8520ff9640 1 -- 10.20.193.104:0/2955897097 --> [v2:10.20.193.153:6824/1592752433,v1:10.20.193.153:6825/1592752433] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f851001be70 con 0x7f84f807d9b0 2026-02-17T20:58:41.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.584+0000 7f8520ff9640 1 -- 10.20.193.104:0/2955897097 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f851009f050 con 0x7f85241048c0 2026-02-17T20:58:41.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.584+0000 7f8522ffd640 1 --2- 10.20.193.104:0/2955897097 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f84f80775f0 0x7f84f8079ab0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f85140040c0 tx=0x7f851403a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.584+0000 7f8523fff640 1 --2- 10.20.193.104:0/2955897097 >> [v2:10.20.193.153:6824/1592752433,v1:10.20.193.153:6825/1592752433] conn(0x7f84f807d9b0 0x7f84f807fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.584+0000 7f8523fff640 1 --2- 10.20.193.104:0/2955897097 >> [v2:10.20.193.153:6824/1592752433,v1:10.20.193.153:6825/1592752433] conn(0x7f84f807d9b0 0x7f84f807fdd0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.584+0000 7fe4537fe640 1 -- 10.20.193.104:0/2285131841 <== osd.5 v2:10.20.193.153:6808/2951447967 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7fe46000b0b0 con 0x7fe44407d9b0 2026-02-17T20:58:41.629 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.584+0000 7f4860b59640 1 -- 10.20.193.104:0/1342863877 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f485c108660 msgr2=0x7f485c108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.584+0000 7f4860b59640 1 --2- 10.20.193.104:0/1342863877 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f485c108660 0x7f485c108a40 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f48500099b0 tx=0x7f485002f220 comp rx=0 tx=0).stop 2026-02-17T20:58:41.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4860b59640 1 -- 10.20.193.104:0/1342863877 shutdown_connections 2026-02-17T20:58:41.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4860b59640 1 --2- 10.20.193.104:0/1342863877 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f485c100b60 0x7f485c100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4860b59640 1 --2- 10.20.193.104:0/1342863877 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f485c108660 0x7f485c108a40 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4860b59640 1 -- 10.20.193.104:0/1342863877 >> 10.20.193.104:0/1342863877 conn(0x7f485c078360 msgr2=0x7f485c078770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4860b59640 1 -- 10.20.193.104:0/1342863877 shutdown_connections 2026-02-17T20:58:41.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4860b59640 1 -- 10.20.193.104:0/1342863877 wait complete. 2026-02-17T20:58:41.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4860b59640 1 Processor -- start 2026-02-17T20:58:41.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4860b59640 1 -- start start 2026-02-17T20:58:41.630 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f8520ff9640 1 -- 10.20.193.104:0/2955897097 <== osd.7 v2:10.20.193.153:6824/1592752433 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f851001be70 con 0x7f84f807d9b0 2026-02-17T20:58:41.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4860b59640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f485c100b60 0x7f485c1a2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4860b59640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f485c108660 0x7f485c1a2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4860b59640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f485c10f890 con 0x7f485c108660 2026-02-17T20:58:41.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4860b59640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f485c10f710 con 0x7f485c100b60 2026-02-17T20:58:41.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4859d74640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f485c108660 0x7f485c1a2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4859d74640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f485c108660 0x7f485c1a2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41176/0 (socket says 10.20.193.104:41176) 2026-02-17T20:58:41.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4859d74640 1 -- 10.20.193.104:0/237461528 learned_addr learned my addr 10.20.193.104:0/237461528 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:41.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4859d74640 1 -- 10.20.193.104:0/237461528 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f485c100b60 msgr2=0x7f485c1a2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4859d74640 1 --2- 10.20.193.104:0/237461528 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f485c100b60 0x7f485c1a2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4859d74640 1 -- 10.20.193.104:0/237461528 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f485c19c6d0 con 0x7f485c108660 2026-02-17T20:58:41.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.585+0000 7f4859d74640 1 --2- 10.20.193.104:0/237461528 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f485c108660 0x7f485c1a2b40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f484400d8d0 tx=0x7f484400dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.586+0000 7f48437fe640 1 -- 10.20.193.104:0/237461528 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f4844014070 con 0x7f485c108660 2026-02-17T20:58:41.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.586+0000 7f48437fe640 1 -- 10.20.193.104:0/237461528 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f48440044a0 con 0x7f485c108660 2026-02-17T20:58:41.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.586+0000 7f4860b59640 1 -- 10.20.193.104:0/237461528 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f485c19c9c0 con 0x7f485c108660 2026-02-17T20:58:41.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.586+0000 7f48437fe640 1 -- 10.20.193.104:0/237461528 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f4844005020 con 0x7f485c108660 2026-02-17T20:58:41.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.586+0000 7f4860b59640 1 -- 10.20.193.104:0/237461528 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f485c19cf20 con 0x7f485c108660 2026-02-17T20:58:41.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.586+0000 7f31880a6640 1 -- 10.20.193.104:0/262566600 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f318010a8c0 msgr2=0x7f318010aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.586+0000 7f31880a6640 1 --2- 10.20.193.104:0/262566600 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f318010a8c0 0x7f318010aca0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f31700099b0 tx=0x7f317002f220 comp rx=0 tx=0).stop 2026-02-17T20:58:41.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.586+0000 7f31880a6640 1 -- 10.20.193.104:0/262566600 shutdown_connections 2026-02-17T20:58:41.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.586+0000 7f31880a6640 1 --2- 10.20.193.104:0/262566600 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f31801048c0 0x7f3180104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.586+0000 7f31880a6640 1 --2- 10.20.193.104:0/262566600 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f318010a8c0 0x7f318010aca0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.586+0000 7f31880a6640 1 -- 10.20.193.104:0/262566600 >> 10.20.193.104:0/262566600 conn(0x7f31801005c0 msgr2=0x7f31801029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.586+0000 7f31880a6640 1 -- 10.20.193.104:0/262566600 shutdown_connections 2026-02-17T20:58:41.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.586+0000 7f4860b59640 1 -- 10.20.193.104:0/237461528 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f485c19d460 con 0x7f485c108660 2026-02-17T20:58:41.633 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.586+0000 7f31880a6640 1 -- 10.20.193.104:0/262566600 wait complete. 2026-02-17T20:58:41.633 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f31880a6640 1 Processor -- start 2026-02-17T20:58:41.633 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f31880a6640 1 -- start start 2026-02-17T20:58:41.633 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f48437fe640 1 -- 10.20.193.104:0/237461528 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f48440047c0 con 0x7f485c108660 2026-02-17T20:58:41.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f31880a6640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f31801048c0 0x7f31801a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f31880a6640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f318010a8c0 0x7f31801a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f31880a6640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f3180111ae0 con 0x7f31801048c0 2026-02-17T20:58:41.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f31880a6640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f3180111960 con 0x7f318010a8c0 2026-02-17T20:58:41.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f3185e1b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f31801048c0 0x7f31801a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f3185e1b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f31801048c0 0x7f31801a25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41192/0 (socket says 10.20.193.104:41192) 2026-02-17T20:58:41.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f3185e1b640 1 -- 10.20.193.104:0/217791687 learned_addr learned my addr 10.20.193.104:0/217791687 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:41.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f318561a640 1 --2- 10.20.193.104:0/217791687 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f318010a8c0 0x7f31801a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f48437fe640 1 --2- 10.20.193.104:0/237461528 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f48340775a0 0x7f4834079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f48437fe640 1 -- 10.20.193.104:0/237461528 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f4844099a50 con 0x7f485c108660 2026-02-17T20:58:41.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f3185e1b640 1 -- 10.20.193.104:0/217791687 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f318010a8c0 msgr2=0x7f31801a2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f3185e1b640 1 --2- 10.20.193.104:0/217791687 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f318010a8c0 0x7f31801a2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f3185e1b640 1 -- 10.20.193.104:0/217791687 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318019c690 con 0x7f31801048c0 2026-02-17T20:58:41.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f48437fe640 1 --2- 10.20.193.104:0/237461528 >> [v2:10.20.193.153:6800/250110565,v1:10.20.193.153:6801/250110565] conn(0x7f483407d960 0x7f483407fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f485a575640 1 --2- 10.20.193.104:0/237461528 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f48340775a0 0x7f4834079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f48437fe640 1 -- 10.20.193.104:0/237461528 --> [v2:10.20.193.153:6800/250110565,v1:10.20.193.153:6801/250110565] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4844012e80 con 0x7f483407d960 2026-02-17T20:58:41.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f48437fe640 1 -- 10.20.193.104:0/237461528 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f4844099ef0 con 0x7f485c108660 2026-02-17T20:58:41.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f3185e1b640 1 --2- 10.20.193.104:0/217791687 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f31801048c0 0x7f31801a25c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3170002410 tx=0x7f31700028b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f316effd640 1 -- 10.20.193.104:0/217791687 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f3170004420 con 0x7f31801048c0 2026-02-17T20:58:41.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f316effd640 1 -- 10.20.193.104:0/217791687 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f3170038a40 con 0x7f31801048c0 2026-02-17T20:58:41.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f485ad76640 1 --2- 10.20.193.104:0/237461528 >> [v2:10.20.193.153:6800/250110565,v1:10.20.193.153:6801/250110565] conn(0x7f483407d960 0x7f483407fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f485a575640 1 --2- 10.20.193.104:0/237461528 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f48340775a0 0x7f4834079a60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f48500099b0 tx=0x7f4850009660 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.587+0000 7f316effd640 1 -- 10.20.193.104:0/217791687 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f3170041880 con 0x7f31801048c0 2026-02-17T20:58:41.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.588+0000 7f31880a6640 1 -- 10.20.193.104:0/217791687 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318019c920 con 0x7f31801048c0 2026-02-17T20:58:41.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.588+0000 7f485ad76640 1 --2- 10.20.193.104:0/237461528 >> [v2:10.20.193.153:6800/250110565,v1:10.20.193.153:6801/250110565] conn(0x7f483407d960 0x7f483407fd80 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.588+0000 7f31880a6640 1 -- 10.20.193.104:0/217791687 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f318019ce20 con 0x7f31801048c0 2026-02-17T20:58:41.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.588+0000 7f31880a6640 1 -- 10.20.193.104:0/217791687 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f318019d3b0 con 0x7f31801048c0 2026-02-17T20:58:41.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.588+0000 7f48437fe640 1 -- 10.20.193.104:0/237461528 <== osd.4 v2:10.20.193.153:6800/250110565 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f4844012e80 con 0x7f483407d960 2026-02-17T20:58:41.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.589+0000 7f316effd640 1 -- 10.20.193.104:0/217791687 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f3170038bf0 con 0x7f31801048c0 2026-02-17T20:58:41.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.589+0000 7f316effd640 1 --2- 10.20.193.104:0/217791687 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f315c077550 0x7f315c079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.589+0000 7f316effd640 1 -- 10.20.193.104:0/217791687 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f317003e070 con 0x7f31801048c0 2026-02-17T20:58:41.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.589+0000 7f316effd640 1 --2- 10.20.193.104:0/217791687 >> [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859] conn(0x7f315c07d910 0x7f315c07fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.589+0000 7f316effd640 1 -- 10.20.193.104:0/217791687 --> [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3170048e50 con 0x7f315c07d910 2026-02-17T20:58:41.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.589+0000 7f316effd640 1 -- 10.20.193.104:0/217791687 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f31700c5050 con 0x7f31801048c0 2026-02-17T20:58:41.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.589+0000 7f318561a640 1 --2- 10.20.193.104:0/217791687 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f315c077550 0x7f315c079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.589+0000 7f318661c640 1 --2- 10.20.193.104:0/217791687 >> [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859] conn(0x7f315c07d910 0x7f315c07fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.589+0000 7f318561a640 1 --2- 10.20.193.104:0/217791687 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f315c077550 0x7f315c079a10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f318019dee0 tx=0x7f317400a5c0 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.590+0000 7f318661c640 1 --2- 10.20.193.104:0/217791687 >> [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859] conn(0x7f315c07d910 0x7f315c07fd30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.590+0000 7f316effd640 1 -- 10.20.193.104:0/217791687 <== osd.1 v2:10.20.193.104:6810/1955490859 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27504 (crc 0 0 0) 0x7f3170048e50 con 0x7f315c07d910 2026-02-17T20:58:41.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.592+0000 7fe47085a640 1 -- 10.20.193.104:0/2285131841 --> [v2:10.20.193.153:6808/2951447967,v1:10.20.193.153:6809/2951447967] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe468063310 con 0x7fe44407d9b0 2026-02-17T20:58:41.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.592+0000 7fe4537fe640 1 -- 10.20.193.104:0/2285131841 <== osd.5 v2:10.20.193.153:6808/2951447967 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe468063310 con 0x7fe44407d9b0 2026-02-17T20:58:41.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.592+0000 7fe47085a640 1 -- 10.20.193.104:0/2285131841 >> [v2:10.20.193.153:6808/2951447967,v1:10.20.193.153:6809/2951447967] conn(0x7fe44407d9b0 msgr2=0x7fe44407fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.592+0000 7fe47085a640 1 --2- 10.20.193.104:0/2285131841 >> [v2:10.20.193.153:6808/2951447967,v1:10.20.193.153:6809/2951447967] conn(0x7fe44407d9b0 0x7fe44407fdd0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.593+0000 7fe47085a640 1 -- 10.20.193.104:0/2285131841 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe4440775f0 msgr2=0x7fe444079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.593+0000 7fe47085a640 1 --2- 10.20.193.104:0/2285131841 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe4440775f0 0x7fe444079ab0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe4680ff860 tx=0x7fe454005e30 comp rx=0 tx=0).stop 2026-02-17T20:58:41.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.593+0000 7fe47085a640 1 -- 10.20.193.104:0/2285131841 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe468102660 msgr2=0x7fe46819a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.593+0000 7fe47085a640 1 --2- 10.20.193.104:0/2285131841 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe468102660 0x7fe46819a620 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe460002410 tx=0x7fe4600028b0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.593+0000 7fe47085a640 1 -- 10.20.193.104:0/2285131841 shutdown_connections 2026-02-17T20:58:41.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.593+0000 7fe47085a640 1 --2- 10.20.193.104:0/2285131841 >> [v2:10.20.193.153:6808/2951447967,v1:10.20.193.153:6809/2951447967] conn(0x7fe44407d9b0 0x7fe44407fdd0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.593+0000 7fe47085a640 1 --2- 10.20.193.104:0/2285131841 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe4440775f0 0x7fe444079ab0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.593+0000 7fe47085a640 1 --2- 10.20.193.104:0/2285131841 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe468108660 0x7fe46819ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.593+0000 7fe47085a640 1 --2- 10.20.193.104:0/2285131841 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe468102660 0x7fe46819a620 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.593+0000 7fe47085a640 1 -- 10.20.193.104:0/2285131841 >> 10.20.193.104:0/2285131841 conn(0x7fe4680fe380 msgr2=0x7fe4681005e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.638 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.593+0000 7fe47085a640 1 -- 10.20.193.104:0/2285131841 shutdown_connections 2026-02-17T20:58:41.639 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.593+0000 7fe47085a640 1 -- 10.20.193.104:0/2285131841 wait complete. 2026-02-17T20:58:41.639 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.593+0000 7f8529f86640 1 -- 10.20.193.104:0/2955897097 --> [v2:10.20.193.153:6824/1592752433,v1:10.20.193.153:6825/1592752433] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8524116c60 con 0x7f84f807d9b0 2026-02-17T20:58:41.639 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.594+0000 7f8520ff9640 1 -- 10.20.193.104:0/2955897097 <== osd.7 v2:10.20.193.153:6824/1592752433 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8524116c60 con 0x7f84f807d9b0 2026-02-17T20:58:41.639 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.594+0000 7f8529f86640 1 -- 10.20.193.104:0/2955897097 >> [v2:10.20.193.153:6824/1592752433,v1:10.20.193.153:6825/1592752433] conn(0x7f84f807d9b0 msgr2=0x7f84f807fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.639 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.594+0000 7f8529f86640 1 --2- 10.20.193.104:0/2955897097 >> [v2:10.20.193.153:6824/1592752433,v1:10.20.193.153:6825/1592752433] conn(0x7f84f807d9b0 0x7f84f807fdd0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.639 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.594+0000 7f8529f86640 1 -- 10.20.193.104:0/2955897097 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f84f80775f0 msgr2=0x7f84f8079ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.639 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.594+0000 7f8529f86640 1 --2- 10.20.193.104:0/2955897097 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f84f80775f0 0x7f84f8079ab0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f85140040c0 tx=0x7f851403a040 comp rx=0 tx=0).stop 2026-02-17T20:58:41.639 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.594+0000 7f8529f86640 1 -- 10.20.193.104:0/2955897097 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f85241048c0 msgr2=0x7f8524111600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.639 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.595+0000 7f8529f86640 1 --2- 10.20.193.104:0/2955897097 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f85241048c0 0x7f8524111600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f851000b700 tx=0x7f851000bbd0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.639 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.595+0000 7f8529f86640 1 -- 10.20.193.104:0/2955897097 shutdown_connections 2026-02-17T20:58:41.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.595+0000 7f8529f86640 1 --2- 10.20.193.104:0/2955897097 >> [v2:10.20.193.153:6824/1592752433,v1:10.20.193.153:6825/1592752433] conn(0x7f84f807d9b0 0x7f84f807fdd0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.595+0000 7f8529f86640 1 --2- 10.20.193.104:0/2955897097 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f84f80775f0 0x7f84f8079ab0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.595+0000 7f8529f86640 1 --2- 10.20.193.104:0/2955897097 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f852410a8c0 0x7f8524111b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.595+0000 7f8529f86640 1 --2- 10.20.193.104:0/2955897097 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f85241048c0 0x7f8524111600 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.595+0000 7f8529f86640 1 -- 10.20.193.104:0/2955897097 >> 10.20.193.104:0/2955897097 conn(0x7f85241005c0 msgr2=0x7f85241029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.595+0000 7f8529f86640 1 -- 10.20.193.104:0/2955897097 shutdown_connections 2026-02-17T20:58:41.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.595+0000 7f8529f86640 1 -- 10.20.193.104:0/2955897097 wait complete. 2026-02-17T20:58:41.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.596+0000 7f4860b59640 1 -- 10.20.193.104:0/237461528 --> [v2:10.20.193.153:6800/250110565,v1:10.20.193.153:6801/250110565] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f485c063310 con 0x7f483407d960 2026-02-17T20:58:41.640 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.596+0000 7f48437fe640 1 -- 10.20.193.104:0/237461528 <== osd.4 v2:10.20.193.153:6800/250110565 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f485c063310 con 0x7f483407d960 2026-02-17T20:58:41.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.597+0000 7f4860b59640 1 -- 10.20.193.104:0/237461528 >> [v2:10.20.193.153:6800/250110565,v1:10.20.193.153:6801/250110565] conn(0x7f483407d960 msgr2=0x7f483407fd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.597+0000 7f4860b59640 1 --2- 10.20.193.104:0/237461528 >> [v2:10.20.193.153:6800/250110565,v1:10.20.193.153:6801/250110565] conn(0x7f483407d960 0x7f483407fd80 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.597+0000 7f4860b59640 1 -- 10.20.193.104:0/237461528 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f48340775a0 msgr2=0x7f4834079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.597+0000 7f4860b59640 1 --2- 10.20.193.104:0/237461528 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f48340775a0 0x7f4834079a60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f48500099b0 tx=0x7f4850009660 comp rx=0 tx=0).stop 2026-02-17T20:58:41.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.597+0000 7f4860b59640 1 -- 10.20.193.104:0/237461528 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f485c108660 msgr2=0x7f485c1a2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.597+0000 7f4860b59640 1 --2- 10.20.193.104:0/237461528 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f485c108660 0x7f485c1a2b40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f484400d8d0 tx=0x7f484400dda0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.597+0000 7f4860b59640 1 -- 10.20.193.104:0/237461528 shutdown_connections 2026-02-17T20:58:41.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.597+0000 7f4860b59640 1 --2- 10.20.193.104:0/237461528 >> [v2:10.20.193.153:6800/250110565,v1:10.20.193.153:6801/250110565] conn(0x7f483407d960 0x7f483407fd80 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.597+0000 7f4860b59640 1 --2- 10.20.193.104:0/237461528 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f48340775a0 0x7f4834079a60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.597+0000 7f4860b59640 1 --2- 10.20.193.104:0/237461528 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f485c108660 0x7f485c1a2b40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.597+0000 7f4860b59640 1 --2- 10.20.193.104:0/237461528 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f485c100b60 0x7f485c1a2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.597+0000 7f4860b59640 1 -- 10.20.193.104:0/237461528 >> 10.20.193.104:0/237461528 conn(0x7f485c078360 msgr2=0x7f485c0ffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.597+0000 7f4860b59640 1 -- 10.20.193.104:0/237461528 shutdown_connections 2026-02-17T20:58:41.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.597+0000 7f4860b59640 1 -- 10.20.193.104:0/237461528 wait complete. 2026-02-17T20:58:41.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.599+0000 7f31880a6640 1 -- 10.20.193.104:0/217791687 --> [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3180063390 con 0x7f315c07d910 2026-02-17T20:58:41.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.600+0000 7f316effd640 1 -- 10.20.193.104:0/217791687 <== osd.1 v2:10.20.193.104:6810/1955490859 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3180063390 con 0x7f315c07d910 2026-02-17T20:58:41.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.600+0000 7f31880a6640 1 -- 10.20.193.104:0/217791687 >> [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859] conn(0x7f315c07d910 msgr2=0x7f315c07fd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.600+0000 7f31880a6640 1 --2- 10.20.193.104:0/217791687 >> [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859] conn(0x7f315c07d910 0x7f315c07fd30 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.600+0000 7f31880a6640 1 -- 10.20.193.104:0/217791687 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f315c077550 msgr2=0x7f315c079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.600+0000 7f31880a6640 1 --2- 10.20.193.104:0/217791687 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f315c077550 0x7f315c079a10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f318019dee0 tx=0x7f317400a5c0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.600+0000 7f31880a6640 1 -- 10.20.193.104:0/217791687 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f31801048c0 msgr2=0x7f31801a25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.600+0000 7f31880a6640 1 --2- 10.20.193.104:0/217791687 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f31801048c0 0x7f31801a25c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3170002410 tx=0x7f31700028b0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.602+0000 7f31880a6640 1 -- 10.20.193.104:0/217791687 shutdown_connections 2026-02-17T20:58:41.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.602+0000 7f31880a6640 1 --2- 10.20.193.104:0/217791687 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f315c077550 0x7f315c079a10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.602+0000 7f31880a6640 1 --2- 10.20.193.104:0/217791687 >> [v2:10.20.193.104:6810/1955490859,v1:10.20.193.104:6811/1955490859] conn(0x7f315c07d910 0x7f315c07fd30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.602+0000 7f31880a6640 1 --2- 10.20.193.104:0/217791687 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f318010a8c0 0x7f31801a2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.602+0000 7f31880a6640 1 --2- 10.20.193.104:0/217791687 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f31801048c0 0x7f31801a25c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.602+0000 7f31880a6640 1 -- 10.20.193.104:0/217791687 >> 10.20.193.104:0/217791687 conn(0x7f31801005c0 msgr2=0x7f3180102810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.602+0000 7f31880a6640 1 -- 10.20.193.104:0/217791687 shutdown_connections 2026-02-17T20:58:41.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.602+0000 7f31880a6640 1 -- 10.20.193.104:0/217791687 wait complete. 2026-02-17T20:58:41.643 INFO:teuthology.orchestra.run.trial104.stdout:107374182411 2026-02-17T20:58:41.643 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-17T20:58:41.645 INFO:teuthology.orchestra.run.trial104.stdout:42949672976 2026-02-17T20:58:41.645 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-17T20:58:41.646 INFO:teuthology.orchestra.run.trial104.stdout:77309411341 2026-02-17T20:58:41.646 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-17T20:58:41.650 INFO:teuthology.orchestra.run.trial104.stdout:124554051592 2026-02-17T20:58:41.650 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-17T20:58:41.657 INFO:teuthology.orchestra.run.trial104.stdout:60129542159 2026-02-17T20:58:41.658 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-17T20:58:41.662 INFO:teuthology.orchestra.run.trial104.stdout:150323855367 2026-02-17T20:58:41.662 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-17T20:58:41.678 INFO:teuthology.orchestra.run.trial104.stdout:176093659141 2026-02-17T20:58:41.679 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-17T20:58:41.693 INFO:teuthology.orchestra.run.trial104.stdout:197568495620 2026-02-17T20:58:41.694 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-17T20:58:41.847 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:41.848 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:41.849 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:41.849 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:41.851 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:41.939 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:41.939 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:41.940 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:41.975 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.972+0000 7fac639ae640 1 -- 10.20.193.104:0/2243428346 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fac5c10a8c0 msgr2=0x7fac5c10aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.972+0000 7fac639ae640 1 --2- 10.20.193.104:0/2243428346 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fac5c10a8c0 0x7fac5c10aca0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fac4c0099b0 tx=0x7fac4c02f220 comp rx=0 tx=0).stop 2026-02-17T20:58:41.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac639ae640 1 -- 10.20.193.104:0/2243428346 shutdown_connections 2026-02-17T20:58:41.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac639ae640 1 --2- 10.20.193.104:0/2243428346 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fac5c1048c0 0x7fac5c104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac639ae640 1 --2- 10.20.193.104:0/2243428346 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fac5c10a8c0 0x7fac5c10aca0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac639ae640 1 -- 10.20.193.104:0/2243428346 >> 10.20.193.104:0/2243428346 conn(0x7fac5c1005c0 msgr2=0x7fac5c1029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac639ae640 1 -- 10.20.193.104:0/2243428346 shutdown_connections 2026-02-17T20:58:41.976 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac639ae640 1 -- 10.20.193.104:0/2243428346 wait complete. 2026-02-17T20:58:41.977 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac639ae640 1 Processor -- start 2026-02-17T20:58:41.977 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac639ae640 1 -- start start 2026-02-17T20:58:41.977 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fc8b9978640 1 -- 10.20.193.104:0/4220995227 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc8b4108660 msgr2=0x7fc8b4108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fc8b9978640 1 --2- 10.20.193.104:0/4220995227 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc8b4108660 0x7fc8b4108a40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80099b0 tx=0x7fc8a802f220 comp rx=0 tx=0).stop 2026-02-17T20:58:41.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fc8b9978640 1 -- 10.20.193.104:0/4220995227 shutdown_connections 2026-02-17T20:58:41.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fc8b9978640 1 --2- 10.20.193.104:0/4220995227 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc8b4102660 0x7fc8b4102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fc8b9978640 1 --2- 10.20.193.104:0/4220995227 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc8b4108660 0x7fc8b4108a40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fc8b9978640 1 -- 10.20.193.104:0/4220995227 >> 10.20.193.104:0/4220995227 conn(0x7fc8b40fe360 msgr2=0x7fc8b4100780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fc8b9978640 1 -- 10.20.193.104:0/4220995227 shutdown_connections 2026-02-17T20:58:41.978 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fc8b9978640 1 -- 10.20.193.104:0/4220995227 wait complete. 2026-02-17T20:58:41.979 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac639ae640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fac5c1048c0 0x7fac5c1a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.980 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac639ae640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fac5c10a8c0 0x7fac5c1a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.980 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac639ae640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c111b00 con 0x7fac5c1048c0 2026-02-17T20:58:41.980 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac639ae640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c111980 con 0x7fac5c10a8c0 2026-02-17T20:58:41.980 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac61723640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fac5c1048c0 0x7fac5c1a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.980 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac61723640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fac5c1048c0 0x7fac5c1a25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41208/0 (socket says 10.20.193.104:41208) 2026-02-17T20:58:41.980 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac61723640 1 -- 10.20.193.104:0/1861268427 learned_addr learned my addr 10.20.193.104:0/1861268427 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:41.980 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac60f22640 1 --2- 10.20.193.104:0/1861268427 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fac5c10a8c0 0x7fac5c1a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.980 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac61723640 1 -- 10.20.193.104:0/1861268427 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fac5c10a8c0 msgr2=0x7fac5c1a2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.980 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac61723640 1 --2- 10.20.193.104:0/1861268427 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fac5c10a8c0 0x7fac5c1a2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.980 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.973+0000 7fac61723640 1 -- 10.20.193.104:0/1861268427 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c19c6a0 con 0x7fac5c1048c0 2026-02-17T20:58:41.981 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.974+0000 7fac61723640 1 --2- 10.20.193.104:0/1861268427 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fac5c1048c0 0x7fac5c1a25d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fac4c02f730 tx=0x7fac4c02fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.981 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.974+0000 7fac4a7fc640 1 -- 10.20.193.104:0/1861268427 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fac4c004260 con 0x7fac5c1048c0 2026-02-17T20:58:41.981 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.974+0000 7fac4a7fc640 1 -- 10.20.193.104:0/1861268427 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fac4c004400 con 0x7fac5c1048c0 2026-02-17T20:58:41.981 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.974+0000 7fac639ae640 1 -- 10.20.193.104:0/1861268427 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5c19c930 con 0x7fac5c1048c0 2026-02-17T20:58:41.981 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.974+0000 7fc8b9978640 1 Processor -- start 2026-02-17T20:58:41.982 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.974+0000 7fac4a7fc640 1 -- 10.20.193.104:0/1861268427 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fac4c0417b0 con 0x7fac5c1048c0 2026-02-17T20:58:41.982 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.974+0000 7fac639ae640 1 -- 10.20.193.104:0/1861268427 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5c19ce30 con 0x7fac5c1048c0 2026-02-17T20:58:41.982 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.974+0000 7fc8b9978640 1 -- start start 2026-02-17T20:58:41.982 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.974+0000 7fc8b9978640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc8b4102660 0x7fc8b419a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.974+0000 7fc8b9978640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc8b4108660 0x7fc8b419ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.974+0000 7fc8b9978640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b410f900 con 0x7fc8b4102660 2026-02-17T20:58:41.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.974+0000 7fc8b9978640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b410f780 con 0x7fc8b4108660 2026-02-17T20:58:41.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.974+0000 7fc8b27fc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc8b4108660 0x7fc8b419ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.974+0000 7fac639ae640 1 -- 10.20.193.104:0/1861268427 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac5c106000 con 0x7fac5c1048c0 2026-02-17T20:58:41.984 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.974+0000 7fc8b27fc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc8b4108660 0x7fc8b419ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.153:3300/0 says I am v2:10.20.193.104:33950/0 (socket says 10.20.193.104:33950) 2026-02-17T20:58:41.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.974+0000 7fc8b27fc640 1 -- 10.20.193.104:0/3036044842 learned_addr learned my addr 10.20.193.104:0/3036044842 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:41.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.974+0000 7fc8b2ffd640 1 --2- 10.20.193.104:0/3036044842 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc8b4102660 0x7fc8b419a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7fc8b2ffd640 1 -- 10.20.193.104:0/3036044842 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc8b4108660 msgr2=0x7fc8b419ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7fc8b2ffd640 1 --2- 10.20.193.104:0/3036044842 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc8b4108660 0x7fc8b419ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7fc8b2ffd640 1 -- 10.20.193.104:0/3036044842 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b419ef90 con 0x7fc8b4102660 2026-02-17T20:58:41.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7fac4a7fc640 1 -- 10.20.193.104:0/1861268427 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7fac4c0385d0 con 0x7fac5c1048c0 2026-02-17T20:58:41.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7fc8b2ffd640 1 --2- 10.20.193.104:0/3036044842 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc8b4102660 0x7fc8b419a6c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009980 tx=0x7fc8a8002960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7fc8b8976640 1 -- 10.20.193.104:0/3036044842 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc8a8046070 con 0x7fc8b4102660 2026-02-17T20:58:41.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7fc8b8976640 1 -- 10.20.193.104:0/3036044842 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fc8a80044b0 con 0x7fc8b4102660 2026-02-17T20:58:41.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7fc8b8976640 1 -- 10.20.193.104:0/3036044842 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc8a8041800 con 0x7fc8b4102660 2026-02-17T20:58:41.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7fc8b9978640 1 -- 10.20.193.104:0/3036044842 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b419f220 con 0x7fc8b4102660 2026-02-17T20:58:41.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7fc8b9978640 1 -- 10.20.193.104:0/3036044842 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b419f750 con 0x7fc8b4102660 2026-02-17T20:58:41.986 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7faa2b89b640 1 -- 10.20.193.104:0/3729317528 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faa24104180 msgr2=0x7faa2410c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7faa2b89b640 1 --2- 10.20.193.104:0/3729317528 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faa24104180 0x7faa2410c670 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faa180099e0 tx=0x7faa1802f2f0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7faa2b89b640 1 -- 10.20.193.104:0/3729317528 shutdown_connections 2026-02-17T20:58:41.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7faa2b89b640 1 --2- 10.20.193.104:0/3729317528 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faa24104180 0x7faa2410c670 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7faa2b89b640 1 --2- 10.20.193.104:0/3729317528 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faa24103860 0x7faa24103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7faa2b89b640 1 -- 10.20.193.104:0/3729317528 >> 10.20.193.104:0/3729317528 conn(0x7faa240fd220 msgr2=0x7faa240ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7faa2b89b640 1 -- 10.20.193.104:0/3729317528 shutdown_connections 2026-02-17T20:58:41.987 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7faa2b89b640 1 -- 10.20.193.104:0/3729317528 wait complete. 2026-02-17T20:58:41.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7f37c7aea640 1 -- 10.20.193.104:0/3315118958 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37c010a8b0 msgr2=0x7f37c010ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7f37c7aea640 1 --2- 10.20.193.104:0/3315118958 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37c010a8b0 0x7f37c010ac90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f37b00099b0 tx=0x7f37b002f220 comp rx=0 tx=0).stop 2026-02-17T20:58:41.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7fac4a7fc640 1 --2- 10.20.193.104:0/1861268427 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fac380775a0 0x7fac38079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7fac4a7fc640 1 -- 10.20.193.104:0/1861268427 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7fac4c03e070 con 0x7fac5c1048c0 2026-02-17T20:58:41.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7fac60f22640 1 --2- 10.20.193.104:0/1861268427 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fac380775a0 0x7fac38079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.988 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7faa2b89b640 1 Processor -- start 2026-02-17T20:58:41.989 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7fc8927fc640 1 -- 10.20.193.104:0/3036044842 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b4103da0 con 0x7fc8b4102660 2026-02-17T20:58:41.989 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7faa2b89b640 1 -- start start 2026-02-17T20:58:41.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.975+0000 7f37c7aea640 1 -- 10.20.193.104:0/3315118958 shutdown_connections 2026-02-17T20:58:41.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7f37c7aea640 1 --2- 10.20.193.104:0/3315118958 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f37c01048b0 0x7f37c0104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7f37c7aea640 1 --2- 10.20.193.104:0/3315118958 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37c010a8b0 0x7f37c010ac90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7f37c7aea640 1 -- 10.20.193.104:0/3315118958 >> 10.20.193.104:0/3315118958 conn(0x7f37c01005f0 msgr2=0x7f37c0102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:41.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7f37c7aea640 1 -- 10.20.193.104:0/3315118958 shutdown_connections 2026-02-17T20:58:41.990 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7f37c7aea640 1 -- 10.20.193.104:0/3315118958 wait complete. 2026-02-17T20:58:41.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7faa2b89b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faa24103860 0x7faa24102eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7faa2b89b640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faa24104180 0x7faa24101440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7faa2b89b640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7faa2410f8c0 con 0x7faa24103860 2026-02-17T20:58:41.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7faa2b89b640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7faa2410f740 con 0x7faa24104180 2026-02-17T20:58:41.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7faa29610640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faa24103860 0x7faa24102eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7faa29610640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faa24103860 0x7faa24102eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41244/0 (socket says 10.20.193.104:41244) 2026-02-17T20:58:41.991 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7faa29610640 1 -- 10.20.193.104:0/786635 learned_addr learned my addr 10.20.193.104:0/786635 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:41.992 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7fc8b8976640 1 -- 10.20.193.104:0/3036044842 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7fc8a8038bf0 con 0x7fc8b4102660 2026-02-17T20:58:41.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7faa29610640 1 -- 10.20.193.104:0/786635 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faa24104180 msgr2=0x7faa24101440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7faa28e0f640 1 --2- 10.20.193.104:0/786635 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faa24104180 0x7faa24101440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7faa29610640 1 --2- 10.20.193.104:0/786635 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faa24104180 0x7faa24101440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7faa29610640 1 -- 10.20.193.104:0/786635 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa24101980 con 0x7faa24103860 2026-02-17T20:58:41.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7faa28e0f640 1 --2- 10.20.193.104:0/786635 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faa24104180 0x7faa24101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T20:58:41.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7faa29610640 1 --2- 10.20.193.104:0/786635 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faa24103860 0x7faa24102eb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faa1400e9e0 tx=0x7faa1400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.994 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7f37c7aea640 1 Processor -- start 2026-02-17T20:58:41.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7fc8b8976640 1 --2- 10.20.193.104:0/3036044842 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc888077550 0x7fc888079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7f37c7aea640 1 -- start start 2026-02-17T20:58:41.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7fac60f22640 1 --2- 10.20.193.104:0/1861268427 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fac380775a0 0x7fac38079a60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fac5c19def0 tx=0x7fac50005f50 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.976+0000 7fc8b27fc640 1 --2- 10.20.193.104:0/3036044842 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc888077550 0x7fc888079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.977+0000 7fc8b27fc640 1 --2- 10.20.193.104:0/3036044842 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc888077550 0x7fc888079a10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4107f70 tx=0x7fc89c004050 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.977+0000 7f37c7aea640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f37c01048b0 0x7f37c01a25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.977+0000 7f37c7aea640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37c010a8b0 0x7f37c01a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:41.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.977+0000 7f37c7aea640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f37c0111ad0 con 0x7f37c010a8b0 2026-02-17T20:58:41.997 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.977+0000 7f37c7aea640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f37c0111950 con 0x7f37c01048b0 2026-02-17T20:58:41.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.977+0000 7f37c505e640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37c010a8b0 0x7f37c01a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.977+0000 7f37c505e640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37c010a8b0 0x7f37c01a2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41252/0 (socket says 10.20.193.104:41252) 2026-02-17T20:58:41.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.977+0000 7f37c505e640 1 -- 10.20.193.104:0/755981972 learned_addr learned my addr 10.20.193.104:0/755981972 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:41.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.977+0000 7f37c585f640 1 --2- 10.20.193.104:0/755981972 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f37c01048b0 0x7f37c01a25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:41.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.977+0000 7f37c505e640 1 -- 10.20.193.104:0/755981972 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f37c01048b0 msgr2=0x7f37c01a25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:41.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.977+0000 7f37c505e640 1 --2- 10.20.193.104:0/755981972 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f37c01048b0 0x7f37c01a25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:41.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.977+0000 7f37c505e640 1 -- 10.20.193.104:0/755981972 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c019c6c0 con 0x7f37c010a8b0 2026-02-17T20:58:41.998 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.978+0000 7faa127fc640 1 -- 10.20.193.104:0/786635 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7faa1400cbe0 con 0x7faa24103860 2026-02-17T20:58:41.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.978+0000 7faa2b89b640 1 -- 10.20.193.104:0/786635 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa24101c70 con 0x7faa24103860 2026-02-17T20:58:41.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.978+0000 7faa2b89b640 1 -- 10.20.193.104:0/786635 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa24102200 con 0x7faa24103860 2026-02-17T20:58:41.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.978+0000 7faa2b89b640 1 -- 10.20.193.104:0/786635 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa2406b6d0 con 0x7faa24103860 2026-02-17T20:58:41.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.977+0000 7f37c505e640 1 --2- 10.20.193.104:0/755981972 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37c010a8b0 0x7f37c01a2b30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f37b400d8d0 tx=0x7f37b400dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:41.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.978+0000 7f37aeffd640 1 -- 10.20.193.104:0/755981972 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f37b4014070 con 0x7f37c010a8b0 2026-02-17T20:58:41.999 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.978+0000 7f37c7aea640 1 -- 10.20.193.104:0/755981972 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c019c9b0 con 0x7f37c010a8b0 2026-02-17T20:58:42.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.978+0000 7f37c7aea640 1 -- 10.20.193.104:0/755981972 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c019cf10 con 0x7f37c010a8b0 2026-02-17T20:58:42.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.978+0000 7f37c7aea640 1 -- 10.20.193.104:0/755981972 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37c0105ff0 con 0x7f37c010a8b0 2026-02-17T20:58:42.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.980+0000 7f37aeffd640 1 -- 10.20.193.104:0/755981972 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f37b40044a0 con 0x7f37c010a8b0 2026-02-17T20:58:42.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.980+0000 7f37aeffd640 1 -- 10.20.193.104:0/755981972 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f37b401e060 con 0x7f37c010a8b0 2026-02-17T20:58:42.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.980+0000 7faa127fc640 1 -- 10.20.193.104:0/786635 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7faa14004540 con 0x7faa24103860 2026-02-17T20:58:42.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.980+0000 7faa127fc640 1 -- 10.20.193.104:0/786635 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7faa14010430 con 0x7faa24103860 2026-02-17T20:58:42.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.981+0000 7f55f8524640 1 -- 10.20.193.104:0/2103831683 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55f01048c0 msgr2=0x7f55f0104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.981+0000 7f55f8524640 1 --2- 10.20.193.104:0/2103831683 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55f01048c0 0x7f55f0104d20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f55e40099b0 tx=0x7f55e402f240 comp rx=0 tx=0).stop 2026-02-17T20:58:42.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.981+0000 7fc8b8976640 1 -- 10.20.193.104:0/3036044842 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7fc8a803e070 con 0x7fc8b4102660 2026-02-17T20:58:42.001 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.981+0000 7fac4a7fc640 1 -- 10.20.193.104:0/1861268427 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fac4c08b400 con 0x7fac5c1048c0 2026-02-17T20:58:42.002 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.981+0000 7fc8b8976640 1 -- 10.20.193.104:0/3036044842 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc8a808b390 con 0x7fc8b4102660 2026-02-17T20:58:42.002 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.981+0000 7f37aeffd640 1 -- 10.20.193.104:0/755981972 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f37b4023480 con 0x7f37c010a8b0 2026-02-17T20:58:42.002 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.981+0000 7f55f8524640 1 -- 10.20.193.104:0/2103831683 shutdown_connections 2026-02-17T20:58:42.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.981+0000 7f55f8524640 1 --2- 10.20.193.104:0/2103831683 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55f01048c0 0x7f55f0104d20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.981+0000 7f55f8524640 1 --2- 10.20.193.104:0/2103831683 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f55f010a8c0 0x7f55f010aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.981+0000 7f55f8524640 1 -- 10.20.193.104:0/2103831683 >> 10.20.193.104:0/2103831683 conn(0x7f55f01005c0 msgr2=0x7f55f01029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:42.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.981+0000 7f55f8524640 1 -- 10.20.193.104:0/2103831683 shutdown_connections 2026-02-17T20:58:42.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.981+0000 7f55f8524640 1 -- 10.20.193.104:0/2103831683 wait complete. 2026-02-17T20:58:42.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.981+0000 7faa127fc640 1 -- 10.20.193.104:0/786635 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7faa140026e0 con 0x7faa24103860 2026-02-17T20:58:42.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.981+0000 7f37aeffd640 1 --2- 10.20.193.104:0/755981972 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f379c0775a0 0x7f379c079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7f55f8524640 1 Processor -- start 2026-02-17T20:58:42.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7f55f8524640 1 -- start start 2026-02-17T20:58:42.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7f37c585f640 1 --2- 10.20.193.104:0/755981972 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f379c0775a0 0x7f379c079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7f37aeffd640 1 -- 10.20.193.104:0/755981972 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f37b4099ce0 con 0x7f37c010a8b0 2026-02-17T20:58:42.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7faa127fc640 1 --2- 10.20.193.104:0/786635 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7faa000775a0 0x7faa00079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7f55f8524640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55f01048c0 0x7f55f01a2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7f55f8524640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f55f010a8c0 0x7f55f01a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7f55f8524640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f55f0111b80 con 0x7f55f01048c0 2026-02-17T20:58:42.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7f55f8524640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f55f0111a00 con 0x7f55f010a8c0 2026-02-17T20:58:42.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7faa28e0f640 1 --2- 10.20.193.104:0/786635 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7faa000775a0 0x7faa00079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7faa127fc640 1 -- 10.20.193.104:0/786635 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7faa14099dc0 con 0x7faa24103860 2026-02-17T20:58:42.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7f55f6299640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55f01048c0 0x7f55f01a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7f55f6299640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55f01048c0 0x7f55f01a2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41264/0 (socket says 10.20.193.104:41264) 2026-02-17T20:58:42.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7f55f6299640 1 -- 10.20.193.104:0/260448519 learned_addr learned my addr 10.20.193.104:0/260448519 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:42.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7f55f5a98640 1 --2- 10.20.193.104:0/260448519 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f55f010a8c0 0x7f55f01a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7f55f6299640 1 -- 10.20.193.104:0/260448519 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f55f010a8c0 msgr2=0x7f55f01a2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7f55f6299640 1 --2- 10.20.193.104:0/260448519 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f55f010a8c0 0x7f55f01a2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7f55f6299640 1 -- 10.20.193.104:0/260448519 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f019c790 con 0x7f55f01048c0 2026-02-17T20:58:42.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7faa28e0f640 1 --2- 10.20.193.104:0/786635 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7faa000775a0 0x7faa00079a60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faa18004870 tx=0x7faa18004800 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:42.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7f55f6299640 1 --2- 10.20.193.104:0/260448519 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55f01048c0 0x7f55f01a2610 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f55e000b4f0 tx=0x7f55e000b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:42.009 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.982+0000 7f37c585f640 1 --2- 10.20.193.104:0/755981972 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f379c0775a0 0x7f379c079a60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f37b0004870 tx=0x7f37b00047c0 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:42.009 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.983+0000 7faa127fc640 1 -- 10.20.193.104:0/786635 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7faa14066f90 con 0x7faa24103860 2026-02-17T20:58:42.009 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.985+0000 7f55d77fe640 1 -- 10.20.193.104:0/260448519 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f55e0004440 con 0x7f55f01048c0 2026-02-17T20:58:42.010 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.985+0000 7f37aeffd640 1 -- 10.20.193.104:0/755981972 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f37b4066eb0 con 0x7f37c010a8b0 2026-02-17T20:58:42.010 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.985+0000 7f55d77fe640 1 -- 10.20.193.104:0/260448519 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f55e0015070 con 0x7f55f01048c0 2026-02-17T20:58:42.011 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.985+0000 7f55f8524640 1 -- 10.20.193.104:0/260448519 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f019ca80 con 0x7f55f01048c0 2026-02-17T20:58:42.011 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.985+0000 7f55d77fe640 1 -- 10.20.193.104:0/260448519 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f55e0010b20 con 0x7f55f01048c0 2026-02-17T20:58:42.011 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.985+0000 7f55f8524640 1 -- 10.20.193.104:0/260448519 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f019d010 con 0x7f55f01048c0 2026-02-17T20:58:42.011 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.986+0000 7f55f8524640 1 -- 10.20.193.104:0/260448519 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55f0106000 con 0x7f55f01048c0 2026-02-17T20:58:42.011 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.986+0000 7f55d77fe640 1 -- 10.20.193.104:0/260448519 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f55e0002780 con 0x7f55f01048c0 2026-02-17T20:58:42.011 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.987+0000 7f55d77fe640 1 --2- 10.20.193.104:0/260448519 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f55cc0775a0 0x7f55cc079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.011 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.987+0000 7f55d77fe640 1 -- 10.20.193.104:0/260448519 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f55e0099090 con 0x7f55f01048c0 2026-02-17T20:58:42.011 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.987+0000 7f55f5a98640 1 --2- 10.20.193.104:0/260448519 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f55cc0775a0 0x7f55cc079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.011 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.987+0000 7f55f5a98640 1 --2- 10.20.193.104:0/260448519 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f55cc0775a0 0x7f55cc079a60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f55e40097c0 tx=0x7f55e403a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:42.011 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:41.989+0000 7f55d77fe640 1 -- 10.20.193.104:0/260448519 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f55e0066120 con 0x7f55f01048c0 2026-02-17T20:58:42.057 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f2bff3dc640 1 -- 10.20.193.104:0/103627029 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2bf8108660 msgr2=0x7f2bf8108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f2bff3dc640 1 --2- 10.20.193.104:0/103627029 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2bf8108660 0x7f2bf8108a40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2be80099b0 tx=0x7f2be802f220 comp rx=0 tx=0).stop 2026-02-17T20:58:42.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f2bff3dc640 1 -- 10.20.193.104:0/103627029 shutdown_connections 2026-02-17T20:58:42.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f2bff3dc640 1 --2- 10.20.193.104:0/103627029 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2bf8102660 0x7f2bf8102ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f2bff3dc640 1 --2- 10.20.193.104:0/103627029 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2bf8108660 0x7f2bf8108a40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f2bff3dc640 1 -- 10.20.193.104:0/103627029 >> 10.20.193.104:0/103627029 conn(0x7f2bf80fe360 msgr2=0x7f2bf8100780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:42.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f2bff3dc640 1 -- 10.20.193.104:0/103627029 shutdown_connections 2026-02-17T20:58:42.058 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f2bff3dc640 1 -- 10.20.193.104:0/103627029 wait complete. 2026-02-17T20:58:42.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f210a14d640 1 -- 10.20.193.104:0/2418721951 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f210410a8c0 msgr2=0x7f210410aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f210a14d640 1 --2- 10.20.193.104:0/2418721951 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f210410a8c0 0x7f210410aca0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f20f800b0a0 tx=0x7f20f802f4a0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f210a14d640 1 -- 10.20.193.104:0/2418721951 shutdown_connections 2026-02-17T20:58:42.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f210a14d640 1 --2- 10.20.193.104:0/2418721951 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f21041048c0 0x7f2104104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f210a14d640 1 --2- 10.20.193.104:0/2418721951 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f210410a8c0 0x7f210410aca0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f210a14d640 1 -- 10.20.193.104:0/2418721951 >> 10.20.193.104:0/2418721951 conn(0x7f21041005c0 msgr2=0x7f21041029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:42.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f210a14d640 1 -- 10.20.193.104:0/2418721951 shutdown_connections 2026-02-17T20:58:42.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f210a14d640 1 -- 10.20.193.104:0/2418721951 wait complete. 2026-02-17T20:58:42.059 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f412c9f6640 1 -- 10.20.193.104:0/2774740353 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4124075410 msgr2=0x7f41240757f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f412c9f6640 1 --2- 10.20.193.104:0/2774740353 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4124075410 0x7f41240757f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f411c0099b0 tx=0x7f411c02f2b0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f412c9f6640 1 -- 10.20.193.104:0/2774740353 shutdown_connections 2026-02-17T20:58:42.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f412c9f6640 1 --2- 10.20.193.104:0/2774740353 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4124075d30 0x7f412410ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f412c9f6640 1 --2- 10.20.193.104:0/2774740353 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4124075410 0x7f41240757f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f412c9f6640 1 -- 10.20.193.104:0/2774740353 >> 10.20.193.104:0/2774740353 conn(0x7f41240fe380 msgr2=0x7f41241007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:42.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f412c9f6640 1 -- 10.20.193.104:0/2774740353 shutdown_connections 2026-02-17T20:58:42.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.054+0000 7f412c9f6640 1 -- 10.20.193.104:0/2774740353 wait complete. 2026-02-17T20:58:42.060 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f2bff3dc640 1 Processor -- start 2026-02-17T20:58:42.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f210a14d640 1 Processor -- start 2026-02-17T20:58:42.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f412c9f6640 1 Processor -- start 2026-02-17T20:58:42.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f210a14d640 1 -- start start 2026-02-17T20:58:42.061 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f2bff3dc640 1 -- start start 2026-02-17T20:58:42.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f412c9f6640 1 -- start start 2026-02-17T20:58:42.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f210a14d640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f21041048c0 0x7f21041a2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f210a14d640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f210410a8c0 0x7f21041a2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f210a14d640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2104111ae0 con 0x7f21041048c0 2026-02-17T20:58:42.062 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f210a14d640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2104111960 con 0x7f210410a8c0 2026-02-17T20:58:42.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f412c9f6640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4124075410 0x7f41241a25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f412c9f6640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4124075d30 0x7f41241a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f412c9f6640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f4124111b10 con 0x7f4124075410 2026-02-17T20:58:42.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f412c9f6640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f4124111990 con 0x7f4124075d30 2026-02-17T20:58:42.063 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f412a76b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4124075410 0x7f41241a25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f21037fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f21041048c0 0x7f21041a2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f21037fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f21041048c0 0x7f21041a2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41300/0 (socket says 10.20.193.104:41300) 2026-02-17T20:58:42.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f21037fe640 1 -- 10.20.193.104:0/2519151805 learned_addr learned my addr 10.20.193.104:0/2519151805 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:42.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f21037fe640 1 -- 10.20.193.104:0/2519151805 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f210410a8c0 msgr2=0x7f21041a2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f2102ffd640 1 --2- 10.20.193.104:0/2519151805 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f210410a8c0 0x7f21041a2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.064 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f21037fe640 1 --2- 10.20.193.104:0/2519151805 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f210410a8c0 0x7f21041a2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f21037fe640 1 -- 10.20.193.104:0/2519151805 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210419c610 con 0x7f21041048c0 2026-02-17T20:58:42.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f412a76b640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4124075410 0x7f41241a25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41302/0 (socket says 10.20.193.104:41302) 2026-02-17T20:58:42.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f412a76b640 1 -- 10.20.193.104:0/3989274560 learned_addr learned my addr 10.20.193.104:0/3989274560 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:42.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f2bff3dc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2bf8102660 0x7f2bf8075370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.065 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f2bff3dc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2bf8108660 0x7f2bf80758b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f2bff3dc640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf810f880 con 0x7f2bf8102660 2026-02-17T20:58:42.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f2bff3dc640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf810f700 con 0x7f2bf8108660 2026-02-17T20:58:42.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f4129f6a640 1 --2- 10.20.193.104:0/3989274560 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4124075d30 0x7f41241a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f412a76b640 1 -- 10.20.193.104:0/3989274560 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4124075d30 msgr2=0x7f41241a2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f412a76b640 1 --2- 10.20.193.104:0/3989274560 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4124075d30 0x7f41241a2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.066 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f412a76b640 1 -- 10.20.193.104:0/3989274560 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f412419c6c0 con 0x7f4124075410 2026-02-17T20:58:42.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f2bfd151640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2bf8102660 0x7f2bf8075370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f2bfd151640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2bf8102660 0x7f2bf8075370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41314/0 (socket says 10.20.193.104:41314) 2026-02-17T20:58:42.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f2bfd151640 1 -- 10.20.193.104:0/3508748572 learned_addr learned my addr 10.20.193.104:0/3508748572 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:42.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f21037fe640 1 --2- 10.20.193.104:0/2519151805 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f21041048c0 0x7f21041a2450 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f20f800b1d0 tx=0x7f20f8002a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:42.067 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f2bfc950640 1 --2- 10.20.193.104:0/3508748572 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2bf8108660 0x7f2bf80758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.055+0000 7f2100ff9640 1 -- 10.20.193.104:0/2519151805 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f20f8002dc0 con 0x7f21041048c0 2026-02-17T20:58:42.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f412a76b640 1 --2- 10.20.193.104:0/3989274560 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4124075410 0x7f41241a25f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f411c002410 tx=0x7f411c0026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:42.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f2100ff9640 1 -- 10.20.193.104:0/2519151805 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f20f80048b0 con 0x7f21041048c0 2026-02-17T20:58:42.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f2100ff9640 1 -- 10.20.193.104:0/2519151805 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f20f8038640 con 0x7f21041048c0 2026-02-17T20:58:42.068 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f210a14d640 1 -- 10.20.193.104:0/2519151805 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f210419c8a0 con 0x7f21041048c0 2026-02-17T20:58:42.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f2bfd151640 1 -- 10.20.193.104:0/3508748572 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2bf8108660 msgr2=0x7f2bf80758b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f2bfd151640 1 --2- 10.20.193.104:0/3508748572 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2bf8108660 0x7f2bf80758b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f2bfd151640 1 -- 10.20.193.104:0/3508748572 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf8075df0 con 0x7f2bf8102660 2026-02-17T20:58:42.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f410f7fe640 1 -- 10.20.193.104:0/3989274560 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f411c046070 con 0x7f4124075410 2026-02-17T20:58:42.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f210a14d640 1 -- 10.20.193.104:0/2519151805 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f210419cdd0 con 0x7f21041048c0 2026-02-17T20:58:42.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f410f7fe640 1 -- 10.20.193.104:0/3989274560 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f411c002bd0 con 0x7f4124075410 2026-02-17T20:58:42.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f412c9f6640 1 -- 10.20.193.104:0/3989274560 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f412419c950 con 0x7f4124075410 2026-02-17T20:58:42.070 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f2bfd151640 1 --2- 10.20.193.104:0/3508748572 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2bf8102660 0x7f2bf8075370 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2be802f730 tx=0x7f2be802fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:42.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f410f7fe640 1 -- 10.20.193.104:0/3989274560 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f411c041630 con 0x7f4124075410 2026-02-17T20:58:42.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f412c9f6640 1 -- 10.20.193.104:0/3989274560 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f412419ce50 con 0x7f4124075410 2026-02-17T20:58:42.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f210a14d640 1 -- 10.20.193.104:0/2519151805 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2104106000 con 0x7f21041048c0 2026-02-17T20:58:42.071 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f412c9f6640 1 -- 10.20.193.104:0/3989274560 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4124076b50 con 0x7f4124075410 2026-02-17T20:58:42.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f2be67fc640 1 -- 10.20.193.104:0/3508748572 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f2be8004210 con 0x7f2bf8102660 2026-02-17T20:58:42.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f2be67fc640 1 -- 10.20.193.104:0/3508748572 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f2be80043b0 con 0x7f2bf8102660 2026-02-17T20:58:42.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f2bff3dc640 1 -- 10.20.193.104:0/3508748572 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf8076080 con 0x7f2bf8102660 2026-02-17T20:58:42.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f2be67fc640 1 -- 10.20.193.104:0/3508748572 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f2be80416b0 con 0x7f2bf8102660 2026-02-17T20:58:42.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.056+0000 7f2bff3dc640 1 -- 10.20.193.104:0/3508748572 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf81a6ae0 con 0x7f2bf8102660 2026-02-17T20:58:42.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.057+0000 7f2bff3dc640 1 -- 10.20.193.104:0/3508748572 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf8103da0 con 0x7f2bf8102660 2026-02-17T20:58:42.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.057+0000 7f410f7fe640 1 -- 10.20.193.104:0/3989274560 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f411c038470 con 0x7f4124075410 2026-02-17T20:58:42.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.057+0000 7f2100ff9640 1 -- 10.20.193.104:0/2519151805 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f20f8007960 con 0x7f21041048c0 2026-02-17T20:58:42.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.057+0000 7f410f7fe640 1 --2- 10.20.193.104:0/3989274560 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f41000775a0 0x7f4100079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.057+0000 7f410f7fe640 1 -- 10.20.193.104:0/3989274560 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f411c03e070 con 0x7f4124075410 2026-02-17T20:58:42.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.057+0000 7f2100ff9640 1 --2- 10.20.193.104:0/2519151805 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f20d80775a0 0x7f20d8079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.057+0000 7f4129f6a640 1 --2- 10.20.193.104:0/3989274560 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f41000775a0 0x7f4100079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.057+0000 7f2be67fc640 1 -- 10.20.193.104:0/3508748572 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f2be8041850 con 0x7f2bf8102660 2026-02-17T20:58:42.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.057+0000 7f2100ff9640 1 -- 10.20.193.104:0/2519151805 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f20f80bde60 con 0x7f21041048c0 2026-02-17T20:58:42.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.057+0000 7f2102ffd640 1 --2- 10.20.193.104:0/2519151805 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f20d80775a0 0x7f20d8079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.058+0000 7f4129f6a640 1 --2- 10.20.193.104:0/3989274560 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f41000775a0 0x7f4100079a60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4110005e00 tx=0x7f4110005d50 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:42.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.058+0000 7f2102ffd640 1 --2- 10.20.193.104:0/2519151805 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f20d80775a0 0x7f20d8079a60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f20f4005fd0 tx=0x7f20f4005950 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:42.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.058+0000 7f2be67fc640 1 --2- 10.20.193.104:0/3508748572 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f2bd4077550 0x7f2bd4079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.058+0000 7f2be67fc640 1 -- 10.20.193.104:0/3508748572 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f2be803e070 con 0x7f2bf8102660 2026-02-17T20:58:42.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.058+0000 7f2bfc950640 1 --2- 10.20.193.104:0/3508748572 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f2bd4077550 0x7f2bd4079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.058+0000 7f2bfc950640 1 --2- 10.20.193.104:0/3508748572 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f2bd4077550 0x7f2bd4079a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8076e00 tx=0x7f2bec009290 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:42.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.059+0000 7f2100ff9640 1 -- 10.20.193.104:0/2519151805 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f20f80ee9f0 con 0x7f21041048c0 2026-02-17T20:58:42.077 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.062+0000 7f410f7fe640 1 -- 10.20.193.104:0/3989274560 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f411c04f070 con 0x7f4124075410 2026-02-17T20:58:42.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.064+0000 7f2be67fc640 1 -- 10.20.193.104:0/3508748572 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f2be808b6a0 con 0x7f2bf8102660 2026-02-17T20:58:42.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.072+0000 7fc8927fc640 1 -- 10.20.193.104:0/3036044842 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fc8b419fa00 con 0x7fc8b4102660 2026-02-17T20:58:42.078 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.072+0000 7fc8b8976640 1 -- 10.20.193.104:0/3036044842 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc8a8090240 con 0x7fc8b4102660 2026-02-17T20:58:42.078 INFO:teuthology.orchestra.run.trial104.stdout:60129542159 2026-02-17T20:58:42.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.072+0000 7fac639ae640 1 -- 10.20.193.104:0/1861268427 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fac5c19d0e0 con 0x7fac5c1048c0 2026-02-17T20:58:42.079 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.072+0000 7fac4a7fc640 1 -- 10.20.193.104:0/1861268427 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fac4c0902b0 con 0x7fac5c1048c0 2026-02-17T20:58:42.079 INFO:teuthology.orchestra.run.trial104.stdout:77309411341 2026-02-17T20:58:42.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fc8927fc640 1 -- 10.20.193.104:0/3036044842 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc888077550 msgr2=0x7fc888079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fc8927fc640 1 --2- 10.20.193.104:0/3036044842 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc888077550 0x7fc888079a10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4107f70 tx=0x7fc89c004050 comp rx=0 tx=0).stop 2026-02-17T20:58:42.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fc8927fc640 1 -- 10.20.193.104:0/3036044842 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc8b4102660 msgr2=0x7fc8b419a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fc8927fc640 1 --2- 10.20.193.104:0/3036044842 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc8b4102660 0x7fc8b419a6c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc8a8009980 tx=0x7fc8a8002960 comp rx=0 tx=0).stop 2026-02-17T20:58:42.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fc8927fc640 1 -- 10.20.193.104:0/3036044842 shutdown_connections 2026-02-17T20:58:42.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fc8927fc640 1 --2- 10.20.193.104:0/3036044842 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc888077550 0x7fc888079a10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fc8927fc640 1 --2- 10.20.193.104:0/3036044842 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc8b4108660 0x7fc8b419ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fc8927fc640 1 --2- 10.20.193.104:0/3036044842 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc8b4102660 0x7fc8b419a6c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fc8927fc640 1 -- 10.20.193.104:0/3036044842 >> 10.20.193.104:0/3036044842 conn(0x7fc8b40fe360 msgr2=0x7fc8b40ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:42.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fc8927fc640 1 -- 10.20.193.104:0/3036044842 shutdown_connections 2026-02-17T20:58:42.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fc8927fc640 1 -- 10.20.193.104:0/3036044842 wait complete. 2026-02-17T20:58:42.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fac639ae640 1 -- 10.20.193.104:0/1861268427 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fac380775a0 msgr2=0x7fac38079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fac639ae640 1 --2- 10.20.193.104:0/1861268427 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fac380775a0 0x7fac38079a60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fac5c19def0 tx=0x7fac50005f50 comp rx=0 tx=0).stop 2026-02-17T20:58:42.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fac639ae640 1 -- 10.20.193.104:0/1861268427 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fac5c1048c0 msgr2=0x7fac5c1a25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fac639ae640 1 --2- 10.20.193.104:0/1861268427 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fac5c1048c0 0x7fac5c1a25d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fac4c02f730 tx=0x7fac4c02fd20 comp rx=0 tx=0).stop 2026-02-17T20:58:42.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fac639ae640 1 -- 10.20.193.104:0/1861268427 shutdown_connections 2026-02-17T20:58:42.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fac639ae640 1 --2- 10.20.193.104:0/1861268427 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fac380775a0 0x7fac38079a60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fac639ae640 1 --2- 10.20.193.104:0/1861268427 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fac5c10a8c0 0x7fac5c1a2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fac639ae640 1 --2- 10.20.193.104:0/1861268427 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fac5c1048c0 0x7fac5c1a25d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fac639ae640 1 -- 10.20.193.104:0/1861268427 >> 10.20.193.104:0/1861268427 conn(0x7fac5c1005c0 msgr2=0x7fac5c1017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:42.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fac639ae640 1 -- 10.20.193.104:0/1861268427 shutdown_connections 2026-02-17T20:58:42.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.074+0000 7fac639ae640 1 -- 10.20.193.104:0/1861268427 wait complete. 2026-02-17T20:58:42.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.079+0000 7faa2b89b640 1 -- 10.20.193.104:0/786635 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7faa24103c40 con 0x7faa24103860 2026-02-17T20:58:42.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.079+0000 7faa127fc640 1 -- 10.20.193.104:0/786635 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa1406be40 con 0x7faa24103860 2026-02-17T20:58:42.083 INFO:teuthology.orchestra.run.trial104.stdout:42949672976 2026-02-17T20:58:42.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.080+0000 7f37c7aea640 1 -- 10.20.193.104:0/755981972 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f37c0104d10 con 0x7f37c010a8b0 2026-02-17T20:58:42.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.080+0000 7f37aeffd640 1 -- 10.20.193.104:0/755981972 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f37b406bd60 con 0x7f37c010a8b0 2026-02-17T20:58:42.084 INFO:teuthology.orchestra.run.trial104.stdout:107374182412 2026-02-17T20:58:42.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.081+0000 7faa2b89b640 1 -- 10.20.193.104:0/786635 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7faa000775a0 msgr2=0x7faa00079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.081+0000 7faa2b89b640 1 --2- 10.20.193.104:0/786635 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7faa000775a0 0x7faa00079a60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7faa18004870 tx=0x7faa18004800 comp rx=0 tx=0).stop 2026-02-17T20:58:42.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.081+0000 7faa2b89b640 1 -- 10.20.193.104:0/786635 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faa24103860 msgr2=0x7faa24102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.081+0000 7faa2b89b640 1 --2- 10.20.193.104:0/786635 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faa24103860 0x7faa24102eb0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faa1400e9e0 tx=0x7faa1400eeb0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.081+0000 7faa2b89b640 1 -- 10.20.193.104:0/786635 shutdown_connections 2026-02-17T20:58:42.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.081+0000 7faa2b89b640 1 --2- 10.20.193.104:0/786635 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7faa000775a0 0x7faa00079a60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.081+0000 7faa2b89b640 1 --2- 10.20.193.104:0/786635 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7faa24104180 0x7faa24101440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.081+0000 7faa2b89b640 1 --2- 10.20.193.104:0/786635 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7faa24103860 0x7faa24102eb0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.081+0000 7faa2b89b640 1 -- 10.20.193.104:0/786635 >> 10.20.193.104:0/786635 conn(0x7faa240fd220 msgr2=0x7faa24104aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:42.085 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.082+0000 7faa2b89b640 1 -- 10.20.193.104:0/786635 shutdown_connections 2026-02-17T20:58:42.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.082+0000 7faa2b89b640 1 -- 10.20.193.104:0/786635 wait complete. 2026-02-17T20:58:42.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.082+0000 7f37c7aea640 1 -- 10.20.193.104:0/755981972 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f379c0775a0 msgr2=0x7f379c079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.086 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.082+0000 7f37c7aea640 1 --2- 10.20.193.104:0/755981972 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f379c0775a0 0x7f379c079a60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f37b0004870 tx=0x7f37b00047c0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.082+0000 7f37c7aea640 1 -- 10.20.193.104:0/755981972 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37c010a8b0 msgr2=0x7f37c01a2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.082+0000 7f37c7aea640 1 --2- 10.20.193.104:0/755981972 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37c010a8b0 0x7f37c01a2b30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f37b400d8d0 tx=0x7f37b400dda0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.083+0000 7f37c7aea640 1 -- 10.20.193.104:0/755981972 shutdown_connections 2026-02-17T20:58:42.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.083+0000 7f37c7aea640 1 --2- 10.20.193.104:0/755981972 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f379c0775a0 0x7f379c079a60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.083+0000 7f37c7aea640 1 --2- 10.20.193.104:0/755981972 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f37c010a8b0 0x7f37c01a2b30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.083+0000 7f37c7aea640 1 --2- 10.20.193.104:0/755981972 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f37c01048b0 0x7f37c01a25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.083+0000 7f37c7aea640 1 -- 10.20.193.104:0/755981972 >> 10.20.193.104:0/755981972 conn(0x7f37c01005f0 msgr2=0x7f37c0102850 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:42.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.083+0000 7f37c7aea640 1 -- 10.20.193.104:0/755981972 shutdown_connections 2026-02-17T20:58:42.087 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.083+0000 7f37c7aea640 1 -- 10.20.193.104:0/755981972 wait complete. 2026-02-17T20:58:42.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.083+0000 7f55f8524640 1 -- 10.20.193.104:0/260448519 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f55f019d2c0 con 0x7f55f01048c0 2026-02-17T20:58:42.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.083+0000 7f55d77fe640 1 -- 10.20.193.104:0/260448519 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f55e006afd0 con 0x7f55f01048c0 2026-02-17T20:58:42.088 INFO:teuthology.orchestra.run.trial104.stdout:124554051592 2026-02-17T20:58:42.088 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.086+0000 7f55f8524640 1 -- 10.20.193.104:0/260448519 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f55cc0775a0 msgr2=0x7f55cc079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.086+0000 7f55f8524640 1 --2- 10.20.193.104:0/260448519 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f55cc0775a0 0x7f55cc079a60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f55e40097c0 tx=0x7f55e403a040 comp rx=0 tx=0).stop 2026-02-17T20:58:42.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.086+0000 7f55f8524640 1 -- 10.20.193.104:0/260448519 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55f01048c0 msgr2=0x7f55f01a2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.086+0000 7f55f8524640 1 --2- 10.20.193.104:0/260448519 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55f01048c0 0x7f55f01a2610 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f55e000b4f0 tx=0x7f55e000b9c0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.086+0000 7f55f8524640 1 -- 10.20.193.104:0/260448519 shutdown_connections 2026-02-17T20:58:42.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.086+0000 7f55f8524640 1 --2- 10.20.193.104:0/260448519 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f55cc0775a0 0x7f55cc079a60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.086+0000 7f55f8524640 1 --2- 10.20.193.104:0/260448519 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f55f010a8c0 0x7f55f01a2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.086+0000 7f55f8524640 1 --2- 10.20.193.104:0/260448519 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f55f01048c0 0x7f55f01a2610 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.086+0000 7f55f8524640 1 -- 10.20.193.104:0/260448519 >> 10.20.193.104:0/260448519 conn(0x7f55f01005c0 msgr2=0x7f55f0101780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:42.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.086+0000 7f55f8524640 1 -- 10.20.193.104:0/260448519 shutdown_connections 2026-02-17T20:58:42.089 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.086+0000 7f55f8524640 1 -- 10.20.193.104:0/260448519 wait complete. 2026-02-17T20:58:42.126 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411341 got 77309411341 for osd.2 2026-02-17T20:58:42.126 DEBUG:teuthology.parallel:result is None 2026-02-17T20:58:42.132 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:42 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/973751783' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T20:58:42.133 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949672976 got 42949672976 for osd.0 2026-02-17T20:58:42.133 DEBUG:teuthology.parallel:result is None 2026-02-17T20:58:42.143 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051592 got 124554051592 for osd.4 2026-02-17T20:58:42.143 DEBUG:teuthology.parallel:result is None 2026-02-17T20:58:42.145 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182411 got 107374182412 for osd.3 2026-02-17T20:58:42.145 DEBUG:teuthology.parallel:result is None 2026-02-17T20:58:42.154 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542159 got 60129542159 for osd.1 2026-02-17T20:58:42.154 DEBUG:teuthology.parallel:result is None 2026-02-17T20:58:42.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.155+0000 7f210a14d640 1 -- 10.20.193.104:0/2519151805 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f210419d0e0 con 0x7f21041048c0 2026-02-17T20:58:42.158 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.155+0000 7f2100ff9640 1 -- 10.20.193.104:0/2519151805 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f20f803d070 con 0x7f21041048c0 2026-02-17T20:58:42.158 INFO:teuthology.orchestra.run.trial104.stdout:197568495620 2026-02-17T20:58:42.159 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.157+0000 7f2bff3dc640 1 -- 10.20.193.104:0/3508748572 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f2bf8105310 con 0x7f2bf8102660 2026-02-17T20:58:42.160 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.157+0000 7f2be67fc640 1 -- 10.20.193.104:0/3508748572 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2be8090550 con 0x7f2bf8102660 2026-02-17T20:58:42.160 INFO:teuthology.orchestra.run.trial104.stdout:176093659141 2026-02-17T20:58:42.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.157+0000 7f210a14d640 1 -- 10.20.193.104:0/2519151805 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f20d80775a0 msgr2=0x7f20d8079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.157+0000 7f210a14d640 1 --2- 10.20.193.104:0/2519151805 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f20d80775a0 0x7f20d8079a60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f20f4005fd0 tx=0x7f20f4005950 comp rx=0 tx=0).stop 2026-02-17T20:58:42.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.157+0000 7f210a14d640 1 -- 10.20.193.104:0/2519151805 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f21041048c0 msgr2=0x7f21041a2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.157+0000 7f210a14d640 1 --2- 10.20.193.104:0/2519151805 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f21041048c0 0x7f21041a2450 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f20f800b1d0 tx=0x7f20f8002a60 comp rx=0 tx=0).stop 2026-02-17T20:58:42.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.157+0000 7f210a14d640 1 -- 10.20.193.104:0/2519151805 shutdown_connections 2026-02-17T20:58:42.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.157+0000 7f210a14d640 1 --2- 10.20.193.104:0/2519151805 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f20d80775a0 0x7f20d8079a60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.157+0000 7f210a14d640 1 --2- 10.20.193.104:0/2519151805 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f210410a8c0 0x7f21041a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.157+0000 7f210a14d640 1 --2- 10.20.193.104:0/2519151805 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f21041048c0 0x7f21041a2450 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.157+0000 7f210a14d640 1 -- 10.20.193.104:0/2519151805 >> 10.20.193.104:0/2519151805 conn(0x7f21041005c0 msgr2=0x7f2104102780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:42.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.157+0000 7f210a14d640 1 -- 10.20.193.104:0/2519151805 shutdown_connections 2026-02-17T20:58:42.161 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.157+0000 7f210a14d640 1 -- 10.20.193.104:0/2519151805 wait complete. 2026-02-17T20:58:42.162 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.159+0000 7f2bff3dc640 1 -- 10.20.193.104:0/3508748572 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f2bd4077550 msgr2=0x7f2bd4079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.162 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.159+0000 7f2bff3dc640 1 --2- 10.20.193.104:0/3508748572 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f2bd4077550 0x7f2bd4079a10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8076e00 tx=0x7f2bec009290 comp rx=0 tx=0).stop 2026-02-17T20:58:42.162 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.159+0000 7f2bff3dc640 1 -- 10.20.193.104:0/3508748572 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2bf8102660 msgr2=0x7f2bf8075370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.162 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.159+0000 7f2bff3dc640 1 --2- 10.20.193.104:0/3508748572 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2bf8102660 0x7f2bf8075370 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2be802f730 tx=0x7f2be802fcb0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.162 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.159+0000 7f2bff3dc640 1 -- 10.20.193.104:0/3508748572 shutdown_connections 2026-02-17T20:58:42.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.159+0000 7f2bff3dc640 1 --2- 10.20.193.104:0/3508748572 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f2bd4077550 0x7f2bd4079a10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.159+0000 7f2bff3dc640 1 --2- 10.20.193.104:0/3508748572 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f2bf8108660 0x7f2bf80758b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.159+0000 7f2bff3dc640 1 --2- 10.20.193.104:0/3508748572 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f2bf8102660 0x7f2bf8075370 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.159+0000 7f2bff3dc640 1 -- 10.20.193.104:0/3508748572 >> 10.20.193.104:0/3508748572 conn(0x7f2bf80fe360 msgr2=0x7f2bf81005c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:42.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.159+0000 7f2bff3dc640 1 -- 10.20.193.104:0/3508748572 shutdown_connections 2026-02-17T20:58:42.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.159+0000 7f2bff3dc640 1 -- 10.20.193.104:0/3508748572 wait complete. 2026-02-17T20:58:42.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.159+0000 7f412c9f6640 1 -- 10.20.193.104:0/3989274560 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f412419d170 con 0x7f4124075410 2026-02-17T20:58:42.163 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.159+0000 7f410f7fe640 1 -- 10.20.193.104:0/3989274560 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f411c08b650 con 0x7f4124075410 2026-02-17T20:58:42.164 INFO:teuthology.orchestra.run.trial104.stdout:150323855367 2026-02-17T20:58:42.164 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.161+0000 7f412c9f6640 1 -- 10.20.193.104:0/3989274560 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f41000775a0 msgr2=0x7f4100079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.164 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.161+0000 7f412c9f6640 1 --2- 10.20.193.104:0/3989274560 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f41000775a0 0x7f4100079a60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4110005e00 tx=0x7f4110005d50 comp rx=0 tx=0).stop 2026-02-17T20:58:42.164 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.161+0000 7f412c9f6640 1 -- 10.20.193.104:0/3989274560 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4124075410 msgr2=0x7f41241a25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.165 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.161+0000 7f412c9f6640 1 --2- 10.20.193.104:0/3989274560 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4124075410 0x7f41241a25f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f411c002410 tx=0x7f411c0026e0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.165 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.161+0000 7f412c9f6640 1 -- 10.20.193.104:0/3989274560 shutdown_connections 2026-02-17T20:58:42.165 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.161+0000 7f412c9f6640 1 --2- 10.20.193.104:0/3989274560 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f41000775a0 0x7f4100079a60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.165 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.161+0000 7f412c9f6640 1 --2- 10.20.193.104:0/3989274560 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f4124075d30 0x7f41241a2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.165 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.161+0000 7f412c9f6640 1 --2- 10.20.193.104:0/3989274560 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f4124075410 0x7f41241a25f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.165 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.161+0000 7f412c9f6640 1 -- 10.20.193.104:0/3989274560 >> 10.20.193.104:0/3989274560 conn(0x7f41240fe380 msgr2=0x7f4124106f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:42.165 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.162+0000 7f412c9f6640 1 -- 10.20.193.104:0/3989274560 shutdown_connections 2026-02-17T20:58:42.165 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.162+0000 7f412c9f6640 1 -- 10.20.193.104:0/3989274560 wait complete. 2026-02-17T20:58:42.203 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495620 got 197568495620 for osd.7 2026-02-17T20:58:42.203 DEBUG:teuthology.parallel:result is None 2026-02-17T20:58:42.204 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855367 got 150323855367 for osd.5 2026-02-17T20:58:42.204 DEBUG:teuthology.parallel:result is None 2026-02-17T20:58:42.216 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659141 got 176093659141 for osd.6 2026-02-17T20:58:42.217 DEBUG:teuthology.parallel:result is None 2026-02-17T20:58:42.217 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-17T20:58:42.217 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph pg dump --format=json 2026-02-17T20:58:42.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:42 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/973751783' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T20:58:42.410 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:42.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.510+0000 7f03303f1640 1 -- 10.20.193.104:0/2500249262 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0328075410 msgr2=0x7f03280757f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.510+0000 7f03303f1640 1 --2- 10.20.193.104:0/2500249262 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0328075410 0x7f03280757f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f03180099b0 tx=0x7f031802f2b0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.510+0000 7f03303f1640 1 -- 10.20.193.104:0/2500249262 shutdown_connections 2026-02-17T20:58:42.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.510+0000 7f03303f1640 1 --2- 10.20.193.104:0/2500249262 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0328075d30 0x7f032810ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.510+0000 7f03303f1640 1 --2- 10.20.193.104:0/2500249262 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0328075410 0x7f03280757f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.510+0000 7f03303f1640 1 -- 10.20.193.104:0/2500249262 >> 10.20.193.104:0/2500249262 conn(0x7f03280fe390 msgr2=0x7f03281007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:42.515 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.510+0000 7f03303f1640 1 -- 10.20.193.104:0/2500249262 shutdown_connections 2026-02-17T20:58:42.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.510+0000 7f03303f1640 1 -- 10.20.193.104:0/2500249262 wait complete. 2026-02-17T20:58:42.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.510+0000 7f03303f1640 1 Processor -- start 2026-02-17T20:58:42.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.510+0000 7f03303f1640 1 -- start start 2026-02-17T20:58:42.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.510+0000 7f03303f1640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0328075410 0x7f03281a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.510+0000 7f03303f1640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0328075d30 0x7f03281a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.510+0000 7f03303f1640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0328111ae0 con 0x7f0328075d30 2026-02-17T20:58:42.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.510+0000 7f03303f1640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0328111960 con 0x7f0328075410 2026-02-17T20:58:42.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.511+0000 7f032d965640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0328075d30 0x7f03281a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.511+0000 7f032d965640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0328075d30 0x7f03281a2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41336/0 (socket says 10.20.193.104:41336) 2026-02-17T20:58:42.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.511+0000 7f032d965640 1 -- 10.20.193.104:0/4015247906 learned_addr learned my addr 10.20.193.104:0/4015247906 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:42.516 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.511+0000 7f032d965640 1 -- 10.20.193.104:0/4015247906 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0328075410 msgr2=0x7f03281a2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.511+0000 7f032d965640 1 --2- 10.20.193.104:0/4015247906 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0328075410 0x7f03281a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.511+0000 7f032d965640 1 -- 10.20.193.104:0/4015247906 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032819c650 con 0x7f0328075d30 2026-02-17T20:58:42.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.511+0000 7f032d965640 1 --2- 10.20.193.104:0/4015247906 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0328075d30 0x7f03281a2ac0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f031c00e990 tx=0x7f031c00ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:42.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.511+0000 7f030f7fe640 1 -- 10.20.193.104:0/4015247906 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f031c00cb80 con 0x7f0328075d30 2026-02-17T20:58:42.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.511+0000 7f030f7fe640 1 -- 10.20.193.104:0/4015247906 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f031c004540 con 0x7f0328075d30 2026-02-17T20:58:42.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.511+0000 7f03303f1640 1 -- 10.20.193.104:0/4015247906 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f032819c940 con 0x7f0328075d30 2026-02-17T20:58:42.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.511+0000 7f030f7fe640 1 -- 10.20.193.104:0/4015247906 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f031c002e60 con 0x7f0328075d30 2026-02-17T20:58:42.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.511+0000 7f03303f1640 1 -- 10.20.193.104:0/4015247906 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f032819cea0 con 0x7f0328075d30 2026-02-17T20:58:42.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.511+0000 7f03303f1640 1 -- 10.20.193.104:0/4015247906 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0328076b50 con 0x7f0328075d30 2026-02-17T20:58:42.517 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.512+0000 7f030f7fe640 1 -- 10.20.193.104:0/4015247906 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f031c020030 con 0x7f0328075d30 2026-02-17T20:58:42.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.512+0000 7f030f7fe640 1 --2- 10.20.193.104:0/4015247906 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0304077550 0x7f0304079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.513+0000 7f030f7fe640 1 -- 10.20.193.104:0/4015247906 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f031c099a00 con 0x7f0328075d30 2026-02-17T20:58:42.518 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.513+0000 7f032e166640 1 --2- 10.20.193.104:0/4015247906 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0304077550 0x7f0304079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.513+0000 7f032e166640 1 --2- 10.20.193.104:0/4015247906 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0304077550 0x7f0304079a10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0318005a40 tx=0x7f03180059b0 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:42.519 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.514+0000 7f030f7fe640 1 -- 10.20.193.104:0/4015247906 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f031c066b30 con 0x7f0328075d30 2026-02-17T20:58:42.598 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.596+0000 7f03303f1640 1 -- 10.20.193.104:0/4015247906 --> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f032819d170 con 0x7f0304077550 2026-02-17T20:58:42.599 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.596+0000 7f030f7fe640 1 -- 10.20.193.104:0/4015247906 <== mgr.14203 v2:10.20.193.104:6800/2484917436 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+14534 (secure 0 0 0) 0x7f032819d170 con 0x7f0304077550 2026-02-17T20:58:42.600 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:42.601 INFO:teuthology.orchestra.run.trial104.stderr:dumped all 2026-02-17T20:58:42.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.597+0000 7f03303f1640 1 -- 10.20.193.104:0/4015247906 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0304077550 msgr2=0x7f0304079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.597+0000 7f03303f1640 1 --2- 10.20.193.104:0/4015247906 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0304077550 0x7f0304079a10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0318005a40 tx=0x7f03180059b0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.597+0000 7f03303f1640 1 -- 10.20.193.104:0/4015247906 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0328075d30 msgr2=0x7f03281a2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.597+0000 7f03303f1640 1 --2- 10.20.193.104:0/4015247906 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0328075d30 0x7f03281a2ac0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f031c00e990 tx=0x7f031c00ee60 comp rx=0 tx=0).stop 2026-02-17T20:58:42.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.597+0000 7f03303f1640 1 -- 10.20.193.104:0/4015247906 shutdown_connections 2026-02-17T20:58:42.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.597+0000 7f03303f1640 1 --2- 10.20.193.104:0/4015247906 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0304077550 0x7f0304079a10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.597+0000 7f03303f1640 1 --2- 10.20.193.104:0/4015247906 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0328075d30 0x7f03281a2ac0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.601 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.597+0000 7f03303f1640 1 --2- 10.20.193.104:0/4015247906 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0328075410 0x7f03281a2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.597+0000 7f03303f1640 1 -- 10.20.193.104:0/4015247906 >> 10.20.193.104:0/4015247906 conn(0x7f03280fe390 msgr2=0x7f0328106ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:42.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.597+0000 7f03303f1640 1 -- 10.20.193.104:0/4015247906 shutdown_connections 2026-02-17T20:58:42.602 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.597+0000 7f03303f1640 1 -- 10.20.193.104:0/4015247906 wait complete. 2026-02-17T20:58:42.634 INFO:teuthology.orchestra.run.trial104.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2026-02-17T20:58:41.637561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":5872025600,"kb_used":221260,"kb_used_data":5492,"kb_used_omap":12,"kb_used_meta":215539,"kb_avail":5871804340,"statfs":{"total":6012954214400,"available":6012727644160,"internally_reserved":0,"allocated":5623808,"data_stored":3334808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":220712504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.649467"},"pg_stats":[{"pgid":"1.0","version":"20'92","reported_seq":19,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-17T20:58:39.000209+0000","last_change":"2026-02-17T20:58:38.802883+0000","last_active":"2026-02-17T20:58:39.000209+0000","last_peered":"2026-02-17T20:58:39.000209+0000","last_clean":"2026-02-17T20:58:39.000209+0000","last_became_active":"2026-02-17T20:58:38.798903+0000","last_became_peered":"2026-02-17T20:58:38.798903+0000","last_unstale":"2026-02-17T20:58:39.000209+0000","last_undegraded":"2026-02-17T20:58:39.000209+0000","last_fullsized":"2026-02-17T20:58:39.000209+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:57:52.493866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:57:52.493866+0000","last_clean_scrub_stamp":"2026-02-17T20:57:52.493866+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:04:09.068058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":46,"seq":197568495620,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28024,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975176,"statfs":{"total":751619276800,"available":751590580224,"internally_reserved":0,"allocated":1077248,"data_stored":787268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659141,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28008,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975192,"statfs":{"total":751619276800,"available":751590596608,"internally_reserved":0,"allocated":1064960,"data_stored":781520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855367,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27444,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975756,"statfs":{"total":751619276800,"available":751591174144,"internally_reserved":0,"allocated":483328,"data_stored":196900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27440,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975760,"statfs":{"total":751619276800,"available":751591178240,"internally_reserved":0,"allocated":483328,"data_stored":196900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27448,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975752,"statfs":{"total":751619276800,"available":751591170048,"internally_reserved":0,"allocated":483328,"data_stored":196900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27444,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975756,"statfs":{"total":751619276800,"available":751591174144,"internally_reserved":0,"allocated":483328,"data_stored":196900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27432,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975768,"statfs":{"total":751619276800,"available":751591186432,"internally_reserved":0,"allocated":471040,"data_stored":191152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672976,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28020,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975180,"statfs":{"total":751619276800,"available":751590584320,"internally_reserved":0,"allocated":1077248,"data_stored":787268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T20:58:42.635 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph pg dump --format=json 2026-02-17T20:58:42.788 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:42.896 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.890+0000 7f41d5967640 1 -- 10.20.193.104:0/59868758 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f41d0101370 msgr2=0x7f41d0101750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.896 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.890+0000 7f41d5967640 1 --2- 10.20.193.104:0/59868758 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f41d0101370 0x7f41d0101750 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009910 tx=0x7f41c402f1d0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.896 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.890+0000 7f41d5967640 1 -- 10.20.193.104:0/59868758 shutdown_connections 2026-02-17T20:58:42.896 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.890+0000 7f41d5967640 1 --2- 10.20.193.104:0/59868758 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f41d0101c90 0x7f41d010eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.896 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.890+0000 7f41d5967640 1 --2- 10.20.193.104:0/59868758 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f41d0101370 0x7f41d0101750 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.896 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.890+0000 7f41d5967640 1 -- 10.20.193.104:0/59868758 >> 10.20.193.104:0/59868758 conn(0x7f41d00fd220 msgr2=0x7f41d00ff640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:42.896 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.890+0000 7f41d5967640 1 -- 10.20.193.104:0/59868758 shutdown_connections 2026-02-17T20:58:42.896 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.890+0000 7f41d5967640 1 -- 10.20.193.104:0/59868758 wait complete. 2026-02-17T20:58:42.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41d5967640 1 Processor -- start 2026-02-17T20:58:42.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41d5967640 1 -- start start 2026-02-17T20:58:42.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41d5967640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f41d0101370 0x7f41d0107630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41d5967640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f41d0101c90 0x7f41d01036d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41d5967640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f41d0111b40 con 0x7f41d0101c90 2026-02-17T20:58:42.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41d5967640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f41d01119c0 con 0x7f41d0101370 2026-02-17T20:58:42.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41ce7fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f41d0101c90 0x7f41d01036d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41ce7fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f41d0101c90 0x7f41d01036d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41354/0 (socket says 10.20.193.104:41354) 2026-02-17T20:58:42.897 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41ce7fc640 1 -- 10.20.193.104:0/1383783801 learned_addr learned my addr 10.20.193.104:0/1383783801 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:42.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41ce7fc640 1 -- 10.20.193.104:0/1383783801 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f41d0101370 msgr2=0x7f41d0107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41ce7fc640 1 --2- 10.20.193.104:0/1383783801 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f41d0101370 0x7f41d0107630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41ce7fc640 1 -- 10.20.193.104:0/1383783801 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d0103e60 con 0x7f41d0101c90 2026-02-17T20:58:42.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41ce7fc640 1 --2- 10.20.193.104:0/1383783801 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f41d0101c90 0x7f41d01036d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f41b800e9b0 tx=0x7f41b800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:42.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41d4965640 1 -- 10.20.193.104:0/1383783801 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f41b800cbe0 con 0x7f41d0101c90 2026-02-17T20:58:42.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41d4965640 1 -- 10.20.193.104:0/1383783801 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f41b8004540 con 0x7f41d0101c90 2026-02-17T20:58:42.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41d4965640 1 -- 10.20.193.104:0/1383783801 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f41b8010430 con 0x7f41d0101c90 2026-02-17T20:58:42.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41d5967640 1 -- 10.20.193.104:0/1383783801 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d0104150 con 0x7f41d0101c90 2026-02-17T20:58:42.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.891+0000 7f41d5967640 1 -- 10.20.193.104:0/1383783801 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d01ab090 con 0x7f41d0101c90 2026-02-17T20:58:42.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.892+0000 7f41d5967640 1 -- 10.20.193.104:0/1383783801 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d006b6d0 con 0x7f41d0101c90 2026-02-17T20:58:42.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.892+0000 7f41d4965640 1 -- 10.20.193.104:0/1383783801 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f41b80040d0 con 0x7f41d0101c90 2026-02-17T20:58:42.898 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.893+0000 7f41d4965640 1 --2- 10.20.193.104:0/1383783801 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f41a40775a0 0x7f41a4079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:42.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.893+0000 7f41d4965640 1 -- 10.20.193.104:0/1383783801 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f41b8099d80 con 0x7f41d0101c90 2026-02-17T20:58:42.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.893+0000 7f41ceffd640 1 --2- 10.20.193.104:0/1383783801 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f41a40775a0 0x7f41a4079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:42.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.893+0000 7f41ceffd640 1 --2- 10.20.193.104:0/1383783801 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f41a40775a0 0x7f41a4079a60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009910 tx=0x7f41c4005d90 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:42.899 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.895+0000 7f41d4965640 1 -- 10.20.193.104:0/1383783801 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f41b8066e10 con 0x7f41d0101c90 2026-02-17T20:58:42.982 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.979+0000 7f41d5967640 1 -- 10.20.193.104:0/1383783801 --> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f41d0108ec0 con 0x7f41a40775a0 2026-02-17T20:58:42.983 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.980+0000 7f41d4965640 1 -- 10.20.193.104:0/1383783801 <== mgr.14203 v2:10.20.193.104:6800/2484917436 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+14534 (secure 0 0 0) 0x7f41d0108ec0 con 0x7f41a40775a0 2026-02-17T20:58:42.983 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:42.984 INFO:teuthology.orchestra.run.trial104.stderr:dumped all 2026-02-17T20:58:42.984 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.981+0000 7f41d5967640 1 -- 10.20.193.104:0/1383783801 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f41a40775a0 msgr2=0x7f41a4079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.981+0000 7f41d5967640 1 --2- 10.20.193.104:0/1383783801 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f41a40775a0 0x7f41a4079a60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009910 tx=0x7f41c4005d90 comp rx=0 tx=0).stop 2026-02-17T20:58:42.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.981+0000 7f41d5967640 1 -- 10.20.193.104:0/1383783801 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f41d0101c90 msgr2=0x7f41d01036d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:42.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.981+0000 7f41d5967640 1 --2- 10.20.193.104:0/1383783801 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f41d0101c90 0x7f41d01036d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f41b800e9b0 tx=0x7f41b800ee80 comp rx=0 tx=0).stop 2026-02-17T20:58:42.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.981+0000 7f41d5967640 1 -- 10.20.193.104:0/1383783801 shutdown_connections 2026-02-17T20:58:42.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.981+0000 7f41d5967640 1 --2- 10.20.193.104:0/1383783801 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f41a40775a0 0x7f41a4079a60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.981+0000 7f41d5967640 1 --2- 10.20.193.104:0/1383783801 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f41d0101c90 0x7f41d01036d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.981+0000 7f41d5967640 1 --2- 10.20.193.104:0/1383783801 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f41d0101370 0x7f41d0107630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:42.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.981+0000 7f41d5967640 1 -- 10.20.193.104:0/1383783801 >> 10.20.193.104:0/1383783801 conn(0x7f41d00fd220 msgr2=0x7f41d00fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:42.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.981+0000 7f41d5967640 1 -- 10.20.193.104:0/1383783801 shutdown_connections 2026-02-17T20:58:42.985 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:42.981+0000 7f41d5967640 1 -- 10.20.193.104:0/1383783801 wait complete. 2026-02-17T20:58:43.020 INFO:teuthology.orchestra.run.trial104.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2026-02-17T20:58:41.637561+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":4,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":5872025600,"kb_used":221260,"kb_used_data":5492,"kb_used_omap":12,"kb_used_meta":215539,"kb_avail":5871804340,"statfs":{"total":6012954214400,"available":6012727644160,"internally_reserved":0,"allocated":5623808,"data_stored":3334808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":220712504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.649467"},"pg_stats":[{"pgid":"1.0","version":"20'92","reported_seq":19,"reported_epoch":48,"state":"active+clean","last_fresh":"2026-02-17T20:58:39.000209+0000","last_change":"2026-02-17T20:58:38.802883+0000","last_active":"2026-02-17T20:58:39.000209+0000","last_peered":"2026-02-17T20:58:39.000209+0000","last_clean":"2026-02-17T20:58:39.000209+0000","last_became_active":"2026-02-17T20:58:38.798903+0000","last_became_peered":"2026-02-17T20:58:38.798903+0000","last_unstale":"2026-02-17T20:58:39.000209+0000","last_undegraded":"2026-02-17T20:58:39.000209+0000","last_fullsized":"2026-02-17T20:58:39.000209+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-17T20:57:52.493866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-17T20:57:52.493866+0000","last_clean_scrub_stamp":"2026-02-17T20:57:52.493866+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-19T08:04:09.068058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3563520,"data_stored":3542208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":46,"seq":197568495620,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28024,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975176,"statfs":{"total":751619276800,"available":751590580224,"internally_reserved":0,"allocated":1077248,"data_stored":787268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27589067},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":41,"seq":176093659141,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28008,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975192,"statfs":{"total":751619276800,"available":751590596608,"internally_reserved":0,"allocated":1064960,"data_stored":781520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27589063},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855367,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27444,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975756,"statfs":{"total":751619276800,"available":751591174144,"internally_reserved":0,"allocated":483328,"data_stored":196900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051592,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27440,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975760,"statfs":{"total":751619276800,"available":751591178240,"internally_reserved":0,"allocated":483328,"data_stored":196900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182412,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27448,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975752,"statfs":{"total":751619276800,"available":751591170048,"internally_reserved":0,"allocated":483328,"data_stored":196900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27589064},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411341,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27444,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975756,"statfs":{"total":751619276800,"available":751591174144,"internally_reserved":0,"allocated":483328,"data_stored":196900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542159,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":734003200,"kb_used":27432,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975768,"statfs":{"total":751619276800,"available":751591186432,"internally_reserved":0,"allocated":471040,"data_stored":191152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":10,"seq":42949672976,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":28020,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":26942,"kb_avail":733975180,"statfs":{"total":751619276800,"available":751590584320,"internally_reserved":0,"allocated":1077248,"data_stored":787268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27589062},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-17T20:58:43.021 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-17T20:58:43.021 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-17T20:58:43.021 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-17T20:58:43.021 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph health --format=json 2026-02-17T20:58:43.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:43 trial104 ceph-mon[20612]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T20:58:43.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:43 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3036044842' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-17T20:58:43.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:43 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/1861268427' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-17T20:58:43.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:43 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/786635' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-17T20:58:43.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:43 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/755981972' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-17T20:58:43.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:43 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/260448519' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-17T20:58:43.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:43 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/2519151805' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-17T20:58:43.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:43 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3508748572' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-17T20:58:43.155 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:43 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3989274560' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-17T20:58:43.172 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:43.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:43 trial153 ceph-mon[25357]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T20:58:43.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:43 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/3036044842' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2026-02-17T20:58:43.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:43 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/1861268427' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2026-02-17T20:58:43.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:43 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/786635' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2026-02-17T20:58:43.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:43 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/755981972' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2026-02-17T20:58:43.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:43 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/260448519' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2026-02-17T20:58:43.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:43 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/2519151805' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2026-02-17T20:58:43.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:43 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/3508748572' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2026-02-17T20:58:43.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:43 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/3989274560' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2026-02-17T20:58:43.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb0bcce640 1 -- 10.20.193.104:0/3767293303 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7feb04075410 msgr2=0x7feb040757f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:43.279 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb0bcce640 1 --2- 10.20.193.104:0/3767293303 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7feb04075410 0x7feb040757f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7feaf40099b0 tx=0x7feaf402f2b0 comp rx=0 tx=0).stop 2026-02-17T20:58:43.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb0bcce640 1 -- 10.20.193.104:0/3767293303 shutdown_connections 2026-02-17T20:58:43.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb0bcce640 1 --2- 10.20.193.104:0/3767293303 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7feb04075d30 0x7feb0410ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:43.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb0bcce640 1 --2- 10.20.193.104:0/3767293303 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7feb04075410 0x7feb040757f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:43.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb0bcce640 1 -- 10.20.193.104:0/3767293303 >> 10.20.193.104:0/3767293303 conn(0x7feb040fe380 msgr2=0x7feb041007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:43.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb0bcce640 1 -- 10.20.193.104:0/3767293303 shutdown_connections 2026-02-17T20:58:43.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb0bcce640 1 -- 10.20.193.104:0/3767293303 wait complete. 2026-02-17T20:58:43.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb0bcce640 1 Processor -- start 2026-02-17T20:58:43.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb0bcce640 1 -- start start 2026-02-17T20:58:43.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb0bcce640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7feb04075410 0x7feb041a2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:43.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb0bcce640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7feb04075d30 0x7feb041a2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:43.280 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb0bcce640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7feb04111b30 con 0x7feb04075410 2026-02-17T20:58:43.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb0bcce640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7feb041119b0 con 0x7feb04075d30 2026-02-17T20:58:43.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb09a43640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7feb04075410 0x7feb041a2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:43.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb09a43640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7feb04075410 0x7feb041a2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41364/0 (socket says 10.20.193.104:41364) 2026-02-17T20:58:43.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb09a43640 1 -- 10.20.193.104:0/3088148974 learned_addr learned my addr 10.20.193.104:0/3088148974 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:43.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb09242640 1 --2- 10.20.193.104:0/3088148974 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7feb04075d30 0x7feb041a2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:43.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb09a43640 1 -- 10.20.193.104:0/3088148974 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7feb04075d30 msgr2=0x7feb041a2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:43.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb09a43640 1 --2- 10.20.193.104:0/3088148974 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7feb04075d30 0x7feb041a2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:43.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb09a43640 1 -- 10.20.193.104:0/3088148974 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb0419c740 con 0x7feb04075410 2026-02-17T20:58:43.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.275+0000 7feb09a43640 1 --2- 10.20.193.104:0/3088148974 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7feb04075410 0x7feb041a2670 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7feaf402f7c0 tx=0x7feaf40026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:43.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.276+0000 7feaf2ffd640 1 -- 10.20.193.104:0/3088148974 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7feaf4046070 con 0x7feb04075410 2026-02-17T20:58:43.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.276+0000 7feb0bcce640 1 -- 10.20.193.104:0/3088148974 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb0419c9d0 con 0x7feb04075410 2026-02-17T20:58:43.281 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.276+0000 7feaf2ffd640 1 -- 10.20.193.104:0/3088148974 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7feaf4002ba0 con 0x7feb04075410 2026-02-17T20:58:43.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.276+0000 7feaf2ffd640 1 -- 10.20.193.104:0/3088148974 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7feaf4041630 con 0x7feb04075410 2026-02-17T20:58:43.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.276+0000 7feb0bcce640 1 -- 10.20.193.104:0/3088148974 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb0419ced0 con 0x7feb04075410 2026-02-17T20:58:43.282 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.276+0000 7feb0bcce640 1 -- 10.20.193.104:0/3088148974 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb04076b50 con 0x7feb04075410 2026-02-17T20:58:43.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.277+0000 7feaf2ffd640 1 -- 10.20.193.104:0/3088148974 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7feaf40418e0 con 0x7feb04075410 2026-02-17T20:58:43.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.277+0000 7feaf2ffd640 1 --2- 10.20.193.104:0/3088148974 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7feae0077550 0x7feae0079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:43.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.277+0000 7feaf2ffd640 1 -- 10.20.193.104:0/3088148974 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7feaf403e070 con 0x7feb04075410 2026-02-17T20:58:43.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.277+0000 7feb09242640 1 --2- 10.20.193.104:0/3088148974 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7feae0077550 0x7feae0079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:43.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.278+0000 7feb09242640 1 --2- 10.20.193.104:0/3088148974 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7feae0077550 0x7feae0079a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feb0419df90 tx=0x7feaf8009290 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:43.283 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.279+0000 7feaf2ffd640 1 -- 10.20.193.104:0/3088148974 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7feaf4050020 con 0x7feb04075410 2026-02-17T20:58:43.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.377+0000 7feb0bcce640 1 -- 10.20.193.104:0/3088148974 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7feb040757f0 con 0x7feb04075410 2026-02-17T20:58:43.381 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.378+0000 7feaf2ffd640 1 -- 10.20.193.104:0/3088148974 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7feb040757f0 con 0x7feb04075410 2026-02-17T20:58:43.381 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:43.381 INFO:teuthology.orchestra.run.trial104.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-17T20:58:43.382 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.378+0000 7feb0bcce640 1 -- 10.20.193.104:0/3088148974 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7feae0077550 msgr2=0x7feae0079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:43.382 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.378+0000 7feb0bcce640 1 --2- 10.20.193.104:0/3088148974 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7feae0077550 0x7feae0079a10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7feb0419df90 tx=0x7feaf8009290 comp rx=0 tx=0).stop 2026-02-17T20:58:43.382 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.378+0000 7feb0bcce640 1 -- 10.20.193.104:0/3088148974 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7feb04075410 msgr2=0x7feb041a2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:43.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.378+0000 7feb0bcce640 1 --2- 10.20.193.104:0/3088148974 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7feb04075410 0x7feb041a2670 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7feaf402f7c0 tx=0x7feaf40026e0 comp rx=0 tx=0).stop 2026-02-17T20:58:43.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.378+0000 7feb0bcce640 1 -- 10.20.193.104:0/3088148974 shutdown_connections 2026-02-17T20:58:43.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.378+0000 7feb0bcce640 1 --2- 10.20.193.104:0/3088148974 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7feae0077550 0x7feae0079a10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:43.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.378+0000 7feb0bcce640 1 --2- 10.20.193.104:0/3088148974 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7feb04075d30 0x7feb041a2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:43.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.378+0000 7feb0bcce640 1 --2- 10.20.193.104:0/3088148974 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7feb04075410 0x7feb041a2670 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:43.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.378+0000 7feb0bcce640 1 -- 10.20.193.104:0/3088148974 >> 10.20.193.104:0/3088148974 conn(0x7feb040fe380 msgr2=0x7feb04106f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:43.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.379+0000 7feb0bcce640 1 -- 10.20.193.104:0/3088148974 shutdown_connections 2026-02-17T20:58:43.383 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.379+0000 7feb0bcce640 1 -- 10.20.193.104:0/3088148974 wait complete. 2026-02-17T20:58:43.417 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2026-02-17T20:58:43.417 INFO:tasks.cephadm:Setup complete, yielding 2026-02-17T20:58:43.417 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-17T20:58:43.432 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial104.front.sepia.ceph.com 2026-02-17T20:58:43.433 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- bash -c 'ceph orch status' 2026-02-17T20:58:43.585 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:43.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.695+0000 7f64b258f640 1 -- 10.20.193.104:0/1302275678 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64ac102790 msgr2=0x7f64ac102c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:43.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.695+0000 7f64b258f640 1 --2- 10.20.193.104:0/1302275678 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64ac102790 0x7f64ac102c10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f649c0099b0 tx=0x7f649c02f220 comp rx=0 tx=0).stop 2026-02-17T20:58:43.700 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.695+0000 7f64b258f640 1 -- 10.20.193.104:0/1302275678 shutdown_connections 2026-02-17T20:58:43.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.695+0000 7f64b258f640 1 --2- 10.20.193.104:0/1302275678 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64ac102790 0x7f64ac102c10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:43.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.695+0000 7f64b258f640 1 --2- 10.20.193.104:0/1302275678 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f64ac101590 0x7f64ac101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:43.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.695+0000 7f64b258f640 1 -- 10.20.193.104:0/1302275678 >> 10.20.193.104:0/1302275678 conn(0x7f64ac0fcd20 msgr2=0x7f64ac0ff160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:43.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.695+0000 7f64b258f640 1 -- 10.20.193.104:0/1302275678 shutdown_connections 2026-02-17T20:58:43.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.695+0000 7f64b258f640 1 -- 10.20.193.104:0/1302275678 wait complete. 2026-02-17T20:58:43.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64b258f640 1 Processor -- start 2026-02-17T20:58:43.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64b258f640 1 -- start start 2026-02-17T20:58:43.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64b258f640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f64ac101590 0x7f64ac19c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:43.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64b258f640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64ac102790 0x7f64ac19c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:43.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64b258f640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac10a120 con 0x7f64ac102790 2026-02-17T20:58:43.701 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64b258f640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f64ac109fa0 con 0x7f64ac101590 2026-02-17T20:58:43.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64ab7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64ac102790 0x7f64ac19c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:43.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64ab7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64ac102790 0x7f64ac19c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41380/0 (socket says 10.20.193.104:41380) 2026-02-17T20:58:43.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64ab7fe640 1 -- 10.20.193.104:0/4236358365 learned_addr learned my addr 10.20.193.104:0/4236358365 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:43.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64abfff640 1 --2- 10.20.193.104:0/4236358365 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f64ac101590 0x7f64ac19c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:43.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64ab7fe640 1 -- 10.20.193.104:0/4236358365 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f64ac101590 msgr2=0x7f64ac19c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:43.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64ab7fe640 1 --2- 10.20.193.104:0/4236358365 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f64ac101590 0x7f64ac19c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:43.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64ab7fe640 1 -- 10.20.193.104:0/4236358365 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64ac19cf10 con 0x7f64ac102790 2026-02-17T20:58:43.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64ab7fe640 1 --2- 10.20.193.104:0/4236358365 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64ac102790 0x7f64ac19c890 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f649c002410 tx=0x7f649c02fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:43.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64a97fa640 1 -- 10.20.193.104:0/4236358365 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f649c004420 con 0x7f64ac102790 2026-02-17T20:58:43.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64b258f640 1 -- 10.20.193.104:0/4236358365 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64ac1a18f0 con 0x7f64ac102790 2026-02-17T20:58:43.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64a97fa640 1 -- 10.20.193.104:0/4236358365 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f649c038a40 con 0x7f64ac102790 2026-02-17T20:58:43.702 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64a97fa640 1 -- 10.20.193.104:0/4236358365 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f649c0418e0 con 0x7f64ac102790 2026-02-17T20:58:43.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.696+0000 7f64b258f640 1 -- 10.20.193.104:0/4236358365 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64ac1a1f00 con 0x7f64ac102790 2026-02-17T20:58:43.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.697+0000 7f64b258f640 1 -- 10.20.193.104:0/4236358365 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64ac101990 con 0x7f64ac102790 2026-02-17T20:58:43.703 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.697+0000 7f64a97fa640 1 -- 10.20.193.104:0/4236358365 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f649c038bf0 con 0x7f64ac102790 2026-02-17T20:58:43.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.698+0000 7f64a97fa640 1 --2- 10.20.193.104:0/4236358365 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f64800775a0 0x7f6480079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:43.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.698+0000 7f64abfff640 1 --2- 10.20.193.104:0/4236358365 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f64800775a0 0x7f6480079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:43.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.698+0000 7f64a97fa640 1 -- 10.20.193.104:0/4236358365 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f649c03e070 con 0x7f64ac102790 2026-02-17T20:58:43.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.698+0000 7f64abfff640 1 --2- 10.20.193.104:0/4236358365 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f64800775a0 0x7f6480079a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6498005fd0 tx=0x7f6498004380 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:43.704 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.700+0000 7f64a97fa640 1 -- 10.20.193.104:0/4236358365 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f649c08b570 con 0x7f64ac102790 2026-02-17T20:58:43.792 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.789+0000 7f64b258f640 1 -- 10.20.193.104:0/4236358365 --> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f64ac06b590 con 0x7f64800775a0 2026-02-17T20:58:43.792 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.790+0000 7f64a97fa640 1 -- 10.20.193.104:0/4236358365 <== mgr.14203 v2:10.20.193.104:6800/2484917436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f64ac06b590 con 0x7f64800775a0 2026-02-17T20:58:43.793 INFO:teuthology.orchestra.run.trial104.stdout:Backend: cephadm 2026-02-17T20:58:43.793 INFO:teuthology.orchestra.run.trial104.stdout:Available: Yes 2026-02-17T20:58:43.793 INFO:teuthology.orchestra.run.trial104.stdout:Paused: No 2026-02-17T20:58:43.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.790+0000 7f64b258f640 1 -- 10.20.193.104:0/4236358365 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f64800775a0 msgr2=0x7f6480079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:43.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.790+0000 7f64b258f640 1 --2- 10.20.193.104:0/4236358365 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f64800775a0 0x7f6480079a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f6498005fd0 tx=0x7f6498004380 comp rx=0 tx=0).stop 2026-02-17T20:58:43.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.790+0000 7f64b258f640 1 -- 10.20.193.104:0/4236358365 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64ac102790 msgr2=0x7f64ac19c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:43.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.790+0000 7f64b258f640 1 --2- 10.20.193.104:0/4236358365 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64ac102790 0x7f64ac19c890 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f649c002410 tx=0x7f649c02fe10 comp rx=0 tx=0).stop 2026-02-17T20:58:43.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.790+0000 7f64b258f640 1 -- 10.20.193.104:0/4236358365 shutdown_connections 2026-02-17T20:58:43.795 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.790+0000 7f64b258f640 1 --2- 10.20.193.104:0/4236358365 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f64800775a0 0x7f6480079a60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:43.795 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.790+0000 7f64b258f640 1 --2- 10.20.193.104:0/4236358365 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f64ac102790 0x7f64ac19c890 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:43.795 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.790+0000 7f64b258f640 1 --2- 10.20.193.104:0/4236358365 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f64ac101590 0x7f64ac19c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:43.795 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.790+0000 7f64b258f640 1 -- 10.20.193.104:0/4236358365 >> 10.20.193.104:0/4236358365 conn(0x7f64ac0fcd20 msgr2=0x7f64ac06ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:43.795 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.791+0000 7f64b258f640 1 -- 10.20.193.104:0/4236358365 shutdown_connections 2026-02-17T20:58:43.795 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:43.791+0000 7f64b258f640 1 -- 10.20.193.104:0/4236358365 wait complete. 2026-02-17T20:58:43.829 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- bash -c 'ceph orch ps' 2026-02-17T20:58:43.980 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:44.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.075+0000 7f079b28e640 1 -- 10.20.193.104:0/342328588 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0794103830 msgr2=0x7f0794105ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:44.080 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.075+0000 7f079b28e640 1 --2- 10.20.193.104:0/342328588 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0794103830 0x7f0794105ca0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f07880099b0 tx=0x7f078802f220 comp rx=0 tx=0).stop 2026-02-17T20:58:44.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.075+0000 7f079b28e640 1 -- 10.20.193.104:0/342328588 shutdown_connections 2026-02-17T20:58:44.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.075+0000 7f079b28e640 1 --2- 10.20.193.104:0/342328588 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0794103830 0x7f0794105ca0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.075+0000 7f079b28e640 1 --2- 10.20.193.104:0/342328588 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0794100ee0 0x7f07941032f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.075+0000 7f079b28e640 1 -- 10.20.193.104:0/342328588 >> 10.20.193.104:0/342328588 conn(0x7f07940fcd10 msgr2=0x7f07940ff130 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:44.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.075+0000 7f079b28e640 1 -- 10.20.193.104:0/342328588 shutdown_connections 2026-02-17T20:58:44.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.075+0000 7f079b28e640 1 -- 10.20.193.104:0/342328588 wait complete. 2026-02-17T20:58:44.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.075+0000 7f079b28e640 1 Processor -- start 2026-02-17T20:58:44.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f079b28e640 1 -- start start 2026-02-17T20:58:44.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f079b28e640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0794100ee0 0x7f07941a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:44.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f079b28e640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0794103830 0x7f07941a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:44.081 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f079b28e640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f07941119a0 con 0x7f0794100ee0 2026-02-17T20:58:44.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f079b28e640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0794111820 con 0x7f0794103830 2026-02-17T20:58:44.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f0799003640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0794100ee0 0x7f07941a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:44.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f0799003640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0794100ee0 0x7f07941a0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41400/0 (socket says 10.20.193.104:41400) 2026-02-17T20:58:44.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f0799003640 1 -- 10.20.193.104:0/3266537688 learned_addr learned my addr 10.20.193.104:0/3266537688 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:44.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f0798802640 1 --2- 10.20.193.104:0/3266537688 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0794103830 0x7f07941a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:44.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f0799003640 1 -- 10.20.193.104:0/3266537688 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0794103830 msgr2=0x7f07941a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:44.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f0799003640 1 --2- 10.20.193.104:0/3266537688 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0794103830 0x7f07941a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f0799003640 1 -- 10.20.193.104:0/3266537688 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07941a1340 con 0x7f0794100ee0 2026-02-17T20:58:44.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f0799003640 1 --2- 10.20.193.104:0/3266537688 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0794100ee0 0x7f07941a0810 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f078400ca30 tx=0x7f078400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:44.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f07827fc640 1 -- 10.20.193.104:0/3266537688 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0784013070 con 0x7f0794100ee0 2026-02-17T20:58:44.082 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f07827fc640 1 -- 10.20.193.104:0/3266537688 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f0784007da0 con 0x7f0794100ee0 2026-02-17T20:58:44.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f07827fc640 1 -- 10.20.193.104:0/3266537688 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0784002e20 con 0x7f0794100ee0 2026-02-17T20:58:44.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f079b28e640 1 -- 10.20.193.104:0/3266537688 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07941a5db0 con 0x7f0794100ee0 2026-02-17T20:58:44.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.076+0000 7f079b28e640 1 -- 10.20.193.104:0/3266537688 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07941a6340 con 0x7f0794100ee0 2026-02-17T20:58:44.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.077+0000 7f079b28e640 1 -- 10.20.193.104:0/3266537688 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07941012e0 con 0x7f0794100ee0 2026-02-17T20:58:44.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.077+0000 7f07827fc640 1 -- 10.20.193.104:0/3266537688 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f0784007930 con 0x7f0794100ee0 2026-02-17T20:58:44.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.077+0000 7f07827fc640 1 --2- 10.20.193.104:0/3266537688 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f07700774f0 0x7f07700799b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:44.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.078+0000 7f07827fc640 1 -- 10.20.193.104:0/3266537688 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f0784099e00 con 0x7f0794100ee0 2026-02-17T20:58:44.083 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.078+0000 7f0798802640 1 --2- 10.20.193.104:0/3266537688 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f07700774f0 0x7f07700799b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:44.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.078+0000 7f0798802640 1 --2- 10.20.193.104:0/3266537688 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f07700774f0 0x7f07700799b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0788002af0 tx=0x7f078803a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:44.084 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.079+0000 7f07827fc640 1 -- 10.20.193.104:0/3266537688 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0784004440 con 0x7f0794100ee0 2026-02-17T20:58:44.168 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.165+0000 7f079b28e640 1 -- 10.20.193.104:0/3266537688 --> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f07941041d0 con 0x7f07700774f0 2026-02-17T20:58:44.172 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.170+0000 7f07827fc640 1 -- 10.20.193.104:0/3266537688 <== mgr.14203 v2:10.20.193.104:6800/2484917436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3388 (secure 0 0 0) 0x7f07941041d0 con 0x7f07700774f0 2026-02-17T20:58:44.173 INFO:teuthology.orchestra.run.trial104.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2026-02-17T20:58:44.173 INFO:teuthology.orchestra.run.trial104.stdout:alertmanager.trial104 trial104 *:9093,9094 running (86s) 49s ago 109s 30.9M - 0.25.0 c8568f914cd2 1dd65d956e53 2026-02-17T20:58:44.173 INFO:teuthology.orchestra.run.trial104.stdout:ceph-exporter.trial104 trial104 *:9926 running (112s) 49s ago 112s 8896k - 19.2.3-683-g76b494d6 84fe6a74d1a3 57236c6aefc6 2026-02-17T20:58:44.173 INFO:teuthology.orchestra.run.trial104.stdout:ceph-exporter.trial153 trial153 *:9926 running (97s) 13s ago 97s 6567k - 19.2.3-683-g76b494d6 84fe6a74d1a3 db665ef4740e 2026-02-17T20:58:44.173 INFO:teuthology.orchestra.run.trial104.stdout:crash.trial104 trial104 running (112s) 49s ago 112s 7642k - 19.2.3-683-g76b494d6 84fe6a74d1a3 8b51fedd9ea8 2026-02-17T20:58:44.173 INFO:teuthology.orchestra.run.trial104.stdout:crash.trial153 trial153 running (96s) 13s ago 96s 7638k - 19.2.3-683-g76b494d6 84fe6a74d1a3 cfbcf5f4a019 2026-02-17T20:58:44.173 INFO:teuthology.orchestra.run.trial104.stdout:grafana.trial104 trial104 *:3000 running (85s) 49s ago 106s 80.0M - 10.4.0 c8b91775d855 c7161df15c19 2026-02-17T20:58:44.173 INFO:teuthology.orchestra.run.trial104.stdout:mgr.trial104.irrhmt trial104 *:9283,8765,8443 running (2m) 49s ago 2m 543M - 19.2.3-683-g76b494d6 84fe6a74d1a3 322d5f2229d1 2026-02-17T20:58:44.174 INFO:teuthology.orchestra.run.trial104.stdout:mgr.trial153.ivmqog trial153 *:8443,9283,8765 running (94s) 13s ago 94s 487M - 19.2.3-683-g76b494d6 84fe6a74d1a3 0c8a8570b95d 2026-02-17T20:58:44.174 INFO:teuthology.orchestra.run.trial104.stdout:mon.trial104 trial104 running (2m) 49s ago 2m 50.0M 2048M 19.2.3-683-g76b494d6 84fe6a74d1a3 23121052e323 2026-02-17T20:58:44.174 INFO:teuthology.orchestra.run.trial104.stdout:mon.trial153 trial153 running (94s) 13s ago 94s 45.1M 2048M 19.2.3-683-g76b494d6 84fe6a74d1a3 00137817b84e 2026-02-17T20:58:44.174 INFO:teuthology.orchestra.run.trial104.stdout:node-exporter.trial104 trial104 *:9100 running (110s) 49s ago 110s 12.6M - 1.7.0 72c9c2088986 615449f6a9b0 2026-02-17T20:58:44.174 INFO:teuthology.orchestra.run.trial104.stdout:node-exporter.trial153 trial153 *:9100 running (95s) 13s ago 95s 12.5M - 1.7.0 72c9c2088986 6c10dc84848a 2026-02-17T20:58:44.174 INFO:teuthology.orchestra.run.trial104.stdout:osd.0 trial104 running (78s) 49s ago 78s 32.0M 19.2G 19.2.3-683-g76b494d6 84fe6a74d1a3 aee2a5cd9a06 2026-02-17T20:58:44.174 INFO:teuthology.orchestra.run.trial104.stdout:osd.1 trial104 running (68s) 49s ago 68s 32.1M 19.2G 19.2.3-683-g76b494d6 84fe6a74d1a3 1136bf055ba7 2026-02-17T20:58:44.174 INFO:teuthology.orchestra.run.trial104.stdout:osd.2 trial104 running (59s) 49s ago 59s 34.8M 19.2G 19.2.3-683-g76b494d6 84fe6a74d1a3 3689807877ae 2026-02-17T20:58:44.174 INFO:teuthology.orchestra.run.trial104.stdout:osd.3 trial104 running (50s) 49s ago 50s 12.5M 19.2G 19.2.3-683-g76b494d6 84fe6a74d1a3 51bbbd869a43 2026-02-17T20:58:44.174 INFO:teuthology.orchestra.run.trial104.stdout:osd.4 trial153 running (41s) 13s ago 41s 39.7M 19.9G 19.2.3-683-g76b494d6 84fe6a74d1a3 ae779a7086dc 2026-02-17T20:58:44.174 INFO:teuthology.orchestra.run.trial104.stdout:osd.5 trial153 running (32s) 13s ago 32s 45.7M 19.9G 19.2.3-683-g76b494d6 84fe6a74d1a3 a6f71a58c5ba 2026-02-17T20:58:44.174 INFO:teuthology.orchestra.run.trial104.stdout:osd.6 trial153 running (23s) 13s ago 23s 35.8M 19.9G 19.2.3-683-g76b494d6 84fe6a74d1a3 6118052e59da 2026-02-17T20:58:44.175 INFO:teuthology.orchestra.run.trial104.stdout:osd.7 trial153 running (14s) 13s ago 14s 15.4M 19.9G 19.2.3-683-g76b494d6 84fe6a74d1a3 344ed0c8bb53 2026-02-17T20:58:44.175 INFO:teuthology.orchestra.run.trial104.stdout:prometheus.trial104 trial104 *:9095 running (84s) 49s ago 104s 40.9M - 2.51.0 1d3b7f56885b 535dc779c841 2026-02-17T20:58:44.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.171+0000 7f079b28e640 1 -- 10.20.193.104:0/3266537688 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f07700774f0 msgr2=0x7f07700799b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:44.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.171+0000 7f079b28e640 1 --2- 10.20.193.104:0/3266537688 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f07700774f0 0x7f07700799b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0788002af0 tx=0x7f078803a040 comp rx=0 tx=0).stop 2026-02-17T20:58:44.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.171+0000 7f079b28e640 1 -- 10.20.193.104:0/3266537688 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0794100ee0 msgr2=0x7f07941a0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:44.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.171+0000 7f079b28e640 1 --2- 10.20.193.104:0/3266537688 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0794100ee0 0x7f07941a0810 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f078400ca30 tx=0x7f078400cf00 comp rx=0 tx=0).stop 2026-02-17T20:58:44.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.171+0000 7f079b28e640 1 -- 10.20.193.104:0/3266537688 shutdown_connections 2026-02-17T20:58:44.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.171+0000 7f079b28e640 1 --2- 10.20.193.104:0/3266537688 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f07700774f0 0x7f07700799b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.171+0000 7f079b28e640 1 --2- 10.20.193.104:0/3266537688 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0794103830 0x7f07941a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.176 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.171+0000 7f079b28e640 1 --2- 10.20.193.104:0/3266537688 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0794100ee0 0x7f07941a0810 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.171+0000 7f079b28e640 1 -- 10.20.193.104:0/3266537688 >> 10.20.193.104:0/3266537688 conn(0x7f07940fcd10 msgr2=0x7f07940ff100 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:44.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.171+0000 7f079b28e640 1 -- 10.20.193.104:0/3266537688 shutdown_connections 2026-02-17T20:58:44.177 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.171+0000 7f079b28e640 1 -- 10.20.193.104:0/3266537688 wait complete. 2026-02-17T20:58:44.210 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- bash -c 'ceph orch ls' 2026-02-17T20:58:44.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:44 trial153 ceph-mon[25357]: from='client.14482 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T20:58:44.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:44 trial153 ceph-mon[25357]: from='client.14486 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T20:58:44.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:44 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/3088148974' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-17T20:58:44.365 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:44.387 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:44 trial104 ceph-mon[20612]: from='client.14482 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T20:58:44.387 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:44 trial104 ceph-mon[20612]: from='client.14486 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-17T20:58:44.387 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:44 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3088148974' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2026-02-17T20:58:44.471 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.464+0000 7ff618857640 1 -- 10.20.193.104:0/4035897812 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff610105b20 msgr2=0x7ff610105fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:44.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.464+0000 7ff618857640 1 --2- 10.20.193.104:0/4035897812 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff610105b20 0x7ff610105fa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0099b0 tx=0x7ff5fc02f220 comp rx=0 tx=0).stop 2026-02-17T20:58:44.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.464+0000 7ff618857640 1 -- 10.20.193.104:0/4035897812 shutdown_connections 2026-02-17T20:58:44.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.464+0000 7ff618857640 1 --2- 10.20.193.104:0/4035897812 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff610105b20 0x7ff610105fa0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.464+0000 7ff618857640 1 --2- 10.20.193.104:0/4035897812 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff610104920 0x7ff610104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.472 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.464+0000 7ff618857640 1 -- 10.20.193.104:0/4035897812 >> 10.20.193.104:0/4035897812 conn(0x7ff6101000b0 msgr2=0x7ff6101024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:44.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.464+0000 7ff618857640 1 -- 10.20.193.104:0/4035897812 shutdown_connections 2026-02-17T20:58:44.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.464+0000 7ff618857640 1 -- 10.20.193.104:0/4035897812 wait complete. 2026-02-17T20:58:44.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff618857640 1 Processor -- start 2026-02-17T20:58:44.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff618857640 1 -- start start 2026-02-17T20:58:44.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff618857640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff610104920 0x7ff61019c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:44.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff618857640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff610105b20 0x7ff61019c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:44.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff618857640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff61010d4b0 con 0x7ff610104920 2026-02-17T20:58:44.473 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff618857640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff61010d330 con 0x7ff610105b20 2026-02-17T20:58:44.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff6165cc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff610104920 0x7ff61019c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:44.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff6165cc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff610104920 0x7ff61019c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41410/0 (socket says 10.20.193.104:41410) 2026-02-17T20:58:44.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff6165cc640 1 -- 10.20.193.104:0/104921129 learned_addr learned my addr 10.20.193.104:0/104921129 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:44.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff615dcb640 1 --2- 10.20.193.104:0/104921129 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff610105b20 0x7ff61019c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:44.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff6165cc640 1 -- 10.20.193.104:0/104921129 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff610105b20 msgr2=0x7ff61019c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:44.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff6165cc640 1 --2- 10.20.193.104:0/104921129 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff610105b20 0x7ff61019c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff6165cc640 1 -- 10.20.193.104:0/104921129 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61019cec0 con 0x7ff610104920 2026-02-17T20:58:44.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff6165cc640 1 --2- 10.20.193.104:0/104921129 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff610104920 0x7ff61019c300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff60800d900 tx=0x7ff60800ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:44.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff5fb7fe640 1 -- 10.20.193.104:0/104921129 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7ff608014070 con 0x7ff610104920 2026-02-17T20:58:44.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff618857640 1 -- 10.20.193.104:0/104921129 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6101a1900 con 0x7ff610104920 2026-02-17T20:58:44.474 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff5fb7fe640 1 -- 10.20.193.104:0/104921129 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7ff6080044a0 con 0x7ff610104920 2026-02-17T20:58:44.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff5fb7fe640 1 -- 10.20.193.104:0/104921129 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7ff608002c40 con 0x7ff610104920 2026-02-17T20:58:44.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.465+0000 7ff618857640 1 -- 10.20.193.104:0/104921129 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6101a1f10 con 0x7ff610104920 2026-02-17T20:58:44.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.466+0000 7ff618857640 1 -- 10.20.193.104:0/104921129 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff610104d20 con 0x7ff610104920 2026-02-17T20:58:44.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.466+0000 7ff5fb7fe640 1 -- 10.20.193.104:0/104921129 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7ff60800b840 con 0x7ff610104920 2026-02-17T20:58:44.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.467+0000 7ff5fb7fe640 1 --2- 10.20.193.104:0/104921129 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7ff5ec0775a0 0x7ff5ec079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:44.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.467+0000 7ff615dcb640 1 --2- 10.20.193.104:0/104921129 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7ff5ec0775a0 0x7ff5ec079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:44.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.467+0000 7ff5fb7fe640 1 -- 10.20.193.104:0/104921129 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7ff608099dc0 con 0x7ff610104920 2026-02-17T20:58:44.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.467+0000 7ff615dcb640 1 --2- 10.20.193.104:0/104921129 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7ff5ec0775a0 0x7ff5ec079a60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc002af0 tx=0x7ff5fc03a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:44.475 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.469+0000 7ff5fb7fe640 1 -- 10.20.193.104:0/104921129 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff608066f90 con 0x7ff610104920 2026-02-17T20:58:44.558 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.555+0000 7ff618857640 1 -- 10.20.193.104:0/104921129 --> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7ff6100630c0 con 0x7ff5ec0775a0 2026-02-17T20:58:44.560 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.557+0000 7ff5fb7fe640 1 -- 10.20.193.104:0/104921129 <== mgr.14203 v2:10.20.193.104:6800/2484917436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1280 (secure 0 0 0) 0x7ff6100630c0 con 0x7ff5ec0775a0 2026-02-17T20:58:44.560 INFO:teuthology.orchestra.run.trial104.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2026-02-17T20:58:44.560 INFO:teuthology.orchestra.run.trial104.stdout:alertmanager ?:9093,9094 1/1 49s ago 2m count:1 2026-02-17T20:58:44.561 INFO:teuthology.orchestra.run.trial104.stdout:ceph-exporter ?:9926 2/2 49s ago 2m * 2026-02-17T20:58:44.561 INFO:teuthology.orchestra.run.trial104.stdout:crash 2/2 49s ago 2m * 2026-02-17T20:58:44.561 INFO:teuthology.orchestra.run.trial104.stdout:grafana ?:3000 1/1 49s ago 2m count:1 2026-02-17T20:58:44.561 INFO:teuthology.orchestra.run.trial104.stdout:mgr 2/2 49s ago 2m count:2 2026-02-17T20:58:44.561 INFO:teuthology.orchestra.run.trial104.stdout:mon 2/2 49s ago 109s trial104:10.20.193.104=trial104;trial153:10.20.193.153=trial153;count:2 2026-02-17T20:58:44.561 INFO:teuthology.orchestra.run.trial104.stdout:node-exporter ?:9100 2/2 49s ago 2m * 2026-02-17T20:58:44.561 INFO:teuthology.orchestra.run.trial104.stdout:osd 8 49s ago - 2026-02-17T20:58:44.561 INFO:teuthology.orchestra.run.trial104.stdout:prometheus ?:9095 1/1 49s ago 2m count:1 2026-02-17T20:58:44.562 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.558+0000 7ff618857640 1 -- 10.20.193.104:0/104921129 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7ff5ec0775a0 msgr2=0x7ff5ec079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:44.562 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.558+0000 7ff618857640 1 --2- 10.20.193.104:0/104921129 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7ff5ec0775a0 0x7ff5ec079a60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc002af0 tx=0x7ff5fc03a040 comp rx=0 tx=0).stop 2026-02-17T20:58:44.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.558+0000 7ff618857640 1 -- 10.20.193.104:0/104921129 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff610104920 msgr2=0x7ff61019c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:44.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.558+0000 7ff618857640 1 --2- 10.20.193.104:0/104921129 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff610104920 0x7ff61019c300 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff60800d900 tx=0x7ff60800ddd0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.558+0000 7ff618857640 1 -- 10.20.193.104:0/104921129 shutdown_connections 2026-02-17T20:58:44.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.558+0000 7ff618857640 1 --2- 10.20.193.104:0/104921129 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7ff5ec0775a0 0x7ff5ec079a60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.558+0000 7ff618857640 1 --2- 10.20.193.104:0/104921129 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff610105b20 0x7ff61019c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.558+0000 7ff618857640 1 --2- 10.20.193.104:0/104921129 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff610104920 0x7ff61019c300 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.558+0000 7ff618857640 1 -- 10.20.193.104:0/104921129 >> 10.20.193.104:0/104921129 conn(0x7ff6101000b0 msgr2=0x7ff6101091a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:44.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.558+0000 7ff618857640 1 -- 10.20.193.104:0/104921129 shutdown_connections 2026-02-17T20:58:44.563 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.558+0000 7ff618857640 1 -- 10.20.193.104:0/104921129 wait complete. 2026-02-17T20:58:44.596 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- bash -c 'ceph orch host ls' 2026-02-17T20:58:44.747 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:44.850 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.845+0000 7fabcb684640 1 -- 10.20.193.104:0/1107584186 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fabc4108e30 msgr2=0x7fabc4109230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:44.850 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.845+0000 7fabcb684640 1 --2- 10.20.193.104:0/1107584186 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fabc4108e30 0x7fabc4109230 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fabb40099b0 tx=0x7fabb402f220 comp rx=0 tx=0).stop 2026-02-17T20:58:44.850 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.845+0000 7fabcb684640 1 -- 10.20.193.104:0/1107584186 shutdown_connections 2026-02-17T20:58:44.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.845+0000 7fabcb684640 1 --2- 10.20.193.104:0/1107584186 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabc4109f90 0x7fabc410a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.845+0000 7fabcb684640 1 --2- 10.20.193.104:0/1107584186 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fabc4108e30 0x7fabc4109230 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.845+0000 7fabcb684640 1 -- 10.20.193.104:0/1107584186 >> 10.20.193.104:0/1107584186 conn(0x7fabc4077de0 msgr2=0x7fabc407a220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:44.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.845+0000 7fabcb684640 1 -- 10.20.193.104:0/1107584186 shutdown_connections 2026-02-17T20:58:44.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.845+0000 7fabcb684640 1 -- 10.20.193.104:0/1107584186 wait complete. 2026-02-17T20:58:44.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.845+0000 7fabcb684640 1 Processor -- start 2026-02-17T20:58:44.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabcb684640 1 -- start start 2026-02-17T20:58:44.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabcb684640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fabc4108e30 0x7fabc41a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:44.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabcb684640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabc4109f90 0x7fabc41a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:44.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabcb684640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fabc41119e0 con 0x7fabc4108e30 2026-02-17T20:58:44.851 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabcb684640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fabc4111860 con 0x7fabc4109f90 2026-02-17T20:58:44.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabc93f9640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fabc4108e30 0x7fabc41a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:44.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabc93f9640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fabc4108e30 0x7fabc41a0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41436/0 (socket says 10.20.193.104:41436) 2026-02-17T20:58:44.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabc93f9640 1 -- 10.20.193.104:0/3822569794 learned_addr learned my addr 10.20.193.104:0/3822569794 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:44.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabc8bf8640 1 --2- 10.20.193.104:0/3822569794 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabc4109f90 0x7fabc41a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:44.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabc93f9640 1 -- 10.20.193.104:0/3822569794 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabc4109f90 msgr2=0x7fabc41a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:44.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabc93f9640 1 --2- 10.20.193.104:0/3822569794 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabc4109f90 0x7fabc41a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabc93f9640 1 -- 10.20.193.104:0/3822569794 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc41a14e0 con 0x7fabc4108e30 2026-02-17T20:58:44.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabc93f9640 1 --2- 10.20.193.104:0/3822569794 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fabc4108e30 0x7fabc41a0920 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fabb4004290 tx=0x7fabb40042c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:44.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabb27fc640 1 -- 10.20.193.104:0/3822569794 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fabb4046070 con 0x7fabc4108e30 2026-02-17T20:58:44.852 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabb27fc640 1 -- 10.20.193.104:0/3822569794 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fabb4038c00 con 0x7fabc4108e30 2026-02-17T20:58:44.853 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabcb684640 1 -- 10.20.193.104:0/3822569794 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc41a5ec0 con 0x7fabc4108e30 2026-02-17T20:58:44.853 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabb27fc640 1 -- 10.20.193.104:0/3822569794 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fabb4041af0 con 0x7fabc4108e30 2026-02-17T20:58:44.853 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.846+0000 7fabcb684640 1 -- 10.20.193.104:0/3822569794 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc41a63f0 con 0x7fabc4108e30 2026-02-17T20:58:44.853 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.847+0000 7fabcb684640 1 -- 10.20.193.104:0/3822569794 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabc41092b0 con 0x7fabc4108e30 2026-02-17T20:58:44.853 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.847+0000 7fabb27fc640 1 -- 10.20.193.104:0/3822569794 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7fabb4038790 con 0x7fabc4108e30 2026-02-17T20:58:44.855 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.848+0000 7fabb27fc640 1 --2- 10.20.193.104:0/3822569794 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7faba00775a0 0x7faba0079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:44.855 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.848+0000 7fabb27fc640 1 -- 10.20.193.104:0/3822569794 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7fabb403e070 con 0x7fabc4108e30 2026-02-17T20:58:44.855 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.848+0000 7fabc8bf8640 1 --2- 10.20.193.104:0/3822569794 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7faba00775a0 0x7faba0079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:44.856 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.848+0000 7fabc8bf8640 1 --2- 10.20.193.104:0/3822569794 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7faba00775a0 0x7faba0079a60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fabc41a1dd0 tx=0x7fabb8008040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:44.856 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.850+0000 7fabb27fc640 1 -- 10.20.193.104:0/3822569794 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fabb4050020 con 0x7fabc4108e30 2026-02-17T20:58:44.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.935+0000 7fabcb684640 1 -- 10.20.193.104:0/3822569794 --> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fabc410e970 con 0x7faba00775a0 2026-02-17T20:58:44.938 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.936+0000 7fabb27fc640 1 -- 10.20.193.104:0/3822569794 <== mgr.14203 v2:10.20.193.104:6800/2484917436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+145 (secure 0 0 0) 0x7fabc410e970 con 0x7faba00775a0 2026-02-17T20:58:44.939 INFO:teuthology.orchestra.run.trial104.stdout:HOST ADDR LABELS STATUS 2026-02-17T20:58:44.939 INFO:teuthology.orchestra.run.trial104.stdout:trial104 10.20.193.104 2026-02-17T20:58:44.940 INFO:teuthology.orchestra.run.trial104.stdout:trial153 10.20.193.153 2026-02-17T20:58:44.940 INFO:teuthology.orchestra.run.trial104.stdout:2 hosts in cluster 2026-02-17T20:58:44.941 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.936+0000 7fabcb684640 1 -- 10.20.193.104:0/3822569794 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7faba00775a0 msgr2=0x7faba0079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:44.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.936+0000 7fabcb684640 1 --2- 10.20.193.104:0/3822569794 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7faba00775a0 0x7faba0079a60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fabc41a1dd0 tx=0x7fabb8008040 comp rx=0 tx=0).stop 2026-02-17T20:58:44.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.936+0000 7fabcb684640 1 -- 10.20.193.104:0/3822569794 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fabc4108e30 msgr2=0x7fabc41a0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:44.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.936+0000 7fabcb684640 1 --2- 10.20.193.104:0/3822569794 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fabc4108e30 0x7fabc41a0920 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fabb4004290 tx=0x7fabb40042c0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.936+0000 7fabcb684640 1 -- 10.20.193.104:0/3822569794 shutdown_connections 2026-02-17T20:58:44.942 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.936+0000 7fabcb684640 1 --2- 10.20.193.104:0/3822569794 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7faba00775a0 0x7faba0079a60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.936+0000 7fabcb684640 1 --2- 10.20.193.104:0/3822569794 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fabc4109f90 0x7fabc41a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.936+0000 7fabcb684640 1 --2- 10.20.193.104:0/3822569794 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fabc4108e30 0x7fabc41a0920 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:44.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.936+0000 7fabcb684640 1 -- 10.20.193.104:0/3822569794 >> 10.20.193.104:0/3822569794 conn(0x7fabc4077de0 msgr2=0x7fabc410d250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:44.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.936+0000 7fabcb684640 1 -- 10.20.193.104:0/3822569794 shutdown_connections 2026-02-17T20:58:44.943 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:44.936+0000 7fabcb684640 1 -- 10.20.193.104:0/3822569794 wait complete. 2026-02-17T20:58:44.974 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- bash -c 'ceph orch device ls' 2026-02-17T20:58:45.127 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:45.149 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:45 trial104 ceph-mon[20612]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T20:58:45.149 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:45 trial104 ceph-mon[20612]: from='client.14494 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:45.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.224+0000 7f6f9c413640 1 -- 10.20.193.104:0/1513443924 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6f94105b40 msgr2=0x7f6f94105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:45.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.224+0000 7f6f9c413640 1 --2- 10.20.193.104:0/1513443924 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6f94105b40 0x7f6f94105fc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6f880099b0 tx=0x7f6f8802f220 comp rx=0 tx=0).stop 2026-02-17T20:58:45.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.224+0000 7f6f9c413640 1 -- 10.20.193.104:0/1513443924 shutdown_connections 2026-02-17T20:58:45.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.224+0000 7f6f9c413640 1 --2- 10.20.193.104:0/1513443924 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6f94105b40 0x7f6f94105fc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:45.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.224+0000 7f6f9c413640 1 --2- 10.20.193.104:0/1513443924 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6f94104940 0x7f6f94104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:45.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.224+0000 7f6f9c413640 1 -- 10.20.193.104:0/1513443924 >> 10.20.193.104:0/1513443924 conn(0x7f6f941000f0 msgr2=0x7f6f94102510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:45.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.224+0000 7f6f9c413640 1 -- 10.20.193.104:0/1513443924 shutdown_connections 2026-02-17T20:58:45.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.224+0000 7f6f9c413640 1 -- 10.20.193.104:0/1513443924 wait complete. 2026-02-17T20:58:45.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f9c413640 1 Processor -- start 2026-02-17T20:58:45.230 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f9c413640 1 -- start start 2026-02-17T20:58:45.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f9c413640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6f94104940 0x7f6f9419c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:45.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f9c413640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6f94105b40 0x7f6f9419c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:45.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f9c413640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9410d4d0 con 0x7f6f94105b40 2026-02-17T20:58:45.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f9c413640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9410d350 con 0x7f6f94104940 2026-02-17T20:58:45.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f99987640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6f94105b40 0x7f6f9419c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:45.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f99987640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6f94105b40 0x7f6f9419c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41446/0 (socket says 10.20.193.104:41446) 2026-02-17T20:58:45.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f99987640 1 -- 10.20.193.104:0/1135800090 learned_addr learned my addr 10.20.193.104:0/1135800090 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:45.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f9a188640 1 --2- 10.20.193.104:0/1135800090 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6f94104940 0x7f6f9419c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:45.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f99987640 1 -- 10.20.193.104:0/1135800090 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6f94104940 msgr2=0x7f6f9419c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:45.231 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f99987640 1 --2- 10.20.193.104:0/1135800090 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6f94104940 0x7f6f9419c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:45.232 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f99987640 1 -- 10.20.193.104:0/1135800090 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9419cf00 con 0x7f6f94105b40 2026-02-17T20:58:45.232 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f99987640 1 --2- 10.20.193.104:0/1135800090 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6f94105b40 0x7f6f9419c880 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009ae0 tx=0x7f6f88002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:45.232 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f7b7fe640 1 -- 10.20.193.104:0/1135800090 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6f880044e0 con 0x7f6f94105b40 2026-02-17T20:58:45.232 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f7b7fe640 1 -- 10.20.193.104:0/1135800090 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f6f88038a40 con 0x7f6f94105b40 2026-02-17T20:58:45.232 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f9c413640 1 -- 10.20.193.104:0/1135800090 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f941a18e0 con 0x7f6f94105b40 2026-02-17T20:58:45.232 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f7b7fe640 1 -- 10.20.193.104:0/1135800090 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6f88041980 con 0x7f6f94105b40 2026-02-17T20:58:45.232 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.225+0000 7f6f9c413640 1 -- 10.20.193.104:0/1135800090 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f941a1ef0 con 0x7f6f94105b40 2026-02-17T20:58:45.232 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.226+0000 7f6f9c413640 1 -- 10.20.193.104:0/1135800090 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f94104d40 con 0x7f6f94105b40 2026-02-17T20:58:45.232 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.226+0000 7f6f7b7fe640 1 -- 10.20.193.104:0/1135800090 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f6f880385d0 con 0x7f6f94105b40 2026-02-17T20:58:45.232 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.227+0000 7f6f7b7fe640 1 --2- 10.20.193.104:0/1135800090 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f6f700775a0 0x7f6f70079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:45.232 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.227+0000 7f6f9a188640 1 --2- 10.20.193.104:0/1135800090 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f6f700775a0 0x7f6f70079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:45.232 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.227+0000 7f6f7b7fe640 1 -- 10.20.193.104:0/1135800090 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7f6f8803e070 con 0x7f6f94105b40 2026-02-17T20:58:45.233 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.227+0000 7f6f9a188640 1 --2- 10.20.193.104:0/1135800090 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f6f700775a0 0x7f6f70079a60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6f84005fd0 tx=0x7f6f84004380 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:45.233 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.229+0000 7f6f7b7fe640 1 -- 10.20.193.104:0/1135800090 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6f8808b5b0 con 0x7f6f94105b40 2026-02-17T20:58:45.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:45 trial153 ceph-mon[25357]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T20:58:45.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:45 trial153 ceph-mon[25357]: from='client.14494 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:45.319 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.316+0000 7f6f9c413640 1 -- 10.20.193.104:0/1135800090 --> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f6f940630c0 con 0x7f6f700775a0 2026-02-17T20:58:45.320 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.317+0000 7f6f7b7fe640 1 -- 10.20.193.104:0/1135800090 <== mgr.14203 v2:10.20.193.104:6800/2484917436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+650 (secure 0 0 0) 0x7f6f940630c0 con 0x7f6f700775a0 2026-02-17T20:58:45.321 INFO:teuthology.orchestra.run.trial104.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2026-02-17T20:58:45.321 INFO:teuthology.orchestra.run.trial104.stdout:trial104 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B47AE7 1788G No 49s ago Has a FileSystem, LVM detected 2026-02-17T20:58:45.321 INFO:teuthology.orchestra.run.trial104.stdout:trial104 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_012510B47AE8 1788G No 49s ago Has a FileSystem, LVM detected 2026-02-17T20:58:45.321 INFO:teuthology.orchestra.run.trial104.stdout:trial153 /dev/nvme0n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6993 1788G No 13s ago Has a FileSystem, LVM detected 2026-02-17T20:58:45.321 INFO:teuthology.orchestra.run.trial104.stdout:trial153 /dev/nvme2n1 ssd MTFDKCC1T9TGP-1BK1JABYY_092510AB6933 1788G No 13s ago Has a FileSystem, LVM detected 2026-02-17T20:58:45.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.318+0000 7f6f9c413640 1 -- 10.20.193.104:0/1135800090 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f6f700775a0 msgr2=0x7f6f70079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:45.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.318+0000 7f6f9c413640 1 --2- 10.20.193.104:0/1135800090 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f6f700775a0 0x7f6f70079a60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6f84005fd0 tx=0x7f6f84004380 comp rx=0 tx=0).stop 2026-02-17T20:58:45.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.318+0000 7f6f9c413640 1 -- 10.20.193.104:0/1135800090 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6f94105b40 msgr2=0x7f6f9419c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:45.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.318+0000 7f6f9c413640 1 --2- 10.20.193.104:0/1135800090 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6f94105b40 0x7f6f9419c880 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6f88009ae0 tx=0x7f6f88002820 comp rx=0 tx=0).stop 2026-02-17T20:58:45.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.318+0000 7f6f9c413640 1 -- 10.20.193.104:0/1135800090 shutdown_connections 2026-02-17T20:58:45.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.318+0000 7f6f9c413640 1 --2- 10.20.193.104:0/1135800090 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f6f700775a0 0x7f6f70079a60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:45.322 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.318+0000 7f6f9c413640 1 --2- 10.20.193.104:0/1135800090 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6f94105b40 0x7f6f9419c880 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:45.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.318+0000 7f6f9c413640 1 --2- 10.20.193.104:0/1135800090 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6f94104940 0x7f6f9419c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:45.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.318+0000 7f6f9c413640 1 -- 10.20.193.104:0/1135800090 >> 10.20.193.104:0/1135800090 conn(0x7f6f941000f0 msgr2=0x7f6f94109250 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:45.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.318+0000 7f6f9c413640 1 -- 10.20.193.104:0/1135800090 shutdown_connections 2026-02-17T20:58:45.323 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.318+0000 7f6f9c413640 1 -- 10.20.193.104:0/1135800090 wait complete. 2026-02-17T20:58:45.357 INFO:teuthology.run_tasks:Running task cephadm.shell... 2026-02-17T20:58:45.372 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@trial104.front.sepia.ceph.com 2026-02-17T20:58:45.372 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- bash -c 'ceph fs volume create foo' 2026-02-17T20:58:45.523 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:45.633 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.627+0000 7fc4ba08a640 1 -- 10.20.193.104:0/2382392264 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc4b4078cf0 msgr2=0x7fc4b4079150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:45.633 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.627+0000 7fc4ba08a640 1 --2- 10.20.193.104:0/2382392264 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc4b4078cf0 0x7fc4b4079150 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40099b0 tx=0x7fc4a402f220 comp rx=0 tx=0).stop 2026-02-17T20:58:45.633 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.627+0000 7fc4ba08a640 1 -- 10.20.193.104:0/2382392264 shutdown_connections 2026-02-17T20:58:45.633 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.627+0000 7fc4ba08a640 1 --2- 10.20.193.104:0/2382392264 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc4b4078cf0 0x7fc4b4079150 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:45.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.627+0000 7fc4ba08a640 1 --2- 10.20.193.104:0/2382392264 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc4b4077aa0 0x7fc4b4077ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:45.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.627+0000 7fc4ba08a640 1 -- 10.20.193.104:0/2382392264 >> 10.20.193.104:0/2382392264 conn(0x7fc4b41000f0 msgr2=0x7fc4b4102510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:45.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.627+0000 7fc4ba08a640 1 -- 10.20.193.104:0/2382392264 shutdown_connections 2026-02-17T20:58:45.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.627+0000 7fc4ba08a640 1 -- 10.20.193.104:0/2382392264 wait complete. 2026-02-17T20:58:45.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4ba08a640 1 Processor -- start 2026-02-17T20:58:45.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4ba08a640 1 -- start start 2026-02-17T20:58:45.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4ba08a640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc4b4077aa0 0x7fc4b41a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:45.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4ba08a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc4b4078cf0 0x7fc4b41a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:45.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4ba08a640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b41119c0 con 0x7fc4b4077aa0 2026-02-17T20:58:45.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4ba08a640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b4111840 con 0x7fc4b4078cf0 2026-02-17T20:58:45.634 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4b37fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc4b4077aa0 0x7fc4b41a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:45.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4b37fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc4b4077aa0 0x7fc4b41a0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41462/0 (socket says 10.20.193.104:41462) 2026-02-17T20:58:45.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4b37fe640 1 -- 10.20.193.104:0/1842259342 learned_addr learned my addr 10.20.193.104:0/1842259342 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:45.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4b2ffd640 1 --2- 10.20.193.104:0/1842259342 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc4b4078cf0 0x7fc4b41a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:45.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4b37fe640 1 -- 10.20.193.104:0/1842259342 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc4b4078cf0 msgr2=0x7fc4b41a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:45.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4b37fe640 1 --2- 10.20.193.104:0/1842259342 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc4b4078cf0 0x7fc4b41a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:45.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4b37fe640 1 -- 10.20.193.104:0/1842259342 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b41a13d0 con 0x7fc4b4077aa0 2026-02-17T20:58:45.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4b2ffd640 1 --2- 10.20.193.104:0/1842259342 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc4b4078cf0 0x7fc4b41a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T20:58:45.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4b37fe640 1 --2- 10.20.193.104:0/1842259342 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc4b4077aa0 0x7fc4b41a0810 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc4a000e990 tx=0x7fc4a000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:45.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4b0ff9640 1 -- 10.20.193.104:0/1842259342 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc4a000cb80 con 0x7fc4b4077aa0 2026-02-17T20:58:45.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4b0ff9640 1 -- 10.20.193.104:0/1842259342 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fc4a0004540 con 0x7fc4b4077aa0 2026-02-17T20:58:45.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4ba08a640 1 -- 10.20.193.104:0/1842259342 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b41a5e10 con 0x7fc4b4077aa0 2026-02-17T20:58:45.635 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4b0ff9640 1 -- 10.20.193.104:0/1842259342 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc4a0002e60 con 0x7fc4b4077aa0 2026-02-17T20:58:45.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.628+0000 7fc4ba08a640 1 -- 10.20.193.104:0/1842259342 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b41a6340 con 0x7fc4b4077aa0 2026-02-17T20:58:45.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.629+0000 7fc4ba08a640 1 -- 10.20.193.104:0/1842259342 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b4077ea0 con 0x7fc4b4077aa0 2026-02-17T20:58:45.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.629+0000 7fc4b0ff9640 1 -- 10.20.193.104:0/1842259342 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7fc4a0020030 con 0x7fc4b4077aa0 2026-02-17T20:58:45.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.630+0000 7fc4b0ff9640 1 --2- 10.20.193.104:0/1842259342 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc488077550 0x7fc488079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:45.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.630+0000 7fc4b0ff9640 1 -- 10.20.193.104:0/1842259342 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5498+0+0 (secure 0 0 0) 0x7fc4a0099940 con 0x7fc4b4077aa0 2026-02-17T20:58:45.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.630+0000 7fc4b2ffd640 1 --2- 10.20.193.104:0/1842259342 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc488077550 0x7fc488079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:45.636 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.630+0000 7fc4b2ffd640 1 --2- 10.20.193.104:0/1842259342 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc488077550 0x7fc488079a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40097c0 tx=0x7fc4a4005c70 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:45.637 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.631+0000 7fc4b0ff9640 1 -- 10.20.193.104:0/1842259342 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc4a0066a50 con 0x7fc4b4077aa0 2026-02-17T20:58:45.727 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:45.724+0000 7fc4ba08a640 1 -- 10.20.193.104:0/1842259342 --> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "foo", "target": ["mon-mgr", ""]}) -- 0x7fc4b40630c0 con 0x7fc488077550 2026-02-17T20:58:46.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:46 trial153 ceph-mon[25357]: from='client.14498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:46.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:46 trial153 ceph-mon[25357]: from='client.14502 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:46.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:46 trial153 ceph-mon[25357]: from='client.14506 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:46.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:46 trial153 ceph-mon[25357]: from='client.14510 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:46.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:46 trial153 ceph-mon[25357]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T20:58:46.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:46 trial153 ceph-mon[25357]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "foo", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:46.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:46 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd pool create", "pool": "cephfs.foo.meta"}]: dispatch 2026-02-17T20:58:46.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:46 trial104 ceph-mon[20612]: from='client.14498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:46.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:46 trial104 ceph-mon[20612]: from='client.14502 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:46.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:46 trial104 ceph-mon[20612]: from='client.14506 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:46.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:46 trial104 ceph-mon[20612]: from='client.14510 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:46.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:46 trial104 ceph-mon[20612]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T20:58:46.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:46 trial104 ceph-mon[20612]: from='client.14514 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "foo", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:46.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:46 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd pool create", "pool": "cephfs.foo.meta"}]: dispatch 2026-02-17T20:58:47.027 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.024+0000 7fc4b0ff9640 1 -- 10.20.193.104:0/1842259342 <== mgr.14203 v2:10.20.193.104:6800/2484917436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc4b40630c0 con 0x7fc488077550 2026-02-17T20:58:47.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.026+0000 7fc4ba08a640 1 -- 10.20.193.104:0/1842259342 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc488077550 msgr2=0x7fc488079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:47.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.026+0000 7fc4ba08a640 1 --2- 10.20.193.104:0/1842259342 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc488077550 0x7fc488079a10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40097c0 tx=0x7fc4a4005c70 comp rx=0 tx=0).stop 2026-02-17T20:58:47.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.026+0000 7fc4ba08a640 1 -- 10.20.193.104:0/1842259342 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc4b4077aa0 msgr2=0x7fc4b41a0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:47.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.026+0000 7fc4ba08a640 1 --2- 10.20.193.104:0/1842259342 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc4b4077aa0 0x7fc4b41a0810 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc4a000e990 tx=0x7fc4a000ee60 comp rx=0 tx=0).stop 2026-02-17T20:58:47.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.026+0000 7fc4ba08a640 1 -- 10.20.193.104:0/1842259342 shutdown_connections 2026-02-17T20:58:47.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.026+0000 7fc4ba08a640 1 --2- 10.20.193.104:0/1842259342 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc488077550 0x7fc488079a10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:47.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.026+0000 7fc4ba08a640 1 --2- 10.20.193.104:0/1842259342 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc4b4078cf0 0x7fc4b41a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:47.030 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.026+0000 7fc4ba08a640 1 --2- 10.20.193.104:0/1842259342 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc4b4077aa0 0x7fc4b41a0810 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:47.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.026+0000 7fc4ba08a640 1 -- 10.20.193.104:0/1842259342 >> 10.20.193.104:0/1842259342 conn(0x7fc4b41000f0 msgr2=0x7fc4b410f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:47.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.026+0000 7fc4ba08a640 1 -- 10.20.193.104:0/1842259342 shutdown_connections 2026-02-17T20:58:47.031 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.026+0000 7fc4ba08a640 1 -- 10.20.193.104:0/1842259342 wait complete. 2026-02-17T20:58:47.068 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- bash -c 'ceph fs volume create bar' 2026-02-17T20:58:47.224 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:47.269 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:47 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "osd pool create", "pool": "cephfs.foo.meta"}]': finished 2026-02-17T20:58:47.269 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:47 trial104 ceph-mon[20612]: osdmap e49: 8 total, 8 up, 8 in 2026-02-17T20:58:47.270 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:47 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"}]: dispatch 2026-02-17T20:58:47.270 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:47 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial104[20608]: 2026-02-17T20:58:47.016+0000 7fe8e58e5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-17T20:58:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:47 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "osd pool create", "pool": "cephfs.foo.meta"}]': finished 2026-02-17T20:58:47.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:47 trial153 ceph-mon[25357]: osdmap e49: 8 total, 8 up, 8 in 2026-02-17T20:58:47.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:47 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"}]: dispatch 2026-02-17T20:58:47.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.319+0000 7fe47f895640 1 -- 10.20.193.104:0/4214597098 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe478105b40 msgr2=0x7fe478105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:47.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.319+0000 7fe47f895640 1 --2- 10.20.193.104:0/4214597098 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe478105b40 0x7fe478105fc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0099b0 tx=0x7fe46c02f220 comp rx=0 tx=0).stop 2026-02-17T20:58:47.325 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.319+0000 7fe47f895640 1 -- 10.20.193.104:0/4214597098 shutdown_connections 2026-02-17T20:58:47.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.319+0000 7fe47f895640 1 --2- 10.20.193.104:0/4214597098 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe478105b40 0x7fe478105fc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:47.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.319+0000 7fe47f895640 1 --2- 10.20.193.104:0/4214597098 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe478104940 0x7fe478104d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:47.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.319+0000 7fe47f895640 1 -- 10.20.193.104:0/4214597098 >> 10.20.193.104:0/4214597098 conn(0x7fe4781000f0 msgr2=0x7fe478102510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:47.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.319+0000 7fe47f895640 1 -- 10.20.193.104:0/4214597098 shutdown_connections 2026-02-17T20:58:47.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe47f895640 1 -- 10.20.193.104:0/4214597098 wait complete. 2026-02-17T20:58:47.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe47f895640 1 Processor -- start 2026-02-17T20:58:47.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe47f895640 1 -- start start 2026-02-17T20:58:47.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe47f895640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe478104940 0x7fe47819c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:47.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe47f895640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe478105b40 0x7fe47819c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:47.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe47f895640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe47810d4d0 con 0x7fe478105b40 2026-02-17T20:58:47.326 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe47f895640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe47810d350 con 0x7fe478104940 2026-02-17T20:58:47.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe47ce09640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe478105b40 0x7fe47819c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:47.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe47ce09640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe478105b40 0x7fe47819c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:41478/0 (socket says 10.20.193.104:41478) 2026-02-17T20:58:47.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe47ce09640 1 -- 10.20.193.104:0/3913707767 learned_addr learned my addr 10.20.193.104:0/3913707767 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:47.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe47d60a640 1 --2- 10.20.193.104:0/3913707767 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe478104940 0x7fe47819c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:47.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe47ce09640 1 -- 10.20.193.104:0/3913707767 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe478104940 msgr2=0x7fe47819c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:47.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe47ce09640 1 --2- 10.20.193.104:0/3913707767 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe478104940 0x7fe47819c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:47.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe47ce09640 1 -- 10.20.193.104:0/3913707767 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47819ced0 con 0x7fe478105b40 2026-02-17T20:58:47.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe47d60a640 1 --2- 10.20.193.104:0/3913707767 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe478104940 0x7fe47819c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T20:58:47.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe47ce09640 1 --2- 10.20.193.104:0/3913707767 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe478105b40 0x7fe47819c850 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe46c002410 tx=0x7fe46c002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:47.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe4667fc640 1 -- 10.20.193.104:0/3913707767 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fe46c004420 con 0x7fe478105b40 2026-02-17T20:58:47.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe4667fc640 1 -- 10.20.193.104:0/3913707767 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fe46c038a40 con 0x7fe478105b40 2026-02-17T20:58:47.327 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe47f895640 1 -- 10.20.193.104:0/3913707767 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4781a18b0 con 0x7fe478105b40 2026-02-17T20:58:47.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.320+0000 7fe4667fc640 1 -- 10.20.193.104:0/3913707767 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fe46c041880 con 0x7fe478105b40 2026-02-17T20:58:47.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.321+0000 7fe47f895640 1 -- 10.20.193.104:0/3913707767 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4781a1ec0 con 0x7fe478105b40 2026-02-17T20:58:47.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.321+0000 7fe47f895640 1 -- 10.20.193.104:0/3913707767 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe478104d40 con 0x7fe478105b40 2026-02-17T20:58:47.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.322+0000 7fe4667fc640 1 -- 10.20.193.104:0/3913707767 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7fe46c0385d0 con 0x7fe478105b40 2026-02-17T20:58:47.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.322+0000 7fe4667fc640 1 --2- 10.20.193.104:0/3913707767 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe4540775a0 0x7fe454079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:47.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.322+0000 7fe4667fc640 1 -- 10.20.193.104:0/3913707767 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6316+0+0 (secure 0 0 0) 0x7fe46c03e070 con 0x7fe478105b40 2026-02-17T20:58:47.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.322+0000 7fe47d60a640 1 --2- 10.20.193.104:0/3913707767 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe4540775a0 0x7fe454079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:47.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.322+0000 7fe47d60a640 1 --2- 10.20.193.104:0/3913707767 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe4540775a0 0x7fe454079a60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe4781059a0 tx=0x7fe468009290 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:47.329 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.325+0000 7fe4667fc640 1 -- 10.20.193.104:0/3913707767 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe46c049340 con 0x7fe478105b40 2026-02-17T20:58:47.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:47.420+0000 7fe47f895640 1 -- 10.20.193.104:0/3913707767 --> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "bar", "target": ["mon-mgr", ""]}) -- 0x7fe4780630c0 con 0x7fe4540775a0 2026-02-17T20:58:48.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"}]': finished 2026-02-17T20:58:48.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: osdmap e50: 8 total, 8 up, 8 in 2026-02-17T20:58:48.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"}]: dispatch 2026-02-17T20:58:48.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-17T20:58:48.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-17T20:58:48.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"}]': finished 2026-02-17T20:58:48.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: osdmap e51: 8 total, 8 up, 8 in 2026-02-17T20:58:48.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: fsmap foo:0 2026-02-17T20:58:48.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: Saving service mds.foo spec with placement count:2 2026-02-17T20:58:48.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:48.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:48.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:48.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:48.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:48.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.foo.trial104.gnmuyp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-17T20:58:48.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.trial104.gnmuyp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-17T20:58:48.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:48.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: Deploying daemon mds.foo.trial104.gnmuyp on trial104 2026-02-17T20:58:48.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='client.14518 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "bar", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:48.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd pool create", "pool": "cephfs.bar.meta"}]: dispatch 2026-02-17T20:58:48.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: pgmap v91: 65 pgs: 3 creating+peering, 57 unknown, 5 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T20:58:48.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:48.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:48.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:48.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.foo.trial153.jtthho", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-17T20:58:48.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.trial153.jtthho", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-17T20:58:48.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:48.278 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:48 trial153 ceph-mon[25357]: Deploying daemon mds.foo.trial153.jtthho on trial153 2026-02-17T20:58:48.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.foo.data"}]': finished 2026-02-17T20:58:48.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: osdmap e50: 8 total, 8 up, 8 in 2026-02-17T20:58:48.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"}]: dispatch 2026-02-17T20:58:48.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2026-02-17T20:58:48.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-17T20:58:48.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "fs new", "fs_name": "foo", "metadata": "cephfs.foo.meta", "data": "cephfs.foo.data"}]': finished 2026-02-17T20:58:48.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: osdmap e51: 8 total, 8 up, 8 in 2026-02-17T20:58:48.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: fsmap foo:0 2026-02-17T20:58:48.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: Saving service mds.foo spec with placement count:2 2026-02-17T20:58:48.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:48.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:48.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:48.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:48.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:48.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.foo.trial104.gnmuyp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-17T20:58:48.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.trial104.gnmuyp", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-17T20:58:48.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:48.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: Deploying daemon mds.foo.trial104.gnmuyp on trial104 2026-02-17T20:58:48.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='client.14518 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "bar", "target": ["mon-mgr", ""]}]: dispatch 2026-02-17T20:58:48.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd pool create", "pool": "cephfs.bar.meta"}]: dispatch 2026-02-17T20:58:48.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: pgmap v91: 65 pgs: 3 creating+peering, 57 unknown, 5 active+clean; 577 KiB data, 216 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-17T20:58:48.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:48.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:48.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:48.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.foo.trial153.jtthho", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-17T20:58:48.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foo.trial153.jtthho", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-17T20:58:48.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:48.406 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:48 trial104 ceph-mon[20612]: Deploying daemon mds.foo.trial153.jtthho on trial153 2026-02-17T20:58:49.047 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.045+0000 7fe4667fc640 1 -- 10.20.193.104:0/3913707767 <== mgr.14203 v2:10.20.193.104:6800/2484917436 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe4780630c0 con 0x7fe4540775a0 2026-02-17T20:58:49.049 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.047+0000 7fe47f895640 1 -- 10.20.193.104:0/3913707767 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe4540775a0 msgr2=0x7fe454079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:49.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.047+0000 7fe47f895640 1 --2- 10.20.193.104:0/3913707767 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe4540775a0 0x7fe454079a60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe4781059a0 tx=0x7fe468009290 comp rx=0 tx=0).stop 2026-02-17T20:58:49.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.047+0000 7fe47f895640 1 -- 10.20.193.104:0/3913707767 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe478105b40 msgr2=0x7fe47819c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:49.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.047+0000 7fe47f895640 1 --2- 10.20.193.104:0/3913707767 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe478105b40 0x7fe47819c850 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe46c002410 tx=0x7fe46c002910 comp rx=0 tx=0).stop 2026-02-17T20:58:49.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.047+0000 7fe47f895640 1 -- 10.20.193.104:0/3913707767 shutdown_connections 2026-02-17T20:58:49.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.047+0000 7fe47f895640 1 --2- 10.20.193.104:0/3913707767 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe4540775a0 0x7fe454079a60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:49.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.047+0000 7fe47f895640 1 --2- 10.20.193.104:0/3913707767 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe478105b40 0x7fe47819c850 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:49.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.047+0000 7fe47f895640 1 --2- 10.20.193.104:0/3913707767 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe478104940 0x7fe47819c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:49.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.047+0000 7fe47f895640 1 -- 10.20.193.104:0/3913707767 >> 10.20.193.104:0/3913707767 conn(0x7fe4781000f0 msgr2=0x7fe4781091c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:49.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.047+0000 7fe47f895640 1 -- 10.20.193.104:0/3913707767 shutdown_connections 2026-02-17T20:58:49.050 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.047+0000 7fe47f895640 1 -- 10.20.193.104:0/3913707767 wait complete. 2026-02-17T20:58:49.092 INFO:teuthology.run_tasks:Running task fs.ready... 2026-02-17T20:58:49.114 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph fs dump --format=json 2026-02-17T20:58:49.269 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "osd pool create", "pool": "cephfs.bar.meta"}]': finished 2026-02-17T20:58:49.269 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: osdmap e52: 8 total, 8 up, 8 in 2026-02-17T20:58:49.269 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.bar.data"}]: dispatch 2026-02-17T20:58:49.270 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: mds.? [v2:10.20.193.104:6834/743462196,v1:10.20.193.104:6835/743462196] up:boot 2026-02-17T20:58:49.270 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: daemon mds.foo.trial104.gnmuyp assigned to filesystem foo as rank 0 (now has 1 ranks) 2026-02-17T20:58:49.270 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-17T20:58:49.270 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-17T20:58:49.270 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: Cluster is now healthy 2026-02-17T20:58:49.270 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: fsmap foo:0 1 up:standby 2026-02-17T20:58:49.270 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mds metadata", "who": "foo.trial104.gnmuyp"}]: dispatch 2026-02-17T20:58:49.270 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: fsmap foo:1 {0=foo.trial104.gnmuyp=up:creating} 2026-02-17T20:58:49.270 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: daemon mds.foo.trial104.gnmuyp is now active in filesystem foo as rank 0 2026-02-17T20:58:49.270 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:49.270 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:49.270 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:49.271 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:49.271 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:49.271 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:49.271 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:49 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:58:49.289 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:49.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.389+0000 7f67986d5640 1 -- 10.20.193.104:0/3586836103 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f679010a8b0 msgr2=0x7f679010ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:49.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.389+0000 7f67986d5640 1 --2- 10.20.193.104:0/3586836103 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f679010a8b0 0x7f679010ac90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f67800099b0 tx=0x7f678002f220 comp rx=0 tx=0).stop 2026-02-17T20:58:49.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.389+0000 7f67986d5640 1 -- 10.20.193.104:0/3586836103 shutdown_connections 2026-02-17T20:58:49.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.389+0000 7f67986d5640 1 --2- 10.20.193.104:0/3586836103 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f67901048b0 0x7f6790104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:49.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.389+0000 7f67986d5640 1 --2- 10.20.193.104:0/3586836103 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f679010a8b0 0x7f679010ac90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:49.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.389+0000 7f67986d5640 1 -- 10.20.193.104:0/3586836103 >> 10.20.193.104:0/3586836103 conn(0x7f67901005f0 msgr2=0x7f6790102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:49.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.389+0000 7f67986d5640 1 -- 10.20.193.104:0/3586836103 shutdown_connections 2026-02-17T20:58:49.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.389+0000 7f67986d5640 1 -- 10.20.193.104:0/3586836103 wait complete. 2026-02-17T20:58:49.394 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.390+0000 7f67986d5640 1 Processor -- start 2026-02-17T20:58:49.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.390+0000 7f67986d5640 1 -- start start 2026-02-17T20:58:49.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.390+0000 7f67986d5640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f67901048b0 0x7f67901a25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:49.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.390+0000 7f67986d5640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f679010a8b0 0x7f67901a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:49.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.390+0000 7f67986d5640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6790111ad0 con 0x7f679010a8b0 2026-02-17T20:58:49.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.390+0000 7f67986d5640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6790111950 con 0x7f67901048b0 2026-02-17T20:58:49.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.390+0000 7f6795c49640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f679010a8b0 0x7f67901a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:49.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.390+0000 7f6795c49640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f679010a8b0 0x7f67901a2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38266/0 (socket says 10.20.193.104:38266) 2026-02-17T20:58:49.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.390+0000 7f6795c49640 1 -- 10.20.193.104:0/2970835233 learned_addr learned my addr 10.20.193.104:0/2970835233 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:49.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.390+0000 7f679644a640 1 --2- 10.20.193.104:0/2970835233 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f67901048b0 0x7f67901a25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:49.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.390+0000 7f6795c49640 1 -- 10.20.193.104:0/2970835233 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f67901048b0 msgr2=0x7f67901a25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:49.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.390+0000 7f6795c49640 1 --2- 10.20.193.104:0/2970835233 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f67901048b0 0x7f67901a25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:49.395 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.390+0000 7f6795c49640 1 -- 10.20.193.104:0/2970835233 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679019c680 con 0x7f679010a8b0 2026-02-17T20:58:49.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.390+0000 7f6795c49640 1 --2- 10.20.193.104:0/2970835233 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f679010a8b0 0x7f67901a2af0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f678400ca30 tx=0x7f678400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:49.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.390+0000 7f67777fe640 1 -- 10.20.193.104:0/2970835233 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6784013070 con 0x7f679010a8b0 2026-02-17T20:58:49.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.391+0000 7f67777fe640 1 -- 10.20.193.104:0/2970835233 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f6784007da0 con 0x7f679010a8b0 2026-02-17T20:58:49.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.391+0000 7f67986d5640 1 -- 10.20.193.104:0/2970835233 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679019c970 con 0x7f679010a8b0 2026-02-17T20:58:49.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.391+0000 7f67777fe640 1 -- 10.20.193.104:0/2970835233 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f6784002e20 con 0x7f679010a8b0 2026-02-17T20:58:49.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.391+0000 7f67986d5640 1 -- 10.20.193.104:0/2970835233 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f679019cf00 con 0x7f679010a8b0 2026-02-17T20:58:49.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.391+0000 7f67986d5640 1 -- 10.20.193.104:0/2970835233 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6790105ff0 con 0x7f679010a8b0 2026-02-17T20:58:49.396 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.392+0000 7f67777fe640 1 -- 10.20.193.104:0/2970835233 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f6784007930 con 0x7f679010a8b0 2026-02-17T20:58:49.397 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.392+0000 7f67777fe640 1 --2- 10.20.193.104:0/2970835233 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f676c077550 0x7f676c079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:49.397 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.392+0000 7f67777fe640 1 -- 10.20.193.104:0/2970835233 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 7134+0+0 (secure 0 0 0) 0x7f678409a2f0 con 0x7f679010a8b0 2026-02-17T20:58:49.397 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.392+0000 7f679644a640 1 --2- 10.20.193.104:0/2970835233 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f676c077550 0x7f676c079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:49.397 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.393+0000 7f679644a640 1 --2- 10.20.193.104:0/2970835233 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f676c077550 0x7f676c079a10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f67800097c0 tx=0x7f678003a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:49.398 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.394+0000 7f67777fe640 1 -- 10.20.193.104:0/2970835233 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f6784004440 con 0x7f679010a8b0 2026-02-17T20:58:49.502 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.500+0000 7f67986d5640 1 -- 10.20.193.104:0/2970835233 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f679019d210 con 0x7f679010a8b0 2026-02-17T20:58:49.503 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.501+0000 7f67777fe640 1 -- 10.20.193.104:0/2970835233 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+4919 (secure 0 0 0) 0x7f6784066e60 con 0x7f679010a8b0 2026-02-17T20:58:49.503 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:49.503 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":5,"btime":"2026-02-17T20:58:49:038291+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-17T20:58:47.017728+0000","modified":"2026-02-17T20:58:49.038287+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14522":{"gid":14522,"name":"foo.trial104.gnmuyp","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"10.20.193.104:6835/743462196","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6834","nonce":743462196},{"type":"v1","addr":"10.20.193.104:6835","nonce":743462196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":14522,"qdb_cluster":[14522]},"id":1},{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-17T20:58:49.029526+0000","modified":"2026-02-17T20:58:49.029559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24327},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24327":{"gid":24327,"name":"foo.trial153.jtthho","rank":0,"incarnation":5,"state":"up:creating","state_seq":1,"addr":"10.20.193.153:6833/3911303877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6832","nonce":3911303877},{"type":"v1","addr":"10.20.193.153:6833","nonce":3911303877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2026-02-17T20:58:49.504 INFO:teuthology.orchestra.run.trial104.stderr:dumped fsmap epoch 5 2026-02-17T20:58:49.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.502+0000 7f67986d5640 1 -- 10.20.193.104:0/2970835233 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f676c077550 msgr2=0x7f676c079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:49.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.502+0000 7f67986d5640 1 --2- 10.20.193.104:0/2970835233 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f676c077550 0x7f676c079a10 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f67800097c0 tx=0x7f678003a040 comp rx=0 tx=0).stop 2026-02-17T20:58:49.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.502+0000 7f67986d5640 1 -- 10.20.193.104:0/2970835233 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f679010a8b0 msgr2=0x7f67901a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:49.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.502+0000 7f67986d5640 1 --2- 10.20.193.104:0/2970835233 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f679010a8b0 0x7f67901a2af0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f678400ca30 tx=0x7f678400cf00 comp rx=0 tx=0).stop 2026-02-17T20:58:49.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.502+0000 7f67986d5640 1 -- 10.20.193.104:0/2970835233 shutdown_connections 2026-02-17T20:58:49.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.502+0000 7f67986d5640 1 --2- 10.20.193.104:0/2970835233 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f676c077550 0x7f676c079a10 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:49.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.502+0000 7f67986d5640 1 --2- 10.20.193.104:0/2970835233 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f679010a8b0 0x7f67901a2af0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:49.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.502+0000 7f67986d5640 1 --2- 10.20.193.104:0/2970835233 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f67901048b0 0x7f67901a25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:49.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.502+0000 7f67986d5640 1 -- 10.20.193.104:0/2970835233 >> 10.20.193.104:0/2970835233 conn(0x7f67901005f0 msgr2=0x7f67901027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:49.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.502+0000 7f67986d5640 1 -- 10.20.193.104:0/2970835233 shutdown_connections 2026-02-17T20:58:49.505 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.502+0000 7f67986d5640 1 -- 10.20.193.104:0/2970835233 wait complete. 2026-02-17T20:58:49.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "osd pool create", "pool": "cephfs.bar.meta"}]': finished 2026-02-17T20:58:49.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: osdmap e52: 8 total, 8 up, 8 in 2026-02-17T20:58:49.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.bar.data"}]: dispatch 2026-02-17T20:58:49.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: mds.? [v2:10.20.193.104:6834/743462196,v1:10.20.193.104:6835/743462196] up:boot 2026-02-17T20:58:49.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: daemon mds.foo.trial104.gnmuyp assigned to filesystem foo as rank 0 (now has 1 ranks) 2026-02-17T20:58:49.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2026-02-17T20:58:49.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-17T20:58:49.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: Cluster is now healthy 2026-02-17T20:58:49.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: fsmap foo:0 1 up:standby 2026-02-17T20:58:49.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mds metadata", "who": "foo.trial104.gnmuyp"}]: dispatch 2026-02-17T20:58:49.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: fsmap foo:1 {0=foo.trial104.gnmuyp=up:creating} 2026-02-17T20:58:49.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: daemon mds.foo.trial104.gnmuyp is now active in filesystem foo as rank 0 2026-02-17T20:58:49.526 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:49.526 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:49.526 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:49.526 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:49.526 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:49.526 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:49.526 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:49 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:58:49.541 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph fs dump --format=json 2026-02-17T20:58:49.716 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:49.915 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.911+0000 7f906a00c640 1 -- 10.20.193.104:0/3671246867 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f906410a7f0 msgr2=0x7f906410abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:49.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.911+0000 7f906a00c640 1 --2- 10.20.193.104:0/3671246867 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f906410a7f0 0x7f906410abd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f90580098e0 tx=0x7f905802f1d0 comp rx=0 tx=0).stop 2026-02-17T20:58:49.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.911+0000 7f906a00c640 1 -- 10.20.193.104:0/3671246867 shutdown_connections 2026-02-17T20:58:49.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.911+0000 7f906a00c640 1 --2- 10.20.193.104:0/3671246867 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f90641046e0 0x7f9064104b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:49.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.911+0000 7f906a00c640 1 --2- 10.20.193.104:0/3671246867 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f906410a7f0 0x7f906410abd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:49.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.911+0000 7f906a00c640 1 -- 10.20.193.104:0/3671246867 >> 10.20.193.104:0/3671246867 conn(0x7f90641003e0 msgr2=0x7f9064102800 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:49.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.911+0000 7f906a00c640 1 -- 10.20.193.104:0/3671246867 shutdown_connections 2026-02-17T20:58:49.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.911+0000 7f906a00c640 1 -- 10.20.193.104:0/3671246867 wait complete. 2026-02-17T20:58:49.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f906a00c640 1 Processor -- start 2026-02-17T20:58:49.916 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f906a00c640 1 -- start start 2026-02-17T20:58:49.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f906a00c640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f90641046e0 0x7f90641a23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:49.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f906a00c640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f906410a7f0 0x7f90641a2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:49.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f906a00c640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9064111a30 con 0x7f906410a7f0 2026-02-17T20:58:49.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f906a00c640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f90641118b0 con 0x7f90641046e0 2026-02-17T20:58:49.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f9068809640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f906410a7f0 0x7f90641a2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:49.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f9068809640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f906410a7f0 0x7f90641a2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38286/0 (socket says 10.20.193.104:38286) 2026-02-17T20:58:49.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f9068809640 1 -- 10.20.193.104:0/3810967460 learned_addr learned my addr 10.20.193.104:0/3810967460 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:49.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f906900a640 1 --2- 10.20.193.104:0/3810967460 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f90641046e0 0x7f90641a23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:49.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f9068809640 1 -- 10.20.193.104:0/3810967460 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f90641046e0 msgr2=0x7f90641a23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:49.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f9068809640 1 --2- 10.20.193.104:0/3810967460 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f90641046e0 0x7f90641a23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:49.917 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f9068809640 1 -- 10.20.193.104:0/3810967460 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f906419c5a0 con 0x7f906410a7f0 2026-02-17T20:58:49.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f9068809640 1 --2- 10.20.193.104:0/3810967460 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f906410a7f0 0x7f90641a2920 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f905400e9b0 tx=0x7f905400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:49.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f90527fc640 1 -- 10.20.193.104:0/3810967460 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f905400cbe0 con 0x7f906410a7f0 2026-02-17T20:58:49.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f906a00c640 1 -- 10.20.193.104:0/3810967460 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f906419c890 con 0x7f906410a7f0 2026-02-17T20:58:49.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f90527fc640 1 -- 10.20.193.104:0/3810967460 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f9054004540 con 0x7f906410a7f0 2026-02-17T20:58:49.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f90527fc640 1 -- 10.20.193.104:0/3810967460 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9054010430 con 0x7f906410a7f0 2026-02-17T20:58:49.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.912+0000 7f906a00c640 1 -- 10.20.193.104:0/3810967460 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f906419ce20 con 0x7f906410a7f0 2026-02-17T20:58:49.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.913+0000 7f906a00c640 1 -- 10.20.193.104:0/3810967460 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9064104b40 con 0x7f906410a7f0 2026-02-17T20:58:49.918 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.914+0000 7f90527fc640 1 -- 10.20.193.104:0/3810967460 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f90540040d0 con 0x7f906410a7f0 2026-02-17T20:58:49.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.914+0000 7f90527fc640 1 --2- 10.20.193.104:0/3810967460 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9034077550 0x7f9034079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:49.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.914+0000 7f906900a640 1 --2- 10.20.193.104:0/3810967460 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9034077550 0x7f9034079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:49.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.914+0000 7f90527fc640 1 -- 10.20.193.104:0/3810967460 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 7134+0+0 (secure 0 0 0) 0x7f905409a570 con 0x7f906410a7f0 2026-02-17T20:58:49.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.914+0000 7f906900a640 1 --2- 10.20.193.104:0/3810967460 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9034077550 0x7f9034079a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9058002410 tx=0x7f9058005d90 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:49.919 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:49.916+0000 7f90527fc640 1 -- 10.20.193.104:0/3810967460 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9054066fa0 con 0x7f906410a7f0 2026-02-17T20:58:50.020 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.017+0000 7f906a00c640 1 -- 10.20.193.104:0/3810967460 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9064105ec0 con 0x7f906410a7f0 2026-02-17T20:58:50.020 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.018+0000 7f90527fc640 1 -- 10.20.193.104:0/3810967460 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+4919 (secure 0 0 0) 0x7f905406be50 con 0x7f906410a7f0 2026-02-17T20:58:50.021 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:50.021 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":5,"btime":"2026-02-17T20:58:49:038291+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-17T20:58:47.017728+0000","modified":"2026-02-17T20:58:49.038287+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14522":{"gid":14522,"name":"foo.trial104.gnmuyp","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"10.20.193.104:6835/743462196","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6834","nonce":743462196},{"type":"v1","addr":"10.20.193.104:6835","nonce":743462196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":14522,"qdb_cluster":[14522]},"id":1},{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-17T20:58:49.029526+0000","modified":"2026-02-17T20:58:49.029559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24327},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24327":{"gid":24327,"name":"foo.trial153.jtthho","rank":0,"incarnation":5,"state":"up:creating","state_seq":1,"addr":"10.20.193.153:6833/3911303877","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6832","nonce":3911303877},{"type":"v1","addr":"10.20.193.153:6833","nonce":3911303877}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2026-02-17T20:58:50.023 INFO:teuthology.orchestra.run.trial104.stderr:dumped fsmap epoch 5 2026-02-17T20:58:50.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.019+0000 7f906a00c640 1 -- 10.20.193.104:0/3810967460 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9034077550 msgr2=0x7f9034079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:50.023 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.019+0000 7f906a00c640 1 --2- 10.20.193.104:0/3810967460 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9034077550 0x7f9034079a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9058002410 tx=0x7f9058005d90 comp rx=0 tx=0).stop 2026-02-17T20:58:50.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.019+0000 7f906a00c640 1 -- 10.20.193.104:0/3810967460 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f906410a7f0 msgr2=0x7f90641a2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:50.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.019+0000 7f906a00c640 1 --2- 10.20.193.104:0/3810967460 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f906410a7f0 0x7f90641a2920 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f905400e9b0 tx=0x7f905400ee80 comp rx=0 tx=0).stop 2026-02-17T20:58:50.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.019+0000 7f906a00c640 1 -- 10.20.193.104:0/3810967460 shutdown_connections 2026-02-17T20:58:50.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.019+0000 7f906a00c640 1 --2- 10.20.193.104:0/3810967460 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9034077550 0x7f9034079a10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.019+0000 7f906a00c640 1 --2- 10.20.193.104:0/3810967460 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f906410a7f0 0x7f90641a2920 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.024 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.019+0000 7f906a00c640 1 --2- 10.20.193.104:0/3810967460 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f90641046e0 0x7f90641a23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.019+0000 7f906a00c640 1 -- 10.20.193.104:0/3810967460 >> 10.20.193.104:0/3810967460 conn(0x7f90641003e0 msgr2=0x7f9064101180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:50.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.019+0000 7f906a00c640 1 -- 10.20.193.104:0/3810967460 shutdown_connections 2026-02-17T20:58:50.025 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.019+0000 7f906a00c640 1 -- 10.20.193.104:0/3810967460 wait complete. 2026-02-17T20:58:50.062 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T20:58:50.085 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.bar.data"}]': finished 2026-02-17T20:58:50.085 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: osdmap e53: 8 total, 8 up, 8 in 2026-02-17T20:58:50.085 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "fs new", "fs_name": "bar", "metadata": "cephfs.bar.meta", "data": "cephfs.bar.data"}]: dispatch 2026-02-17T20:58:50.085 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: daemon mds.foo.trial153.jtthho assigned to filesystem bar as rank 0 2026-02-17T20:58:50.085 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "fs new", "fs_name": "bar", "metadata": "cephfs.bar.meta", "data": "cephfs.bar.data"}]': finished 2026-02-17T20:58:50.085 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: osdmap e54: 8 total, 8 up, 8 in 2026-02-17T20:58:50.085 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: mds.? [v2:10.20.193.104:6834/743462196,v1:10.20.193.104:6835/743462196] up:active 2026-02-17T20:58:50.085 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: mds.? [v2:10.20.193.153:6832/3911303877,v1:10.20.193.153:6833/3911303877] up:boot 2026-02-17T20:58:50.086 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: fsmap foo:1 bar:1 {bar:0=foo.trial153.jtthho=up:creating,foo:0=foo.trial104.gnmuyp=up:active} 2026-02-17T20:58:50.086 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mds metadata", "who": "foo.trial153.jtthho"}]: dispatch 2026-02-17T20:58:50.086 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: Saving service mds.bar spec with placement count:2 2026-02-17T20:58:50.086 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:50.086 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: daemon mds.foo.trial153.jtthho is now active in filesystem bar as rank 0 2026-02-17T20:58:50.086 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:50.086 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:50.086 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:50.086 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:50.086 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:50.086 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:50.086 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:50.087 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.bar.trial104.jdjykv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-17T20:58:50.087 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.trial104.jdjykv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-17T20:58:50.087 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:50.087 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: Deploying daemon mds.bar.trial104.jdjykv on trial104 2026-02-17T20:58:50.087 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/2970835233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-17T20:58:50.087 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: pgmap v95: 129 pgs: 28 creating+peering, 30 unknown, 71 active+clean; 579 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 9.1 KiB/s wr, 14 op/s 2026-02-17T20:58:50.087 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:50 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3810967460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-17T20:58:50.226 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:50.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.329+0000 7f7dc077a640 1 -- 10.20.193.104:0/538915786 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7db8077f40 msgr2=0x7f7db8113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:50.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.329+0000 7f7dc077a640 1 --2- 10.20.193.104:0/538915786 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7db8077f40 0x7f7db8113220 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0099b0 tx=0x7f7dac02f220 comp rx=0 tx=0).stop 2026-02-17T20:58:50.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.329+0000 7f7dc077a640 1 -- 10.20.193.104:0/538915786 shutdown_connections 2026-02-17T20:58:50.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.329+0000 7f7dc077a640 1 --2- 10.20.193.104:0/538915786 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7db8077f40 0x7f7db8113220 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.335 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.329+0000 7f7dc077a640 1 --2- 10.20.193.104:0/538915786 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7db8077620 0x7f7db8077a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.329+0000 7f7dc077a640 1 -- 10.20.193.104:0/538915786 >> 10.20.193.104:0/538915786 conn(0x7f7db81005c0 msgr2=0x7f7db81029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:50.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.329+0000 7f7dc077a640 1 -- 10.20.193.104:0/538915786 shutdown_connections 2026-02-17T20:58:50.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.329+0000 7f7dc077a640 1 -- 10.20.193.104:0/538915786 wait complete. 2026-02-17T20:58:50.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7dc077a640 1 Processor -- start 2026-02-17T20:58:50.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7dc077a640 1 -- start start 2026-02-17T20:58:50.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7dc077a640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7db8077620 0x7f7db81a0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:50.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7dc077a640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7db8077f40 0x7f7db81a12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:50.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7dc077a640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f7db8116010 con 0x7f7db8077620 2026-02-17T20:58:50.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7dc077a640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f7db8115e90 con 0x7f7db8077f40 2026-02-17T20:58:50.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7dbe4ef640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7db8077620 0x7f7db81a0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:50.336 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7dbe4ef640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7db8077620 0x7f7db81a0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38334/0 (socket says 10.20.193.104:38334) 2026-02-17T20:58:50.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7dbe4ef640 1 -- 10.20.193.104:0/3351075982 learned_addr learned my addr 10.20.193.104:0/3351075982 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:50.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7dbdcee640 1 --2- 10.20.193.104:0/3351075982 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7db8077f40 0x7f7db81a12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:50.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7dbe4ef640 1 -- 10.20.193.104:0/3351075982 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7db8077f40 msgr2=0x7f7db81a12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:50.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7dbe4ef640 1 --2- 10.20.193.104:0/3351075982 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7db8077f40 0x7f7db81a12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7dbe4ef640 1 -- 10.20.193.104:0/3351075982 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db81a5640 con 0x7f7db8077620 2026-02-17T20:58:50.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7dbe4ef640 1 --2- 10.20.193.104:0/3351075982 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7db8077620 0x7f7db81a0d70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7da800e990 tx=0x7f7da800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:50.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7d9f7fe640 1 -- 10.20.193.104:0/3351075982 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f7da800cb80 con 0x7f7db8077620 2026-02-17T20:58:50.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7dc077a640 1 -- 10.20.193.104:0/3351075982 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db81a5930 con 0x7f7db8077620 2026-02-17T20:58:50.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7d9f7fe640 1 -- 10.20.193.104:0/3351075982 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f7da8004540 con 0x7f7db8077620 2026-02-17T20:58:50.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7d9f7fe640 1 -- 10.20.193.104:0/3351075982 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f7da8002e60 con 0x7f7db8077620 2026-02-17T20:58:50.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.330+0000 7f7dc077a640 1 -- 10.20.193.104:0/3351075982 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db81a5ec0 con 0x7f7db8077620 2026-02-17T20:58:50.337 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.331+0000 7f7dc077a640 1 -- 10.20.193.104:0/3351075982 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7db8078d60 con 0x7f7db8077620 2026-02-17T20:58:50.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.332+0000 7f7d9f7fe640 1 -- 10.20.193.104:0/3351075982 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f7da8020030 con 0x7f7db8077620 2026-02-17T20:58:50.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.332+0000 7f7d9f7fe640 1 --2- 10.20.193.104:0/3351075982 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f7d94077550 0x7f7d94079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:50.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.332+0000 7f7d9f7fe640 1 -- 10.20.193.104:0/3351075982 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 7134+0+0 (secure 0 0 0) 0x7f7da809a010 con 0x7f7db8077620 2026-02-17T20:58:50.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.332+0000 7f7dbdcee640 1 --2- 10.20.193.104:0/3351075982 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f7d94077550 0x7f7d94079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:50.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.333+0000 7f7dbdcee640 1 --2- 10.20.193.104:0/3351075982 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f7d94077550 0x7f7d94079a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7db8101d60 tx=0x7f7dac03a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:50.338 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.334+0000 7f7d9f7fe640 1 -- 10.20.193.104:0/3351075982 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7da8066ae0 con 0x7f7db8077620 2026-02-17T20:58:50.371 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.bar.data"}]': finished 2026-02-17T20:58:50.371 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: osdmap e53: 8 total, 8 up, 8 in 2026-02-17T20:58:50.371 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "fs new", "fs_name": "bar", "metadata": "cephfs.bar.meta", "data": "cephfs.bar.data"}]: dispatch 2026-02-17T20:58:50.371 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: daemon mds.foo.trial153.jtthho assigned to filesystem bar as rank 0 2026-02-17T20:58:50.371 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "fs new", "fs_name": "bar", "metadata": "cephfs.bar.meta", "data": "cephfs.bar.data"}]': finished 2026-02-17T20:58:50.371 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: osdmap e54: 8 total, 8 up, 8 in 2026-02-17T20:58:50.371 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: mds.? [v2:10.20.193.104:6834/743462196,v1:10.20.193.104:6835/743462196] up:active 2026-02-17T20:58:50.371 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: mds.? [v2:10.20.193.153:6832/3911303877,v1:10.20.193.153:6833/3911303877] up:boot 2026-02-17T20:58:50.371 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: fsmap foo:1 bar:1 {bar:0=foo.trial153.jtthho=up:creating,foo:0=foo.trial104.gnmuyp=up:active} 2026-02-17T20:58:50.371 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mds metadata", "who": "foo.trial153.jtthho"}]: dispatch 2026-02-17T20:58:50.372 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: Saving service mds.bar spec with placement count:2 2026-02-17T20:58:50.372 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:50.372 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: daemon mds.foo.trial153.jtthho is now active in filesystem bar as rank 0 2026-02-17T20:58:50.372 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:50.372 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:50.372 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:50.372 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:50.372 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:50.372 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:50.372 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:50.372 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.bar.trial104.jdjykv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-17T20:58:50.372 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.trial104.jdjykv", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-17T20:58:50.373 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:50.373 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: Deploying daemon mds.bar.trial104.jdjykv on trial104 2026-02-17T20:58:50.373 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/2970835233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-17T20:58:50.373 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: pgmap v95: 129 pgs: 28 creating+peering, 30 unknown, 71 active+clean; 579 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 9.1 KiB/s wr, 14 op/s 2026-02-17T20:58:50.373 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:50 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/3810967460' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-17T20:58:50.418 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.416+0000 7f7dc077a640 1 -- 10.20.193.104:0/3351075982 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7db81a20d0 con 0x7f7db8077620 2026-02-17T20:58:50.419 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.417+0000 7f7d9f7fe640 1 -- 10.20.193.104:0/3351075982 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) ==== 74+0+21404 (secure 0 0 0) 0x7f7da806b990 con 0x7f7db8077620 2026-02-17T20:58:50.420 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:50.420 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":55,"fsid":"19072504-0c43-11f1-93a3-d404e6e7d460","created":"2026-02-17T20:56:28.383257+0000","modified":"2026-02-17T20:58:50.039340+0000","last_up_change":"2026-02-17T20:58:36.991631+0000","last_in_change":"2026-02-17T20:58:24.285994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T20:57:51.660976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.foo.meta","create_time":"2026-02-17T20:58:45.732318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"foo"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.foo.data","create_time":"2026-02-17T20:58:46.020886+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"foo"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs.bar.meta","create_time":"2026-02-17T20:58:47.427175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"bar"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs.bar.data","create_time":"2026-02-17T20:58:48.028767+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"bar"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a22ae774-55bf-4c61-9328-96f1ad2a6a62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6802","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6803","nonce":438222704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6804","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6805","nonce":438222704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6808","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6809","nonce":438222704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6806","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6807","nonce":438222704}]},"public_addr":"10.20.193.104:6803/438222704","cluster_addr":"10.20.193.104:6805/438222704","heartbeat_back_addr":"10.20.193.104:6809/438222704","heartbeat_front_addr":"10.20.193.104:6807/438222704","state":["exists","up"]},{"osd":1,"uuid":"e221e89a-fd48-4e6f-a73d-a109718c9b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6810","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6811","nonce":1955490859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6812","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6813","nonce":1955490859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6816","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6817","nonce":1955490859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6814","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6815","nonce":1955490859}]},"public_addr":"10.20.193.104:6811/1955490859","cluster_addr":"10.20.193.104:6813/1955490859","heartbeat_back_addr":"10.20.193.104:6817/1955490859","heartbeat_front_addr":"10.20.193.104:6815/1955490859","state":["exists","up"]},{"osd":2,"uuid":"e0266db8-19cd-4ddb-a96a-cb84d2b0c4c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6818","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6819","nonce":3131863919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6820","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6821","nonce":3131863919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6824","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6825","nonce":3131863919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6822","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6823","nonce":3131863919}]},"public_addr":"10.20.193.104:6819/3131863919","cluster_addr":"10.20.193.104:6821/3131863919","heartbeat_back_addr":"10.20.193.104:6825/3131863919","heartbeat_front_addr":"10.20.193.104:6823/3131863919","state":["exists","up"]},{"osd":3,"uuid":"3b10ab50-7d78-4eea-b768-34534959a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6826","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6827","nonce":1948872135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6828","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6829","nonce":1948872135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6832","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6833","nonce":1948872135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6830","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6831","nonce":1948872135}]},"public_addr":"10.20.193.104:6827/1948872135","cluster_addr":"10.20.193.104:6829/1948872135","heartbeat_back_addr":"10.20.193.104:6833/1948872135","heartbeat_front_addr":"10.20.193.104:6831/1948872135","state":["exists","up"]},{"osd":4,"uuid":"d713875a-a825-474b-9ea5-cf8935174190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6800","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6801","nonce":250110565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6802","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6803","nonce":250110565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6806","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6807","nonce":250110565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6804","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6805","nonce":250110565}]},"public_addr":"10.20.193.153:6801/250110565","cluster_addr":"10.20.193.153:6803/250110565","heartbeat_back_addr":"10.20.193.153:6807/250110565","heartbeat_front_addr":"10.20.193.153:6805/250110565","state":["exists","up"]},{"osd":5,"uuid":"65f4195f-0129-41e5-931f-4b0a53ee6868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6808","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6809","nonce":2951447967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6810","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6811","nonce":2951447967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6814","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6815","nonce":2951447967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6812","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6813","nonce":2951447967}]},"public_addr":"10.20.193.153:6809/2951447967","cluster_addr":"10.20.193.153:6811/2951447967","heartbeat_back_addr":"10.20.193.153:6815/2951447967","heartbeat_front_addr":"10.20.193.153:6813/2951447967","state":["exists","up"]},{"osd":6,"uuid":"070da905-eb86-4405-a53f-fc3414a1ca70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6816","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6817","nonce":4066146238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6818","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6819","nonce":4066146238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6822","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6823","nonce":4066146238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6820","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6821","nonce":4066146238}]},"public_addr":"10.20.193.153:6817/4066146238","cluster_addr":"10.20.193.153:6819/4066146238","heartbeat_back_addr":"10.20.193.153:6823/4066146238","heartbeat_front_addr":"10.20.193.153:6821/4066146238","state":["exists","up"]},{"osd":7,"uuid":"25d0a88d-9c35-4a39-809f-7adfc0833bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6824","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6825","nonce":1592752433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6826","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6827","nonce":1592752433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6830","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6831","nonce":1592752433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6828","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6829","nonce":1592752433}]},"public_addr":"10.20.193.153:6825/1592752433","cluster_addr":"10.20.193.153:6827/1592752433","heartbeat_back_addr":"10.20.193.153:6831/1592752433","heartbeat_front_addr":"10.20.193.153:6829/1592752433","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:31.826317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:41.551881+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:50.391122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:59.141852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:08.326015+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:17.517921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:26.636353+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:35.670150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.104:0/2181220307":"2026-02-18T20:57:03.624371+0000","10.20.193.104:0/1441972685":"2026-02-18T20:57:03.624371+0000","10.20.193.104:0/1658112270":"2026-02-18T20:56:38.012869+0000","10.20.193.104:0/501037198":"2026-02-18T20:56:38.012869+0000","10.20.193.104:6801/3247908774":"2026-02-18T20:56:38.012869+0000","10.20.193.104:0/2902766949":"2026-02-18T20:56:38.012869+0000","10.20.193.104:0/1424534119":"2026-02-18T20:56:47.530062+0000","10.20.193.104:0/413298199":"2026-02-18T20:56:47.530062+0000","10.20.193.104:6800/95322277":"2026-02-18T20:56:47.530062+0000","10.20.193.104:0/1013639580":"2026-02-18T20:57:03.624371+0000","10.20.193.104:6801/1034073782":"2026-02-18T20:57:03.624371+0000","10.20.193.104:6800/3247908774":"2026-02-18T20:56:38.012869+0000","10.20.193.104:6801/95322277":"2026-02-18T20:56:47.530062+0000","10.20.193.104:0/1181662162":"2026-02-18T20:56:47.530062+0000","10.20.193.104:6800/1034073782":"2026-02-18T20:57:03.624371+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:58:50.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.418+0000 7f7dc077a640 1 -- 10.20.193.104:0/3351075982 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f7d94077550 msgr2=0x7f7d94079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:50.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.418+0000 7f7dc077a640 1 --2- 10.20.193.104:0/3351075982 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f7d94077550 0x7f7d94079a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7db8101d60 tx=0x7f7dac03a040 comp rx=0 tx=0).stop 2026-02-17T20:58:50.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.418+0000 7f7dc077a640 1 -- 10.20.193.104:0/3351075982 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7db8077620 msgr2=0x7f7db81a0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:50.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.418+0000 7f7dc077a640 1 --2- 10.20.193.104:0/3351075982 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7db8077620 0x7f7db81a0d70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7da800e990 tx=0x7f7da800ee60 comp rx=0 tx=0).stop 2026-02-17T20:58:50.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.418+0000 7f7dc077a640 1 -- 10.20.193.104:0/3351075982 shutdown_connections 2026-02-17T20:58:50.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.418+0000 7f7dc077a640 1 --2- 10.20.193.104:0/3351075982 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f7d94077550 0x7f7d94079a10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.418+0000 7f7dc077a640 1 --2- 10.20.193.104:0/3351075982 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7db8077f40 0x7f7db81a12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.418+0000 7f7dc077a640 1 --2- 10.20.193.104:0/3351075982 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f7db8077620 0x7f7db81a0d70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.421 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.418+0000 7f7dc077a640 1 -- 10.20.193.104:0/3351075982 >> 10.20.193.104:0/3351075982 conn(0x7f7db81005c0 msgr2=0x7f7db81009a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:50.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.418+0000 7f7dc077a640 1 -- 10.20.193.104:0/3351075982 shutdown_connections 2026-02-17T20:58:50.422 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.418+0000 7f7dc077a640 1 -- 10.20.193.104:0/3351075982 wait complete. 2026-02-17T20:58:50.458 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2026-02-17T20:58:47.017728+0000', 'modified': '2026-02-17T20:58:49.038287+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14522}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14522': {'gid': 14522, 'name': 'foo.trial104.gnmuyp', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '10.20.193.104:6835/743462196', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.104:6834', 'nonce': 743462196}, {'type': 'v1', 'addr': '10.20.193.104:6835', 'nonce': 743462196}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'foo', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 14522, 'qdb_cluster': [14522]} 2026-02-17T20:58:50.458 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2026-02-17T20:58:50.459 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph tell mds.foo.trial104.gnmuyp status 2026-02-17T20:58:50.652 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:50.757 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.753+0000 7f8cb9945640 1 -- 10.20.193.104:0/3549301844 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8cb41048c0 msgr2=0x7f8cb4104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:50.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.753+0000 7f8cb9945640 1 --2- 10.20.193.104:0/3549301844 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8cb41048c0 0x7f8cb4104d20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0099b0 tx=0x7f8c9c02f220 comp rx=0 tx=0).stop 2026-02-17T20:58:50.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.753+0000 7f8cb9945640 1 -- 10.20.193.104:0/3549301844 shutdown_connections 2026-02-17T20:58:50.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.753+0000 7f8cb9945640 1 --2- 10.20.193.104:0/3549301844 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8cb41048c0 0x7f8cb4104d20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.753+0000 7f8cb9945640 1 --2- 10.20.193.104:0/3549301844 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8cb410a8c0 0x7f8cb410aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.753+0000 7f8cb9945640 1 -- 10.20.193.104:0/3549301844 >> 10.20.193.104:0/3549301844 conn(0x7f8cb41005c0 msgr2=0x7f8cb41029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:50.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.753+0000 7f8cb9945640 1 -- 10.20.193.104:0/3549301844 shutdown_connections 2026-02-17T20:58:50.758 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.753+0000 7f8cb9945640 1 -- 10.20.193.104:0/3549301844 wait complete. 2026-02-17T20:58:50.759 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb9945640 1 Processor -- start 2026-02-17T20:58:50.759 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb9945640 1 -- start start 2026-02-17T20:58:50.759 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb9945640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8cb41048c0 0x7f8cb41a2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:50.759 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb9945640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8cb410a8c0 0x7f8cb41a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:50.759 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb9945640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb4111b60 con 0x7f8cb41048c0 2026-02-17T20:58:50.759 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb9945640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb41119e0 con 0x7f8cb410a8c0 2026-02-17T20:58:50.759 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb2ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8cb41048c0 0x7f8cb41a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:50.759 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb2ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8cb41048c0 0x7f8cb41a2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38356/0 (socket says 10.20.193.104:38356) 2026-02-17T20:58:50.759 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb2ffd640 1 -- 10.20.193.104:0/2343735777 learned_addr learned my addr 10.20.193.104:0/2343735777 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:50.759 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb27fc640 1 --2- 10.20.193.104:0/2343735777 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8cb410a8c0 0x7f8cb41a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:50.759 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb2ffd640 1 -- 10.20.193.104:0/2343735777 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8cb410a8c0 msgr2=0x7f8cb41a2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:50.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb2ffd640 1 --2- 10.20.193.104:0/2343735777 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8cb410a8c0 0x7f8cb41a2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb2ffd640 1 -- 10.20.193.104:0/2343735777 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb419c7c0 con 0x7f8cb41048c0 2026-02-17T20:58:50.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb2ffd640 1 --2- 10.20.193.104:0/2343735777 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8cb41048c0 0x7f8cb41a2640 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800b700 tx=0x7f8ca800bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:50.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb8943640 1 -- 10.20.193.104:0/2343735777 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8ca8004440 con 0x7f8cb41048c0 2026-02-17T20:58:50.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb8943640 1 -- 10.20.193.104:0/2343735777 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f8ca8010070 con 0x7f8cb41048c0 2026-02-17T20:58:50.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb9945640 1 -- 10.20.193.104:0/2343735777 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb419cab0 con 0x7f8cb41048c0 2026-02-17T20:58:50.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.754+0000 7f8cb8943640 1 -- 10.20.193.104:0/2343735777 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8ca800c9b0 con 0x7f8cb41048c0 2026-02-17T20:58:50.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.755+0000 7f8cb9945640 1 -- 10.20.193.104:0/2343735777 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb419d040 con 0x7f8cb41048c0 2026-02-17T20:58:50.760 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.756+0000 7f8cb8943640 1 -- 10.20.193.104:0/2343735777 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f8ca801d030 con 0x7f8cb41048c0 2026-02-17T20:58:50.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.756+0000 7f8cb8943640 1 --2- 10.20.193.104:0/2343735777 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f8c880775a0 0x7f8c88079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:50.769 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.756+0000 7f8cb8943640 1 -- 10.20.193.104:0/2343735777 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 7134+0+0 (secure 0 0 0) 0x7f8ca8098bd0 con 0x7f8cb41048c0 2026-02-17T20:58:50.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.756+0000 7f8cb27fc640 1 --2- 10.20.193.104:0/2343735777 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f8c880775a0 0x7f8c88079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:50.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.757+0000 7f8cb27fc640 1 --2- 10.20.193.104:0/2343735777 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f8c880775a0 0x7f8c88079a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8cb410a0b0 tx=0x7f8c9c03a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:50.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.757+0000 7f8cbbe4ae00 1 Processor -- start 2026-02-17T20:58:50.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.757+0000 7f8cbbe4ae00 1 -- start start 2026-02-17T20:58:50.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.757+0000 7f8cbbe4ae00 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b2e940 0x55b902b2ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:50.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.757+0000 7f8cbbe4ae00 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b2d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:50.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.757+0000 7f8cbbe4ae00 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x55b902aae120 con 0x55b902b2d4e0 2026-02-17T20:58:50.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.757+0000 7f8cbbe4ae00 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x55b902a80a40 con 0x55b902b2e940 2026-02-17T20:58:50.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.757+0000 7f8cb27fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b2d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:50.770 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.757+0000 7f8cb27fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b2d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38364/0 (socket says 10.20.193.104:38364) 2026-02-17T20:58:50.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.757+0000 7f8cb27fc640 1 -- 10.20.193.104:0/3956931539 learned_addr learned my addr 10.20.193.104:0/3956931539 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:50.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.757+0000 7f8cb2ffd640 1 --2- 10.20.193.104:0/3956931539 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b2e940 0x55b902b2ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:50.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.757+0000 7f8cb27fc640 1 -- 10.20.193.104:0/3956931539 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b2e940 msgr2=0x55b902b2ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:58:50.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.757+0000 7f8cb27fc640 1 --2- 10.20.193.104:0/3956931539 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b2e940 0x55b902b2ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.757+0000 7f8cb27fc640 1 -- 10.20.193.104:0/3956931539 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b902a364b0 con 0x55b902b2d4e0 2026-02-17T20:58:50.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.757+0000 7f8cb27fc640 1 --2- 10.20.193.104:0/3956931539 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b2d960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c002e80 tx=0x7f8c9c03e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421fc52bdf158b7f server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:50.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.758+0000 7f8c77fff640 1 -- 10.20.193.104:0/3956931539 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8c9c0385d0 con 0x55b902b2d4e0 2026-02-17T20:58:50.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.758+0000 7f8c77fff640 1 -- 10.20.193.104:0/3956931539 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f8c9c033040 con 0x55b902b2d4e0 2026-02-17T20:58:50.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.758+0000 7f8c77fff640 1 -- 10.20.193.104:0/3956931539 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8c9c04f820 con 0x55b902b2d4e0 2026-02-17T20:58:50.771 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.758+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/3956931539 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 msgr2=0x55b902b2d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.758+0000 7f8cbbe4ae00 1 --2- 10.20.193.104:0/3956931539 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b2d960 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c002e80 tx=0x7f8c9c03e000 comp rx=0 tx=0).stop 2026-02-17T20:58:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.758+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/3956931539 shutdown_connections 2026-02-17T20:58:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.758+0000 7f8cbbe4ae00 1 --2- 10.20.193.104:0/3956931539 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b2d960 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.758+0000 7f8cbbe4ae00 1 --2- 10.20.193.104:0/3956931539 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b2e940 0x55b902b2ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.758+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/3956931539 >> 10.20.193.104:0/3956931539 conn(0x55b902b24f40 msgr2=0x55b902b2bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.758+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/3956931539 shutdown_connections 2026-02-17T20:58:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.758+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/3956931539 wait complete. 2026-02-17T20:58:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8cbbe4ae00 1 -- start start 2026-02-17T20:58:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8cbbe4ae00 1 Processor -- start 2026-02-17T20:58:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8cbbe4ae00 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:50.772 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8cbbe4ae00 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b2e940 0x55b902b47a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:50.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8cbbe4ae00 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x55b902a2e250 con 0x55b902b2d4e0 2026-02-17T20:58:50.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8cbbe4ae00 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x55b902a28030 con 0x55b902b2e940 2026-02-17T20:58:50.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8cb2ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:50.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8cb2ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b474d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38374/0 (socket says 10.20.193.104:38374) 2026-02-17T20:58:50.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8cb2ffd640 1 -- 10.20.193.104:0/2974138397 learned_addr learned my addr 10.20.193.104:0/2974138397 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:50.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8cb27fc640 1 --2- 10.20.193.104:0/2974138397 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b2e940 0x55b902b47a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:50.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8cb2ffd640 1 -- 10.20.193.104:0/2974138397 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b2e940 msgr2=0x55b902b47a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:58:50.773 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8cb2ffd640 1 --2- 10.20.193.104:0/2974138397 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b2e940 0x55b902b47a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8cb2ffd640 1 -- 10.20.193.104:0/2974138397 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b902b3f190 con 0x55b902b2d4e0 2026-02-17T20:58:50.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8cb2ffd640 1 --2- 10.20.193.104:0/2974138397 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b474d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8061390 tx=0x7f8ca80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab210f85628289d1 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:50.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8c757fa640 10 client.0 ms_handle_connect on v2:10.20.193.104:3300/0 2026-02-17T20:58:50.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8c757fa640 1 -- 10.20.193.104:0/2974138397 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8ca807a030 con 0x55b902b2d4e0 2026-02-17T20:58:50.774 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8c757fa640 1 -- 10.20.193.104:0/2974138397 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f8ca8060410 con 0x55b902b2d4e0 2026-02-17T20:58:50.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8c757fa640 1 -- 10.20.193.104:0/2974138397 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8ca80600a0 con 0x55b902b2d4e0 2026-02-17T20:58:50.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2974138397 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b902851950 con 0x55b902b2d4e0 2026-02-17T20:58:50.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8c757fa640 1 -- 10.20.193.104:0/2974138397 <== mon.0 v2:10.20.193.104:3300/0 4 ==== osd_map(55..55 src has 1..55) ==== 7134+0+0 (secure 0 0 0) 0x7f8ca807b070 con 0x55b902b2d4e0 2026-02-17T20:58:50.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8c757fa640 10 client.14548 inactive, discarding osd_map(55..55 src has 1..55) 2026-02-17T20:58:50.775 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.759+0000 7f8cbbe4ae00 10 client.14548 _ll_register_callbacks cb 0x55b902a21a10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-17T20:58:50.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.760+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2974138397 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b902a88630 con 0x55b902b2d4e0 2026-02-17T20:58:50.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.760+0000 7f8c757fa640 1 -- 10.20.193.104:0/2974138397 <== mon.0 v2:10.20.193.104:3300/0 5 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f8ca807f070 con 0x55b902b2d4e0 2026-02-17T20:58:50.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.760+0000 7f8cbbe4ae00 10 client.14548 fetch_fsmap learned FSMap version 6 2026-02-17T20:58:50.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.760+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2974138397 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({fsmap=6}) -- 0x55b902a3b3a0 con 0x55b902b2d4e0 2026-02-17T20:58:50.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.760+0000 7f8c757fa640 1 -- 10.20.193.104:0/2974138397 <== mon.0 v2:10.20.193.104:3300/0 6 ==== fsmap(e 6) ==== 2966+0+0 (secure 0 0 0) 0x7f8ca8082020 con 0x55b902b2d4e0 2026-02-17T20:58:50.776 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.760+0000 7f8cbbe4ae00 10 client.14548 fetch_fsmap finished waiting for FSMap version 6 2026-02-17T20:58:50.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.760+0000 7f8cbbe4ae00 10 client.14548 resolve_mds: resolved name 'foo.trial104.gnmuyp' to daemon mds.foo.trial104.gnmuyp 2026-02-17T20:58:50.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.760+0000 7f8cbbe4ae00 20 client.14548 populate_metadata read hostname 'trial104' 2026-02-17T20:58:50.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.760+0000 7f8cbbe4ae00 1 --2- 10.20.193.104:0/2974138397 >> [v2:10.20.193.104:6834/743462196,v1:10.20.193.104:6835/743462196] conn(0x55b902b53df0 0x55b902b561e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:50.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.760+0000 7f8cbbe4ae00 4 client.14548 mds_command: new command op to 14522 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-17T20:58:50.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.760+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2974138397 --> [v2:10.20.193.104:6834/743462196,v1:10.20.193.104:6835/743462196] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b902a02bd0 con 0x55b902b53df0 2026-02-17T20:58:50.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.760+0000 7f8cb27fc640 1 --2- 10.20.193.104:0/2974138397 >> [v2:10.20.193.104:6834/743462196,v1:10.20.193.104:6835/743462196] conn(0x55b902b53df0 0x55b902b561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:50.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.760+0000 7f8cb27fc640 1 --2- 10.20.193.104:0/2974138397 >> [v2:10.20.193.104:6834/743462196,v1:10.20.193.104:6835/743462196] conn(0x55b902b53df0 0x55b902b561e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dae5ec23ee501f6e server_cookie=217f715ee5dac679 in_seq=0 out_seq=0 2026-02-17T20:58:50.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.760+0000 7f8c757fa640 10 client.14548 ms_handle_connect on v2:10.20.193.104:6834/743462196 2026-02-17T20:58:50.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.761+0000 7f8c757fa640 1 -- 10.20.193.104:0/2974138397 <== mds.0 v2:10.20.193.104:6834/743462196 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x55b902a02bd0 con 0x55b902b53df0 2026-02-17T20:58:50.777 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.761+0000 7f8c757fa640 10 client.14548 handle_command_reply: tid=0 2026-02-17T20:58:50.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.761+0000 7f8cbbe4ae00 1 client.14548 shutdown 2026-02-17T20:58:50.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.761+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2974138397 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 msgr2=0x55b902b474d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:50.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.761+0000 7f8cbbe4ae00 1 --2- 10.20.193.104:0/2974138397 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b474d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8061390 tx=0x7f8ca80047c0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.761+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2974138397 shutdown_connections 2026-02-17T20:58:50.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.761+0000 7f8cbbe4ae00 1 --2- 10.20.193.104:0/2974138397 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b2e940 0x55b902b47a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.778 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.761+0000 7f8cbbe4ae00 1 --2- 10.20.193.104:0/2974138397 >> [v2:10.20.193.104:6834/743462196,v1:10.20.193.104:6835/743462196] conn(0x55b902b53df0 0x55b902b561e0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.761+0000 7f8cbbe4ae00 1 --2- 10.20.193.104:0/2974138397 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b474d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.761+0000 7f8c757fa640 0 client.14548 ms_handle_reset on v2:10.20.193.104:6834/743462196 2026-02-17T20:58:50.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.761+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2974138397 >> 10.20.193.104:0/2974138397 conn(0x55b902b24f40 msgr2=0x55b902b316f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:50.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.761+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2974138397 shutdown_connections 2026-02-17T20:58:50.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.761+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2974138397 wait complete. 2026-02-17T20:58:50.779 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.761+0000 7f8cbbe4ae00 20 client.14548 trim_cache size 0 max 16384 2026-02-17T20:58:50.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.770+0000 7f8cbbe4ae00 1 Processor -- start 2026-02-17T20:58:50.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.770+0000 7f8cbbe4ae00 1 -- start start 2026-02-17T20:58:50.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.770+0000 7f8cbbe4ae00 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b24f40 0x55b902b474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:50.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.770+0000 7f8cbbe4ae00 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b44a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:50.785 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.770+0000 7f8cbbe4ae00 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5800c970 con 0x55b902b2d4e0 2026-02-17T20:58:50.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.770+0000 7f8cbbe4ae00 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f8c5800d970 con 0x55b902b24f40 2026-02-17T20:58:50.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.770+0000 7f8cb27fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b44a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:50.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.770+0000 7f8cb27fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b44a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38386/0 (socket says 10.20.193.104:38386) 2026-02-17T20:58:50.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.770+0000 7f8cb27fc640 1 -- 10.20.193.104:0/2971526414 learned_addr learned my addr 10.20.193.104:0/2971526414 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:50.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.770+0000 7f8cb27fc640 1 -- 10.20.193.104:0/2971526414 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b24f40 msgr2=0x55b902b474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:58:50.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.770+0000 7f8cb27fc640 1 --2- 10.20.193.104:0/2971526414 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b24f40 0x55b902b474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.770+0000 7f8cb27fc640 1 -- 10.20.193.104:0/2971526414 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b902b3efc0 con 0x55b902b2d4e0 2026-02-17T20:58:50.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.770+0000 7f8cb27fc640 1 --2- 10.20.193.104:0/2971526414 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b44a10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c002e80 tx=0x7f8c9c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439f6e9ba1b0d769 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:50.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.771+0000 7f8c777fe640 1 -- 10.20.193.104:0/2971526414 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8c9c0045e0 con 0x55b902b2d4e0 2026-02-17T20:58:50.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.771+0000 7f8c777fe640 1 -- 10.20.193.104:0/2971526414 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f8c9c004d10 con 0x55b902b2d4e0 2026-02-17T20:58:50.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.771+0000 7f8c777fe640 1 -- 10.20.193.104:0/2971526414 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8c9c0385d0 con 0x55b902b2d4e0 2026-02-17T20:58:50.786 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.771+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2971526414 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 msgr2=0x55b902b44a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:50.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.771+0000 7f8cbbe4ae00 1 --2- 10.20.193.104:0/2971526414 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b44a10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c002e80 tx=0x7f8c9c009780 comp rx=0 tx=0).stop 2026-02-17T20:58:50.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.771+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2971526414 shutdown_connections 2026-02-17T20:58:50.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.771+0000 7f8cbbe4ae00 1 --2- 10.20.193.104:0/2971526414 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902b44a10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.771+0000 7f8cbbe4ae00 1 --2- 10.20.193.104:0/2971526414 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b24f40 0x55b902b474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.771+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2971526414 >> 10.20.193.104:0/2971526414 conn(0x55b902b439b0 msgr2=0x55b902b44300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:50.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.771+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2971526414 shutdown_connections 2026-02-17T20:58:50.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.771+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2971526414 wait complete. 2026-02-17T20:58:50.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.771+0000 7f8cbbe4ae00 1 -- start start 2026-02-17T20:58:50.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cbbe4ae00 1 Processor -- start 2026-02-17T20:58:50.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cbbe4ae00 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b24f40 0x55b902bb6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:50.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cbbe4ae00 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902bb7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:50.787 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cbbe4ae00 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x55b902b525c0 con 0x55b902b2d4e0 2026-02-17T20:58:50.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cbbe4ae00 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x55b90286ed60 con 0x55b902b24f40 2026-02-17T20:58:50.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cb27fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902bb7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:50.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cb27fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902bb7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38394/0 (socket says 10.20.193.104:38394) 2026-02-17T20:58:50.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cb27fc640 1 -- 10.20.193.104:0/2469312321 learned_addr learned my addr 10.20.193.104:0/2469312321 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:50.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cb2ffd640 1 --2- 10.20.193.104:0/2469312321 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b24f40 0x55b902bb6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:50.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cb27fc640 1 -- 10.20.193.104:0/2469312321 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b24f40 msgr2=0x55b902bb6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:58:50.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cb27fc640 1 --2- 10.20.193.104:0/2469312321 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b24f40 0x55b902bb6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cb27fc640 1 -- 10.20.193.104:0/2469312321 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b90275f680 con 0x55b902b2d4e0 2026-02-17T20:58:50.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cb27fc640 1 --2- 10.20.193.104:0/2469312321 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902bb7000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c02f730 tx=0x7f8c9c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdee894a97648ff server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:50.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8c757fa640 10 client.0 ms_handle_connect on v2:10.20.193.104:3300/0 2026-02-17T20:58:50.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8c757fa640 1 -- 10.20.193.104:0/2469312321 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8c9c0385d0 con 0x55b902b2d4e0 2026-02-17T20:58:50.788 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8c757fa640 1 -- 10.20.193.104:0/2469312321 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f8c9c038be0 con 0x55b902b2d4e0 2026-02-17T20:58:50.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8c757fa640 1 -- 10.20.193.104:0/2469312321 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f8c9c005620 con 0x55b902b2d4e0 2026-02-17T20:58:50.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2469312321 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b902a20450 con 0x55b902b2d4e0 2026-02-17T20:58:50.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8c757fa640 1 -- 10.20.193.104:0/2469312321 <== mon.0 v2:10.20.193.104:3300/0 4 ==== osd_map(55..55 src has 1..55) ==== 7134+0+0 (secure 0 0 0) 0x7f8c9c067070 con 0x55b902b2d4e0 2026-02-17T20:58:50.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8c757fa640 10 client.14552 inactive, discarding osd_map(55..55 src has 1..55) 2026-02-17T20:58:50.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cbbe4ae00 10 client.14552 _ll_register_callbacks cb 0x7f8ca80611d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-17T20:58:50.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2469312321 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c9c033040 con 0x55b902b2d4e0 2026-02-17T20:58:50.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8c757fa640 1 -- 10.20.193.104:0/2469312321 <== mon.0 v2:10.20.193.104:3300/0 5 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f8c9c038d90 con 0x55b902b2d4e0 2026-02-17T20:58:50.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cbbe4ae00 10 client.14552 fetch_fsmap learned FSMap version 6 2026-02-17T20:58:50.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.772+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2469312321 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({fsmap=6}) -- 0x55b902b3fcb0 con 0x55b902b2d4e0 2026-02-17T20:58:50.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8c757fa640 1 -- 10.20.193.104:0/2469312321 <== mon.0 v2:10.20.193.104:3300/0 6 ==== fsmap(e 6) ==== 2966+0+0 (secure 0 0 0) 0x7f8c9c060030 con 0x55b902b2d4e0 2026-02-17T20:58:50.789 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cbbe4ae00 10 client.14552 fetch_fsmap finished waiting for FSMap version 6 2026-02-17T20:58:50.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cbbe4ae00 10 client.14552 resolve_mds: resolved name 'foo.trial104.gnmuyp' to daemon mds.foo.trial104.gnmuyp 2026-02-17T20:58:50.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cbbe4ae00 20 client.14552 populate_metadata read hostname 'trial104' 2026-02-17T20:58:50.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cbbe4ae00 1 --2- 10.20.193.104:0/2469312321 >> [v2:10.20.193.104:6834/743462196,v1:10.20.193.104:6835/743462196] conn(0x55b902b2e940 0x55b902bc2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:50.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cbbe4ae00 4 client.14552 mds_command: new command op to 14522 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-17T20:58:50.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2469312321 --> [v2:10.20.193.104:6834/743462196,v1:10.20.193.104:6835/743462196] -- command(tid 0: {"prefix": "status"}) -- 0x55b9027f07a0 con 0x55b902b2e940 2026-02-17T20:58:50.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cb2ffd640 1 --2- 10.20.193.104:0/2469312321 >> [v2:10.20.193.104:6834/743462196,v1:10.20.193.104:6835/743462196] conn(0x55b902b2e940 0x55b902bc2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:50.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8c757fa640 10 client.14552 ms_handle_connect on v2:10.20.193.104:6834/743462196 2026-02-17T20:58:50.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cb2ffd640 1 --2- 10.20.193.104:0/2469312321 >> [v2:10.20.193.104:6834/743462196,v1:10.20.193.104:6835/743462196] conn(0x55b902b2e940 0x55b902bc2c30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=320f698edb7966fc server_cookie=f9c76a63bf19bf41 in_seq=0 out_seq=0 2026-02-17T20:58:50.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8c757fa640 1 -- 10.20.193.104:0/2469312321 <== mds.0 v2:10.20.193.104:6834/743462196 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x55b9027f07a0 con 0x55b902b2e940 2026-02-17T20:58:50.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8c757fa640 10 client.14552 handle_command_reply: tid=0 2026-02-17T20:58:50.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cbbe4ae00 1 client.14552 shutdown 2026-02-17T20:58:50.790 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2469312321 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 msgr2=0x55b902bb7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:50.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cbbe4ae00 1 --2- 10.20.193.104:0/2469312321 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902bb7000 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c02f730 tx=0x7f8c9c004610 comp rx=0 tx=0).stop 2026-02-17T20:58:50.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2469312321 shutdown_connections 2026-02-17T20:58:50.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cbbe4ae00 1 --2- 10.20.193.104:0/2469312321 >> [v2:10.20.193.104:6834/743462196,v1:10.20.193.104:6835/743462196] conn(0x55b902b2e940 0x55b902bc2c30 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cbbe4ae00 1 --2- 10.20.193.104:0/2469312321 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x55b902b2d4e0 0x55b902bb7000 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8c757fa640 0 client.14552 ms_handle_reset on v2:10.20.193.104:6834/743462196 2026-02-17T20:58:50.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cbbe4ae00 1 --2- 10.20.193.104:0/2469312321 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x55b902b24f40 0x55b902bb6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2469312321 >> 10.20.193.104:0/2469312321 conn(0x55b902b439b0 msgr2=0x55b902b44b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:50.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2469312321 shutdown_connections 2026-02-17T20:58:50.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cbbe4ae00 1 -- 10.20.193.104:0/2469312321 wait complete. 2026-02-17T20:58:50.791 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cbbe4ae00 20 client.14552 trim_cache size 0 max 16384 2026-02-17T20:58:50.792 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-17T20:58:50.792 INFO:teuthology.orchestra.run.trial104.stdout: "cluster_fsid": "19072504-0c43-11f1-93a3-d404e6e7d460", 2026-02-17T20:58:50.792 INFO:teuthology.orchestra.run.trial104.stdout: "whoami": 0, 2026-02-17T20:58:50.792 INFO:teuthology.orchestra.run.trial104.stdout: "id": 14522, 2026-02-17T20:58:50.792 INFO:teuthology.orchestra.run.trial104.stdout: "want_state": "up:active", 2026-02-17T20:58:50.792 INFO:teuthology.orchestra.run.trial104.stdout: "state": "up:active", 2026-02-17T20:58:50.792 INFO:teuthology.orchestra.run.trial104.stdout: "fs_name": "foo", 2026-02-17T20:58:50.792 INFO:teuthology.orchestra.run.trial104.stdout: "rank_uptime": 2.7336884170000002, 2026-02-17T20:58:50.792 INFO:teuthology.orchestra.run.trial104.stdout: "mdsmap_epoch": 5, 2026-02-17T20:58:50.793 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap_epoch": 55, 2026-02-17T20:58:50.793 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap_epoch_barrier": 53, 2026-02-17T20:58:50.793 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 3.05478607 2026-02-17T20:58:50.793 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-17T20:58:50.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cb9945640 1 -- 10.20.193.104:0/2343735777 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f8c880775a0 msgr2=0x7f8c88079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:50.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cb9945640 1 --2- 10.20.193.104:0/2343735777 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f8c880775a0 0x7f8c88079a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8cb410a0b0 tx=0x7f8c9c03a040 comp rx=0 tx=0).stop 2026-02-17T20:58:50.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cb9945640 1 -- 10.20.193.104:0/2343735777 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8cb41048c0 msgr2=0x7f8cb41a2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:50.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.773+0000 7f8cb9945640 1 --2- 10.20.193.104:0/2343735777 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8cb41048c0 0x7f8cb41a2640 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f8ca800b700 tx=0x7f8ca800bbd0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.774+0000 7f8cb9945640 1 -- 10.20.193.104:0/2343735777 shutdown_connections 2026-02-17T20:58:50.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.774+0000 7f8cb9945640 1 --2- 10.20.193.104:0/2343735777 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f8c880775a0 0x7f8c88079a60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.774+0000 7f8cb9945640 1 --2- 10.20.193.104:0/2343735777 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f8cb410a8c0 0x7f8cb41a2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.774+0000 7f8cb9945640 1 --2- 10.20.193.104:0/2343735777 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f8cb41048c0 0x7f8cb41a2640 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:50.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.774+0000 7f8cb9945640 1 -- 10.20.193.104:0/2343735777 >> 10.20.193.104:0/2343735777 conn(0x7f8cb41005c0 msgr2=0x7f8cb4101740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:50.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.774+0000 7f8cb9945640 1 -- 10.20.193.104:0/2343735777 shutdown_connections 2026-02-17T20:58:50.794 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:50.774+0000 7f8cb9945640 1 -- 10.20.193.104:0/2343735777 wait complete. 2026-02-17T20:58:50.809 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph fs dump --format=json 2026-02-17T20:58:50.965 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:51.072 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.068+0000 7ff1a470d640 1 -- 10.20.193.104:0/1304356054 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff19c10a8b0 msgr2=0x7ff19c10ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:51.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.068+0000 7ff1a470d640 1 --2- 10.20.193.104:0/1304356054 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff19c10a8b0 0x7ff19c10ac90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0099b0 tx=0x7ff18c02f220 comp rx=0 tx=0).stop 2026-02-17T20:58:51.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.068+0000 7ff1a470d640 1 -- 10.20.193.104:0/1304356054 shutdown_connections 2026-02-17T20:58:51.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.068+0000 7ff1a470d640 1 --2- 10.20.193.104:0/1304356054 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff19c1048b0 0x7ff19c104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:51.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.068+0000 7ff1a470d640 1 --2- 10.20.193.104:0/1304356054 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff19c10a8b0 0x7ff19c10ac90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:51.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.068+0000 7ff1a470d640 1 -- 10.20.193.104:0/1304356054 >> 10.20.193.104:0/1304356054 conn(0x7ff19c100590 msgr2=0x7ff19c1029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:51.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.068+0000 7ff1a470d640 1 -- 10.20.193.104:0/1304356054 shutdown_connections 2026-02-17T20:58:51.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.068+0000 7ff1a470d640 1 -- 10.20.193.104:0/1304356054 wait complete. 2026-02-17T20:58:51.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1a470d640 1 Processor -- start 2026-02-17T20:58:51.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1a470d640 1 -- start start 2026-02-17T20:58:51.073 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1a470d640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff19c1048b0 0x7ff19c1a2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:51.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1a470d640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff19c10a8b0 0x7ff19c1a2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:51.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1a470d640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c111ad0 con 0x7ff19c1048b0 2026-02-17T20:58:51.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1a470d640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c111950 con 0x7ff19c10a8b0 2026-02-17T20:58:51.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1a2482640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff19c1048b0 0x7ff19c1a2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:51.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1a2482640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff19c1048b0 0x7ff19c1a2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38406/0 (socket says 10.20.193.104:38406) 2026-02-17T20:58:51.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1a2482640 1 -- 10.20.193.104:0/274993052 learned_addr learned my addr 10.20.193.104:0/274993052 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:51.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1a1c81640 1 --2- 10.20.193.104:0/274993052 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff19c10a8b0 0x7ff19c1a2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:51.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1a2482640 1 -- 10.20.193.104:0/274993052 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff19c10a8b0 msgr2=0x7ff19c1a2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:51.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1a2482640 1 --2- 10.20.193.104:0/274993052 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff19c10a8b0 0x7ff19c1a2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:51.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1a2482640 1 -- 10.20.193.104:0/274993052 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff19c19c600 con 0x7ff19c1048b0 2026-02-17T20:58:51.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1a2482640 1 --2- 10.20.193.104:0/274993052 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff19c1048b0 0x7ff19c1a2440 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009980 tx=0x7ff18c02fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:51.074 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1837fe640 1 -- 10.20.193.104:0/274993052 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7ff18c004420 con 0x7ff19c1048b0 2026-02-17T20:58:51.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1837fe640 1 -- 10.20.193.104:0/274993052 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7ff18c038a40 con 0x7ff19c1048b0 2026-02-17T20:58:51.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1a470d640 1 -- 10.20.193.104:0/274993052 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff19c19c890 con 0x7ff19c1048b0 2026-02-17T20:58:51.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1837fe640 1 -- 10.20.193.104:0/274993052 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7ff18c0417e0 con 0x7ff19c1048b0 2026-02-17T20:58:51.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.069+0000 7ff1a470d640 1 -- 10.20.193.104:0/274993052 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff19c19cdc0 con 0x7ff19c1048b0 2026-02-17T20:58:51.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.070+0000 7ff1a470d640 1 -- 10.20.193.104:0/274993052 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff19c105ff0 con 0x7ff19c1048b0 2026-02-17T20:58:51.075 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.070+0000 7ff1837fe640 1 -- 10.20.193.104:0/274993052 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7ff18c038bf0 con 0x7ff19c1048b0 2026-02-17T20:58:51.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.071+0000 7ff1837fe640 1 --2- 10.20.193.104:0/274993052 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7ff1780775a0 0x7ff178079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:51.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.071+0000 7ff1a1c81640 1 --2- 10.20.193.104:0/274993052 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7ff1780775a0 0x7ff178079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:51.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.071+0000 7ff1837fe640 1 -- 10.20.193.104:0/274993052 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 7220+0+0 (secure 0 0 0) 0x7ff18c03e070 con 0x7ff19c1048b0 2026-02-17T20:58:51.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.071+0000 7ff1a1c81640 1 --2- 10.20.193.104:0/274993052 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7ff1780775a0 0x7ff178079a60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff19c10b8e0 tx=0x7ff190005f50 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:51.076 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.072+0000 7ff1837fe640 1 -- 10.20.193.104:0/274993052 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7ff18c08b7d0 con 0x7ff19c1048b0 2026-02-17T20:58:51.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.176+0000 7ff1a470d640 1 -- 10.20.193.104:0/274993052 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff19c19db60 con 0x7ff19c1048b0 2026-02-17T20:58:51.178 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.176+0000 7ff1837fe640 1 -- 10.20.193.104:0/274993052 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5760 (secure 0 0 0) 0x7ff19c19db60 con 0x7ff19c1048b0 2026-02-17T20:58:51.178 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:51.179 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":8,"btime":"2026-02-17T20:58:51:049753+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14536,"name":"bar.trial104.jdjykv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.104:6837/347975304","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6836","nonce":347975304},{"type":"v1","addr":"10.20.193.104:6837","nonce":347975304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-17T20:58:47.017728+0000","modified":"2026-02-17T20:58:49.038287+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14522":{"gid":14522,"name":"foo.trial104.gnmuyp","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"10.20.193.104:6835/743462196","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6834","nonce":743462196},{"type":"v1","addr":"10.20.193.104:6835","nonce":743462196}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14522,"qdb_cluster":[14522]},"id":1},{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-17T20:58:49.029526+0000","modified":"2026-02-17T20:58:51.049750+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24351":{"gid":24351,"name":"bar.trial153.cedikz","rank":0,"incarnation":8,"state":"up:replay","state_seq":1,"addr":"10.20.193.153:6835/3684943307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6834","nonce":3684943307},{"type":"v1","addr":"10.20.193.153:6835","nonce":3684943307}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2026-02-17T20:58:51.179 INFO:teuthology.orchestra.run.trial104.stderr:dumped fsmap epoch 8 2026-02-17T20:58:51.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.178+0000 7ff1a470d640 1 -- 10.20.193.104:0/274993052 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7ff1780775a0 msgr2=0x7ff178079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:51.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.178+0000 7ff1a470d640 1 --2- 10.20.193.104:0/274993052 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7ff1780775a0 0x7ff178079a60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff19c10b8e0 tx=0x7ff190005f50 comp rx=0 tx=0).stop 2026-02-17T20:58:51.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.178+0000 7ff1a470d640 1 -- 10.20.193.104:0/274993052 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff19c1048b0 msgr2=0x7ff19c1a2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:51.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.178+0000 7ff1a470d640 1 --2- 10.20.193.104:0/274993052 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff19c1048b0 0x7ff19c1a2440 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff18c009980 tx=0x7ff18c02fdf0 comp rx=0 tx=0).stop 2026-02-17T20:58:51.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.178+0000 7ff1a470d640 1 -- 10.20.193.104:0/274993052 shutdown_connections 2026-02-17T20:58:51.180 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.178+0000 7ff1a470d640 1 --2- 10.20.193.104:0/274993052 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7ff1780775a0 0x7ff178079a60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:51.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.178+0000 7ff1a470d640 1 --2- 10.20.193.104:0/274993052 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7ff19c10a8b0 0x7ff19c1a2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:51.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.178+0000 7ff1a470d640 1 --2- 10.20.193.104:0/274993052 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7ff19c1048b0 0x7ff19c1a2440 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:51.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.178+0000 7ff1a470d640 1 -- 10.20.193.104:0/274993052 >> 10.20.193.104:0/274993052 conn(0x7ff19c100590 msgr2=0x7ff19c102740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:51.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.178+0000 7ff1a470d640 1 -- 10.20.193.104:0/274993052 shutdown_connections 2026-02-17T20:58:51.181 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.178+0000 7ff1a470d640 1 -- 10.20.193.104:0/274993052 wait complete. 2026-02-17T20:58:51.216 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd dump --format=json 2026-02-17T20:58:51.238 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: osdmap e55: 8 total, 8 up, 8 in 2026-02-17T20:58:51.238 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: mds.? [v2:10.20.193.153:6832/3911303877,v1:10.20.193.153:6833/3911303877] up:active 2026-02-17T20:58:51.238 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: fsmap foo:1 bar:1 {bar:0=foo.trial153.jtthho=up:active,foo:0=foo.trial104.gnmuyp=up:active} 2026-02-17T20:58:51.238 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.238 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.239 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.239 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.bar.trial153.cedikz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-17T20:58:51.239 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.239 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.trial153.cedikz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-17T20:58:51.239 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:51.239 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: Deploying daemon mds.bar.trial153.cedikz on trial153 2026-02-17T20:58:51.239 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3351075982' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T20:58:51.239 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.239 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.239 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.239 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.240 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.240 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:51 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:51.380 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:51.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.493+0000 7f0444b7c640 1 -- 10.20.193.104:0/447956851 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f04401048c0 msgr2=0x7f0440104d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:51.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.493+0000 7f0444b7c640 1 --2- 10.20.193.104:0/447956851 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f04401048c0 0x7f0440104d20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f04280098e0 tx=0x7f042802f1d0 comp rx=0 tx=0).stop 2026-02-17T20:58:51.497 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.493+0000 7f0444b7c640 1 -- 10.20.193.104:0/447956851 shutdown_connections 2026-02-17T20:58:51.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.493+0000 7f0444b7c640 1 --2- 10.20.193.104:0/447956851 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f04401048c0 0x7f0440104d20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:51.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.493+0000 7f0444b7c640 1 --2- 10.20.193.104:0/447956851 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f044010a8c0 0x7f044010aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:51.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.493+0000 7f0444b7c640 1 -- 10.20.193.104:0/447956851 >> 10.20.193.104:0/447956851 conn(0x7f04401005c0 msgr2=0x7f04401029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:51.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.493+0000 7f0444b7c640 1 -- 10.20.193.104:0/447956851 shutdown_connections 2026-02-17T20:58:51.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.493+0000 7f0444b7c640 1 -- 10.20.193.104:0/447956851 wait complete. 2026-02-17T20:58:51.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.494+0000 7f0444b7c640 1 Processor -- start 2026-02-17T20:58:51.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.494+0000 7f0444b7c640 1 -- start start 2026-02-17T20:58:51.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.494+0000 7f0444b7c640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f04401048c0 0x7f04401a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:51.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.494+0000 7f0444b7c640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f044010a8c0 0x7f04401a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:51.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.494+0000 7f0444b7c640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0440111b00 con 0x7f044010a8c0 2026-02-17T20:58:51.498 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.494+0000 7f0444b7c640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0440111980 con 0x7f04401048c0 2026-02-17T20:58:51.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.494+0000 7f043dd74640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f044010a8c0 0x7f04401a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:51.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.494+0000 7f043dd74640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f044010a8c0 0x7f04401a2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38432/0 (socket says 10.20.193.104:38432) 2026-02-17T20:58:51.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.494+0000 7f043dd74640 1 -- 10.20.193.104:0/2278803632 learned_addr learned my addr 10.20.193.104:0/2278803632 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:51.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.495+0000 7f043e575640 1 --2- 10.20.193.104:0/2278803632 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f04401048c0 0x7f04401a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:51.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.495+0000 7f043dd74640 1 -- 10.20.193.104:0/2278803632 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f04401048c0 msgr2=0x7f04401a25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:51.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.495+0000 7f043dd74640 1 --2- 10.20.193.104:0/2278803632 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f04401048c0 0x7f04401a25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:51.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.495+0000 7f043dd74640 1 -- 10.20.193.104:0/2278803632 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044019c690 con 0x7f044010a8c0 2026-02-17T20:58:51.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.495+0000 7f043dd74640 1 --2- 10.20.193.104:0/2278803632 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f044010a8c0 0x7f04401a2b00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f04280098b0 tx=0x7f0428004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:51.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.495+0000 7f04277fe640 1 -- 10.20.193.104:0/2278803632 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0428046070 con 0x7f044010a8c0 2026-02-17T20:58:51.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.495+0000 7f0444b7c640 1 -- 10.20.193.104:0/2278803632 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044019c920 con 0x7f044010a8c0 2026-02-17T20:58:51.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.495+0000 7f04277fe640 1 -- 10.20.193.104:0/2278803632 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f0428002bf0 con 0x7f044010a8c0 2026-02-17T20:58:51.499 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.495+0000 7f04277fe640 1 -- 10.20.193.104:0/2278803632 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0428041630 con 0x7f044010a8c0 2026-02-17T20:58:51.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.495+0000 7f0444b7c640 1 -- 10.20.193.104:0/2278803632 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f044019ce20 con 0x7f044010a8c0 2026-02-17T20:58:51.500 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.495+0000 7f0444b7c640 1 -- 10.20.193.104:0/2278803632 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0440106000 con 0x7f044010a8c0 2026-02-17T20:58:51.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.496+0000 7f04277fe640 1 -- 10.20.193.104:0/2278803632 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f0428038510 con 0x7f044010a8c0 2026-02-17T20:58:51.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.496+0000 7f04277fe640 1 --2- 10.20.193.104:0/2278803632 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0418077550 0x7f0418079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:51.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.496+0000 7f04277fe640 1 -- 10.20.193.104:0/2278803632 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 7220+0+0 (secure 0 0 0) 0x7f042803e070 con 0x7f044010a8c0 2026-02-17T20:58:51.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.496+0000 7f043e575640 1 --2- 10.20.193.104:0/2278803632 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0418077550 0x7f0418079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:51.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.497+0000 7f043e575640 1 --2- 10.20.193.104:0/2278803632 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0418077550 0x7f0418079a10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0434004680 tx=0x7f0434009340 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:51.501 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.498+0000 7f04277fe640 1 -- 10.20.193.104:0/2278803632 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f042808b190 con 0x7f044010a8c0 2026-02-17T20:58:51.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: osdmap e55: 8 total, 8 up, 8 in 2026-02-17T20:58:51.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: mds.? [v2:10.20.193.153:6832/3911303877,v1:10.20.193.153:6833/3911303877] up:active 2026-02-17T20:58:51.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: fsmap foo:1 bar:1 {bar:0=foo.trial153.jtthho=up:active,foo:0=foo.trial104.gnmuyp=up:active} 2026-02-17T20:58:51.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get-or-create", "entity": "mds.bar.trial153.cedikz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2026-02-17T20:58:51.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "auth get-or-create", "entity": "mds.bar.trial153.cedikz", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-17T20:58:51.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:51.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: Deploying daemon mds.bar.trial153.cedikz on trial153 2026-02-17T20:58:51.526 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/3351075982' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T20:58:51.526 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.526 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.526 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.526 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.526 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:51.526 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:51 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:51.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.582+0000 7f0444b7c640 1 -- 10.20.193.104:0/2278803632 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f044019d0d0 con 0x7f044010a8c0 2026-02-17T20:58:51.585 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.583+0000 7f04277fe640 1 -- 10.20.193.104:0/2278803632 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+21527 (secure 0 0 0) 0x7f0428090040 con 0x7f044010a8c0 2026-02-17T20:58:51.586 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:51.586 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":57,"fsid":"19072504-0c43-11f1-93a3-d404e6e7d460","created":"2026-02-17T20:56:28.383257+0000","modified":"2026-02-17T20:58:51.049660+0000","last_up_change":"2026-02-17T20:58:36.991631+0000","last_in_change":"2026-02-17T20:58:24.285994+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-17T20:57:51.660976+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":7.8899998664855957,"score_stable":7.8899998664855957,"optimal_score":0.37999999523162842,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.foo.meta","create_time":"2026-02-17T20:58:45.732318+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"foo"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.foo.data","create_time":"2026-02-17T20:58:46.020886+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"foo"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs.bar.meta","create_time":"2026-02-17T20:58:47.427175+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"bar"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs.bar.data","create_time":"2026-02-17T20:58:48.028767+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"bar"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a22ae774-55bf-4c61-9328-96f1ad2a6a62","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6802","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6803","nonce":438222704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6804","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6805","nonce":438222704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6808","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6809","nonce":438222704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6806","nonce":438222704},{"type":"v1","addr":"10.20.193.104:6807","nonce":438222704}]},"public_addr":"10.20.193.104:6803/438222704","cluster_addr":"10.20.193.104:6805/438222704","heartbeat_back_addr":"10.20.193.104:6809/438222704","heartbeat_front_addr":"10.20.193.104:6807/438222704","state":["exists","up"]},{"osd":1,"uuid":"e221e89a-fd48-4e6f-a73d-a109718c9b7a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6810","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6811","nonce":1955490859}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6812","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6813","nonce":1955490859}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6816","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6817","nonce":1955490859}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6814","nonce":1955490859},{"type":"v1","addr":"10.20.193.104:6815","nonce":1955490859}]},"public_addr":"10.20.193.104:6811/1955490859","cluster_addr":"10.20.193.104:6813/1955490859","heartbeat_back_addr":"10.20.193.104:6817/1955490859","heartbeat_front_addr":"10.20.193.104:6815/1955490859","state":["exists","up"]},{"osd":2,"uuid":"e0266db8-19cd-4ddb-a96a-cb84d2b0c4c6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6818","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6819","nonce":3131863919}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6820","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6821","nonce":3131863919}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6824","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6825","nonce":3131863919}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6822","nonce":3131863919},{"type":"v1","addr":"10.20.193.104:6823","nonce":3131863919}]},"public_addr":"10.20.193.104:6819/3131863919","cluster_addr":"10.20.193.104:6821/3131863919","heartbeat_back_addr":"10.20.193.104:6825/3131863919","heartbeat_front_addr":"10.20.193.104:6823/3131863919","state":["exists","up"]},{"osd":3,"uuid":"3b10ab50-7d78-4eea-b768-34534959a99d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6826","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6827","nonce":1948872135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6828","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6829","nonce":1948872135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6832","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6833","nonce":1948872135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6830","nonce":1948872135},{"type":"v1","addr":"10.20.193.104:6831","nonce":1948872135}]},"public_addr":"10.20.193.104:6827/1948872135","cluster_addr":"10.20.193.104:6829/1948872135","heartbeat_back_addr":"10.20.193.104:6833/1948872135","heartbeat_front_addr":"10.20.193.104:6831/1948872135","state":["exists","up"]},{"osd":4,"uuid":"d713875a-a825-474b-9ea5-cf8935174190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6800","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6801","nonce":250110565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6802","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6803","nonce":250110565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6806","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6807","nonce":250110565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6804","nonce":250110565},{"type":"v1","addr":"10.20.193.153:6805","nonce":250110565}]},"public_addr":"10.20.193.153:6801/250110565","cluster_addr":"10.20.193.153:6803/250110565","heartbeat_back_addr":"10.20.193.153:6807/250110565","heartbeat_front_addr":"10.20.193.153:6805/250110565","state":["exists","up"]},{"osd":5,"uuid":"65f4195f-0129-41e5-931f-4b0a53ee6868","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6808","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6809","nonce":2951447967}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6810","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6811","nonce":2951447967}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6814","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6815","nonce":2951447967}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6812","nonce":2951447967},{"type":"v1","addr":"10.20.193.153:6813","nonce":2951447967}]},"public_addr":"10.20.193.153:6809/2951447967","cluster_addr":"10.20.193.153:6811/2951447967","heartbeat_back_addr":"10.20.193.153:6815/2951447967","heartbeat_front_addr":"10.20.193.153:6813/2951447967","state":["exists","up"]},{"osd":6,"uuid":"070da905-eb86-4405-a53f-fc3414a1ca70","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6816","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6817","nonce":4066146238}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6818","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6819","nonce":4066146238}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6822","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6823","nonce":4066146238}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6820","nonce":4066146238},{"type":"v1","addr":"10.20.193.153:6821","nonce":4066146238}]},"public_addr":"10.20.193.153:6817/4066146238","cluster_addr":"10.20.193.153:6819/4066146238","heartbeat_back_addr":"10.20.193.153:6823/4066146238","heartbeat_front_addr":"10.20.193.153:6821/4066146238","state":["exists","up"]},{"osd":7,"uuid":"25d0a88d-9c35-4a39-809f-7adfc0833bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6824","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6825","nonce":1592752433}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6826","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6827","nonce":1592752433}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6830","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6831","nonce":1592752433}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6828","nonce":1592752433},{"type":"v1","addr":"10.20.193.153:6829","nonce":1592752433}]},"public_addr":"10.20.193.153:6825/1592752433","cluster_addr":"10.20.193.153:6827/1592752433","heartbeat_back_addr":"10.20.193.153:6831/1592752433","heartbeat_front_addr":"10.20.193.153:6829/1592752433","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:31.826317+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:41.551881+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:50.391122+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:57:59.141852+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:08.326015+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:17.517921+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:26.636353+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2026-02-17T20:58:35.670150+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.153:6832/3911303877":"2026-02-18T20:58:51.049644+0000","10.20.193.153:6833/3911303877":"2026-02-18T20:58:51.049644+0000","10.20.193.104:0/2181220307":"2026-02-18T20:57:03.624371+0000","10.20.193.104:0/1441972685":"2026-02-18T20:57:03.624371+0000","10.20.193.104:0/1658112270":"2026-02-18T20:56:38.012869+0000","10.20.193.104:0/501037198":"2026-02-18T20:56:38.012869+0000","10.20.193.104:6801/3247908774":"2026-02-18T20:56:38.012869+0000","10.20.193.104:0/2902766949":"2026-02-18T20:56:38.012869+0000","10.20.193.104:0/1424534119":"2026-02-18T20:56:47.530062+0000","10.20.193.104:0/413298199":"2026-02-18T20:56:47.530062+0000","10.20.193.104:6800/95322277":"2026-02-18T20:56:47.530062+0000","10.20.193.104:0/1013639580":"2026-02-18T20:57:03.624371+0000","10.20.193.104:6801/1034073782":"2026-02-18T20:57:03.624371+0000","10.20.193.104:6800/3247908774":"2026-02-18T20:56:38.012869+0000","10.20.193.104:6801/95322277":"2026-02-18T20:56:47.530062+0000","10.20.193.104:0/1181662162":"2026-02-18T20:56:47.530062+0000","10.20.193.104:6800/1034073782":"2026-02-18T20:57:03.624371+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-17T20:58:51.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.585+0000 7f0444b7c640 1 -- 10.20.193.104:0/2278803632 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0418077550 msgr2=0x7f0418079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.585+0000 7f0444b7c640 1 --2- 10.20.193.104:0/2278803632 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0418077550 0x7f0418079a10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0434004680 tx=0x7f0434009340 comp rx=0 tx=0).stop 2026-02-17T20:58:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.585+0000 7f0444b7c640 1 -- 10.20.193.104:0/2278803632 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f044010a8c0 msgr2=0x7f04401a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.585+0000 7f0444b7c640 1 --2- 10.20.193.104:0/2278803632 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f044010a8c0 0x7f04401a2b00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f04280098b0 tx=0x7f0428004600 comp rx=0 tx=0).stop 2026-02-17T20:58:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.585+0000 7f0444b7c640 1 -- 10.20.193.104:0/2278803632 shutdown_connections 2026-02-17T20:58:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.585+0000 7f0444b7c640 1 --2- 10.20.193.104:0/2278803632 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0418077550 0x7f0418079a10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.585+0000 7f0444b7c640 1 --2- 10.20.193.104:0/2278803632 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f044010a8c0 0x7f04401a2b00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.585+0000 7f0444b7c640 1 --2- 10.20.193.104:0/2278803632 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f04401048c0 0x7f04401a25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.585+0000 7f0444b7c640 1 -- 10.20.193.104:0/2278803632 >> 10.20.193.104:0/2278803632 conn(0x7f04401005c0 msgr2=0x7f04401016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:51.588 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.585+0000 7f0444b7c640 1 -- 10.20.193.104:0/2278803632 shutdown_connections 2026-02-17T20:58:51.589 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:51.585+0000 7f0444b7c640 1 -- 10.20.193.104:0/2278803632 wait complete. 2026-02-17T20:58:51.625 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2026-02-17T20:58:49.029526+0000', 'modified': '2026-02-17T20:58:49.029559+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24327}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24327': {'gid': 24327, 'name': 'foo.trial153.jtthho', 'rank': 0, 'incarnation': 5, 'state': 'up:creating', 'state_seq': 1, 'addr': '10.20.193.153:6833/3911303877', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.153:6832', 'nonce': 3911303877}, {'type': 'v1', 'addr': '10.20.193.153:6833', 'nonce': 3911303877}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'bar', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2026-02-17T20:58:51.625 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_24327:up:creating 2026-02-17T20:58:52.166 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: osdmap e56: 8 total, 8 up, 8 in 2026-02-17T20:58:52.167 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: mds.? [v2:10.20.193.104:6836/347975304,v1:10.20.193.104:6837/347975304] up:boot 2026-02-17T20:58:52.167 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: mds.? [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] up:boot 2026-02-17T20:58:52.167 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: Dropping low affinity active daemon mds.foo.trial153.jtthho in favor of higher affinity standby. 2026-02-17T20:58:52.167 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: Replacing daemon mds.foo.trial153.jtthho as rank 0 with standby daemon mds.bar.trial153.cedikz 2026-02-17T20:58:52.167 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-17T20:58:52.167 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: fsmap foo:1 bar:1 {bar:0=foo.trial153.jtthho=up:active,foo:0=foo.trial104.gnmuyp=up:active} 2 up:standby 2026-02-17T20:58:52.167 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mds metadata", "who": "bar.trial104.jdjykv"}]: dispatch 2026-02-17T20:58:52.167 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mds metadata", "who": "bar.trial153.cedikz"}]: dispatch 2026-02-17T20:58:52.167 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: osdmap e57: 8 total, 8 up, 8 in 2026-02-17T20:58:52.168 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: fsmap foo:1 bar:1/1 {bar:0=bar.trial153.cedikz=up:replay,foo:0=foo.trial104.gnmuyp=up:active} 1 up:standby 2026-02-17T20:58:52.168 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/274993052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-17T20:58:52.168 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:52.168 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:52.168 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/2278803632' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T20:58:52.168 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: pgmap v99: 129 pgs: 25 creating+peering, 13 unknown, 91 active+clean; 581 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 1.1 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2026-02-17T20:58:52.168 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:52.168 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:52.168 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:52.168 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:52.168 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:52.168 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:52.169 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:52.169 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:52.169 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:52.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: osdmap e56: 8 total, 8 up, 8 in 2026-02-17T20:58:52.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: mds.? [v2:10.20.193.104:6836/347975304,v1:10.20.193.104:6837/347975304] up:boot 2026-02-17T20:58:52.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: mds.? [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] up:boot 2026-02-17T20:58:52.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: Dropping low affinity active daemon mds.foo.trial153.jtthho in favor of higher affinity standby. 2026-02-17T20:58:52.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: Replacing daemon mds.foo.trial153.jtthho as rank 0 with standby daemon mds.bar.trial153.cedikz 2026-02-17T20:58:52.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2026-02-17T20:58:52.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: fsmap foo:1 bar:1 {bar:0=foo.trial153.jtthho=up:active,foo:0=foo.trial104.gnmuyp=up:active} 2 up:standby 2026-02-17T20:58:52.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mds metadata", "who": "bar.trial104.jdjykv"}]: dispatch 2026-02-17T20:58:52.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mds metadata", "who": "bar.trial153.cedikz"}]: dispatch 2026-02-17T20:58:52.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: osdmap e57: 8 total, 8 up, 8 in 2026-02-17T20:58:52.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: fsmap foo:1 bar:1/1 {bar:0=bar.trial153.cedikz=up:replay,foo:0=foo.trial104.gnmuyp=up:active} 1 up:standby 2026-02-17T20:58:52.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/274993052' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-17T20:58:52.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:52.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:52.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/2278803632' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2026-02-17T20:58:52.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: pgmap v99: 129 pgs: 25 creating+peering, 13 unknown, 91 active+clean; 581 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 1.1 KiB/s rd, 9.2 KiB/s wr, 21 op/s 2026-02-17T20:58:52.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:52.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:52.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:52.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:52.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:52.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:58:52.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:58:52.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:58:52.277 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:52.627 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph fs dump --format=json 2026-02-17T20:58:52.783 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:52.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.887+0000 7f781a1f7640 1 -- 10.20.193.104:0/3484989606 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f78141006a0 msgr2=0x7f7814100ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:52.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.887+0000 7f781a1f7640 1 --2- 10.20.193.104:0/3484989606 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f78141006a0 0x7f7814100ae0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f78040099b0 tx=0x7f780402f2b0 comp rx=0 tx=0).stop 2026-02-17T20:58:52.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.887+0000 7f781a1f7640 1 -- 10.20.193.104:0/3484989606 shutdown_connections 2026-02-17T20:58:52.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.887+0000 7f781a1f7640 1 --2- 10.20.193.104:0/3484989606 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f78141006a0 0x7f7814100ae0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:52.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.887+0000 7f781a1f7640 1 --2- 10.20.193.104:0/3484989606 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7814107750 0x7f7814107b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:52.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.887+0000 7f781a1f7640 1 -- 10.20.193.104:0/3484989606 >> 10.20.193.104:0/3484989606 conn(0x7f78140fc4f0 msgr2=0x7f78140fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:52.891 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.887+0000 7f781a1f7640 1 -- 10.20.193.104:0/3484989606 shutdown_connections 2026-02-17T20:58:52.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.887+0000 7f781a1f7640 1 -- 10.20.193.104:0/3484989606 wait complete. 2026-02-17T20:58:52.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.887+0000 7f781a1f7640 1 Processor -- start 2026-02-17T20:58:52.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.887+0000 7f781a1f7640 1 -- start start 2026-02-17T20:58:52.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.887+0000 7f781a1f7640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f78141006a0 0x7f7814102170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:52.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.887+0000 7f781a1f7640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7814107750 0x7f78141026b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:52.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.887+0000 7f781a1f7640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f781410f8d0 con 0x7f78141006a0 2026-02-17T20:58:52.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.887+0000 7f781a1f7640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f781410f750 con 0x7f7814107750 2026-02-17T20:58:52.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.888+0000 7f78137fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f78141006a0 0x7f7814102170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:52.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.888+0000 7f78137fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f78141006a0 0x7f7814102170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38448/0 (socket says 10.20.193.104:38448) 2026-02-17T20:58:52.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.888+0000 7f78137fe640 1 -- 10.20.193.104:0/3299836638 learned_addr learned my addr 10.20.193.104:0/3299836638 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:52.892 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.888+0000 7f7812ffd640 1 --2- 10.20.193.104:0/3299836638 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7814107750 0x7f78141026b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:52.893 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.888+0000 7f78137fe640 1 -- 10.20.193.104:0/3299836638 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7814107750 msgr2=0x7f78141026b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:52.893 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.888+0000 7f78137fe640 1 --2- 10.20.193.104:0/3299836638 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7814107750 0x7f78141026b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:52.893 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.888+0000 7f78137fe640 1 -- 10.20.193.104:0/3299836638 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7814102bf0 con 0x7f78141006a0 2026-02-17T20:58:52.893 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.888+0000 7f7812ffd640 1 --2- 10.20.193.104:0/3299836638 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7814107750 0x7f78141026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T20:58:52.893 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.888+0000 7f78137fe640 1 --2- 10.20.193.104:0/3299836638 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f78141006a0 0x7f7814102170 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f780000b700 tx=0x7f780000bbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:52.893 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.888+0000 7f7810ff9640 1 -- 10.20.193.104:0/3299836638 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f7800004440 con 0x7f78141006a0 2026-02-17T20:58:52.893 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.888+0000 7f7810ff9640 1 -- 10.20.193.104:0/3299836638 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f7800010070 con 0x7f78141006a0 2026-02-17T20:58:52.893 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.888+0000 7f781a1f7640 1 -- 10.20.193.104:0/3299836638 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7814102ee0 con 0x7f78141006a0 2026-02-17T20:58:52.893 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.888+0000 7f7810ff9640 1 -- 10.20.193.104:0/3299836638 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f780000c9b0 con 0x7f78141006a0 2026-02-17T20:58:52.893 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.888+0000 7f781a1f7640 1 -- 10.20.193.104:0/3299836638 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78141a6c50 con 0x7f78141006a0 2026-02-17T20:58:52.893 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.888+0000 7f781a1f7640 1 -- 10.20.193.104:0/3299836638 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7814101ad0 con 0x7f78141006a0 2026-02-17T20:58:52.894 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.889+0000 7f7810ff9640 1 -- 10.20.193.104:0/3299836638 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f780001d030 con 0x7f78141006a0 2026-02-17T20:58:52.895 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.890+0000 7f7810ff9640 1 --2- 10.20.193.104:0/3299836638 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f77e8077550 0x7f77e8079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:52.895 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.890+0000 7f7810ff9640 1 -- 10.20.193.104:0/3299836638 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 7220+0+0 (secure 0 0 0) 0x7f78000990d0 con 0x7f78141006a0 2026-02-17T20:58:52.895 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.890+0000 7f7812ffd640 1 --2- 10.20.193.104:0/3299836638 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f77e8077550 0x7f77e8079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:52.895 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.890+0000 7f7812ffd640 1 --2- 10.20.193.104:0/3299836638 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f77e8077550 0x7f77e8079a10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f78040097c0 tx=0x7f780402fc50 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:52.895 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.892+0000 7f7810ff9640 1 -- 10.20.193.104:0/3299836638 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f7800065c50 con 0x7f78141006a0 2026-02-17T20:58:52.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.990+0000 7f781a1f7640 1 -- 10.20.193.104:0/3299836638 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7814100b60 con 0x7f78141006a0 2026-02-17T20:58:52.993 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.991+0000 7f7810ff9640 1 -- 10.20.193.104:0/3299836638 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6606 (secure 0 0 0) 0x7f780006ab00 con 0x7f78141006a0 2026-02-17T20:58:52.993 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:52.993 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":9,"btime":"2026-02-17T20:58:52:050564+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14536,"name":"bar.trial104.jdjykv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.104:6837/347975304","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6836","nonce":347975304},{"type":"v1","addr":"10.20.193.104:6837","nonce":347975304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24359,"name":"foo.trial153.jtthho","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.153:6833/3602691448","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6832","nonce":3602691448},{"type":"v1","addr":"10.20.193.153:6833","nonce":3602691448}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-17T20:58:47.017728+0000","modified":"2026-02-17T20:58:52.045079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14522":{"gid":14522,"name":"foo.trial104.gnmuyp","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"10.20.193.104:6835/743462196","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6834","nonce":743462196},{"type":"v1","addr":"10.20.193.104:6835","nonce":743462196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14522,"qdb_cluster":[14522]},"id":1},{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-17T20:58:49.029526+0000","modified":"2026-02-17T20:58:51.062646+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24351":{"gid":24351,"name":"bar.trial153.cedikz","rank":0,"incarnation":8,"state":"up:reconnect","state_seq":2,"addr":"10.20.193.153:6835/3684943307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6834","nonce":3684943307},{"type":"v1","addr":"10.20.193.153:6835","nonce":3684943307}]},"join_fscid":2,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2026-02-17T20:58:52.994 INFO:teuthology.orchestra.run.trial104.stderr:dumped fsmap epoch 9 2026-02-17T20:58:52.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.991+0000 7f781a1f7640 1 -- 10.20.193.104:0/3299836638 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f77e8077550 msgr2=0x7f77e8079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:52.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.991+0000 7f781a1f7640 1 --2- 10.20.193.104:0/3299836638 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f77e8077550 0x7f77e8079a10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f78040097c0 tx=0x7f780402fc50 comp rx=0 tx=0).stop 2026-02-17T20:58:52.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.991+0000 7f781a1f7640 1 -- 10.20.193.104:0/3299836638 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f78141006a0 msgr2=0x7f7814102170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:52.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.991+0000 7f781a1f7640 1 --2- 10.20.193.104:0/3299836638 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f78141006a0 0x7f7814102170 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f780000b700 tx=0x7f780000bbd0 comp rx=0 tx=0).stop 2026-02-17T20:58:52.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.992+0000 7f781a1f7640 1 -- 10.20.193.104:0/3299836638 shutdown_connections 2026-02-17T20:58:52.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.992+0000 7f781a1f7640 1 --2- 10.20.193.104:0/3299836638 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f77e8077550 0x7f77e8079a10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:52.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.992+0000 7f781a1f7640 1 --2- 10.20.193.104:0/3299836638 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f7814107750 0x7f78141026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:52.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.992+0000 7f781a1f7640 1 --2- 10.20.193.104:0/3299836638 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f78141006a0 0x7f7814102170 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:52.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.992+0000 7f781a1f7640 1 -- 10.20.193.104:0/3299836638 >> 10.20.193.104:0/3299836638 conn(0x7f78140fc4f0 msgr2=0x7f78140fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:52.995 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.992+0000 7f781a1f7640 1 -- 10.20.193.104:0/3299836638 shutdown_connections 2026-02-17T20:58:52.996 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:52.992+0000 7f781a1f7640 1 -- 10.20.193.104:0/3299836638 wait complete. 2026-02-17T20:58:53.029 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2026-02-17T20:58:49.029526+0000', 'modified': '2026-02-17T20:58:51.062646+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 57, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24351}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24351': {'gid': 24351, 'name': 'bar.trial153.cedikz', 'rank': 0, 'incarnation': 8, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '10.20.193.153:6835/3684943307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.153:6834', 'nonce': 3684943307}, {'type': 'v1', 'addr': '10.20.193.153:6835', 'nonce': 3684943307}]}, 'join_fscid': 2, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'bar', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 0, 'qdb_cluster': []} 2026-02-17T20:58:53.029 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_24351:up:reconnect 2026-02-17T20:58:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:53 trial104 ceph-mon[20612]: mds.? [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] up:reconnect 2026-02-17T20:58:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:53 trial104 ceph-mon[20612]: mds.? [v2:10.20.193.153:6832/3602691448,v1:10.20.193.153:6833/3602691448] up:boot 2026-02-17T20:58:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:53 trial104 ceph-mon[20612]: mds.? [v2:10.20.193.104:6834/743462196,v1:10.20.193.104:6835/743462196] up:active 2026-02-17T20:58:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:53 trial104 ceph-mon[20612]: fsmap foo:1 bar:1/1 {bar:0=bar.trial153.cedikz=up:reconnect,foo:0=foo.trial104.gnmuyp=up:active} 2 up:standby 2026-02-17T20:58:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:53 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mds metadata", "who": "foo.trial153.jtthho"}]: dispatch 2026-02-17T20:58:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:53 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3299836638' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-17T20:58:53.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:53 trial153 ceph-mon[25357]: mds.? [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] up:reconnect 2026-02-17T20:58:53.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:53 trial153 ceph-mon[25357]: mds.? [v2:10.20.193.153:6832/3602691448,v1:10.20.193.153:6833/3602691448] up:boot 2026-02-17T20:58:53.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:53 trial153 ceph-mon[25357]: mds.? [v2:10.20.193.104:6834/743462196,v1:10.20.193.104:6835/743462196] up:active 2026-02-17T20:58:53.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:53 trial153 ceph-mon[25357]: fsmap foo:1 bar:1/1 {bar:0=bar.trial153.cedikz=up:reconnect,foo:0=foo.trial104.gnmuyp=up:active} 2 up:standby 2026-02-17T20:58:53.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:53 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "mds metadata", "who": "foo.trial153.jtthho"}]: dispatch 2026-02-17T20:58:53.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:53 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/3299836638' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-17T20:58:54.030 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph fs dump --format=json 2026-02-17T20:58:54.188 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:54.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cc58db640 1 -- 10.20.193.104:0/2615734548 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9cc0102660 msgr2=0x7f9cc0102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:54.303 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cc58db640 1 --2- 10.20.193.104:0/2615734548 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9cc0102660 0x7f9cc0102ac0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9ca80099b0 tx=0x7f9ca802f220 comp rx=0 tx=0).stop 2026-02-17T20:58:54.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cc58db640 1 -- 10.20.193.104:0/2615734548 shutdown_connections 2026-02-17T20:58:54.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cc58db640 1 --2- 10.20.193.104:0/2615734548 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9cc0102660 0x7f9cc0102ac0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cc58db640 1 --2- 10.20.193.104:0/2615734548 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9cc0108660 0x7f9cc0108a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cc58db640 1 -- 10.20.193.104:0/2615734548 >> 10.20.193.104:0/2615734548 conn(0x7f9cc00fe360 msgr2=0x7f9cc0100780 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:54.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cc58db640 1 -- 10.20.193.104:0/2615734548 shutdown_connections 2026-02-17T20:58:54.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cc58db640 1 -- 10.20.193.104:0/2615734548 wait complete. 2026-02-17T20:58:54.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cc58db640 1 Processor -- start 2026-02-17T20:58:54.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cc58db640 1 -- start start 2026-02-17T20:58:54.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cc58db640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9cc0102660 0x7f9cc01a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:54.304 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cc58db640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9cc0108660 0x7f9cc01a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:54.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cc58db640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc010f900 con 0x7f9cc0108660 2026-02-17T20:58:54.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cc58db640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc010f780 con 0x7f9cc0102660 2026-02-17T20:58:54.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cbe7fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9cc0108660 0x7f9cc01a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:54.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cbe7fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9cc0108660 0x7f9cc01a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38474/0 (socket says 10.20.193.104:38474) 2026-02-17T20:58:54.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cbe7fc640 1 -- 10.20.193.104:0/4187637321 learned_addr learned my addr 10.20.193.104:0/4187637321 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:54.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cbeffd640 1 --2- 10.20.193.104:0/4187637321 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9cc0102660 0x7f9cc01a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:54.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cbe7fc640 1 -- 10.20.193.104:0/4187637321 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9cc0102660 msgr2=0x7f9cc01a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:54.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.300+0000 7f9cbe7fc640 1 --2- 10.20.193.104:0/4187637321 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9cc0102660 0x7f9cc01a0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.301+0000 7f9cbe7fc640 1 -- 10.20.193.104:0/4187637321 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc019a5f0 con 0x7f9cc0108660 2026-02-17T20:58:54.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.301+0000 7f9cbe7fc640 1 --2- 10.20.193.104:0/4187637321 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9cc0108660 0x7f9cc01a0970 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8009980 tx=0x7f9ca80029c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:54.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.301+0000 7f9cc48d9640 1 -- 10.20.193.104:0/4187637321 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9ca8046070 con 0x7f9cc0108660 2026-02-17T20:58:54.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.301+0000 7f9cc48d9640 1 -- 10.20.193.104:0/4187637321 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f9ca8038a40 con 0x7f9cc0108660 2026-02-17T20:58:54.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.301+0000 7f9cc48d9640 1 -- 10.20.193.104:0/4187637321 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f9ca80419a0 con 0x7f9cc0108660 2026-02-17T20:58:54.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.301+0000 7f9cc58db640 1 -- 10.20.193.104:0/4187637321 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cc019a880 con 0x7f9cc0108660 2026-02-17T20:58:54.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.301+0000 7f9cc58db640 1 -- 10.20.193.104:0/4187637321 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cc019adb0 con 0x7f9cc0108660 2026-02-17T20:58:54.306 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.301+0000 7f9cc58db640 1 -- 10.20.193.104:0/4187637321 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cc0103da0 con 0x7f9cc0108660 2026-02-17T20:58:54.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.302+0000 7f9cc48d9640 1 -- 10.20.193.104:0/4187637321 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f9ca8038bf0 con 0x7f9cc0108660 2026-02-17T20:58:54.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.302+0000 7f9cc48d9640 1 --2- 10.20.193.104:0/4187637321 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9c940775a0 0x7f9c94079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:54.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.302+0000 7f9cbeffd640 1 --2- 10.20.193.104:0/4187637321 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9c940775a0 0x7f9c94079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:54.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.302+0000 7f9cc48d9640 1 -- 10.20.193.104:0/4187637321 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 7220+0+0 (secure 0 0 0) 0x7f9ca803e070 con 0x7f9cc0108660 2026-02-17T20:58:54.307 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.303+0000 7f9cbeffd640 1 --2- 10.20.193.104:0/4187637321 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9c940775a0 0x7f9c94079a60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009990 tx=0x7f9cb4008040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:54.308 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.305+0000 7f9cc48d9640 1 -- 10.20.193.104:0/4187637321 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f9ca808b320 con 0x7f9cc0108660 2026-02-17T20:58:54.308 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:54 trial104 ceph-mon[20612]: mds.? [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] up:rejoin 2026-02-17T20:58:54.308 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:54 trial104 ceph-mon[20612]: fsmap foo:1 bar:1/1 {bar:0=bar.trial153.cedikz=up:rejoin,foo:0=foo.trial104.gnmuyp=up:active} 2 up:standby 2026-02-17T20:58:54.308 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:54 trial104 ceph-mon[20612]: daemon mds.bar.trial153.cedikz is now active in filesystem bar as rank 0 2026-02-17T20:58:54.308 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:54 trial104 ceph-mon[20612]: pgmap v100: 129 pgs: 19 creating+peering, 3 unknown, 107 active+clean; 581 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 667 B/s rd, 5.2 KiB/s wr, 17 op/s 2026-02-17T20:58:54.308 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:54 trial104 ceph-mon[20612]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-17T20:58:54.308 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:54 trial104 ceph-mon[20612]: Cluster is now healthy 2026-02-17T20:58:54.308 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:54 trial104 ceph-mon[20612]: mds.? [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] up:active 2026-02-17T20:58:54.309 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:54 trial104 ceph-mon[20612]: fsmap foo:1 bar:1 {bar:0=bar.trial153.cedikz=up:active,foo:0=foo.trial104.gnmuyp=up:active} 2 up:standby 2026-02-17T20:58:54.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.405+0000 7f9cc58db640 1 -- 10.20.193.104:0/4187637321 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9cc019bb20 con 0x7f9cc0108660 2026-02-17T20:58:54.407 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.405+0000 7f9cc48d9640 1 -- 10.20.193.104:0/4187637321 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6614 (secure 0 0 0) 0x7f9ca80901d0 con 0x7f9cc0108660 2026-02-17T20:58:54.408 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T20:58:54.408 INFO:teuthology.orchestra.run.trial104.stdout:{"epoch":11,"btime":"2026-02-17T20:58:54:052012+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14536,"name":"bar.trial104.jdjykv","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.104:6837/347975304","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6836","nonce":347975304},{"type":"v1","addr":"10.20.193.104:6837","nonce":347975304}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24359,"name":"foo.trial153.jtthho","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.153:6833/3602691448","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6832","nonce":3602691448},{"type":"v1","addr":"10.20.193.153:6833","nonce":3602691448}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-17T20:58:47.017728+0000","modified":"2026-02-17T20:58:52.045079+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14522},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14522":{"gid":14522,"name":"foo.trial104.gnmuyp","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"10.20.193.104:6835/743462196","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.104:6834","nonce":743462196},{"type":"v1","addr":"10.20.193.104:6835","nonce":743462196}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"foo","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14522,"qdb_cluster":[14522]},"id":1},{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2026-02-17T20:58:49.029526+0000","modified":"2026-02-17T20:58:54.052009+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":57,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24351},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24351":{"gid":24351,"name":"bar.trial153.cedikz","rank":0,"incarnation":8,"state":"up:active","state_seq":4,"addr":"10.20.193.153:6835/3684943307","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.153:6834","nonce":3684943307},{"type":"v1","addr":"10.20.193.153:6835","nonce":3684943307}]},"join_fscid":2,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"bar","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24351,"qdb_cluster":[24351]},"id":2}]} 2026-02-17T20:58:54.409 INFO:teuthology.orchestra.run.trial104.stderr:dumped fsmap epoch 11 2026-02-17T20:58:54.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.406+0000 7f9cc58db640 1 -- 10.20.193.104:0/4187637321 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9c940775a0 msgr2=0x7f9c94079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:54.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.406+0000 7f9cc58db640 1 --2- 10.20.193.104:0/4187637321 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9c940775a0 0x7f9c94079a60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009990 tx=0x7f9cb4008040 comp rx=0 tx=0).stop 2026-02-17T20:58:54.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.406+0000 7f9cc58db640 1 -- 10.20.193.104:0/4187637321 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9cc0108660 msgr2=0x7f9cc01a0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:54.409 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.406+0000 7f9cc58db640 1 --2- 10.20.193.104:0/4187637321 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9cc0108660 0x7f9cc01a0970 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8009980 tx=0x7f9ca80029c0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.410 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.406+0000 7f9cc58db640 1 -- 10.20.193.104:0/4187637321 shutdown_connections 2026-02-17T20:58:54.410 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.406+0000 7f9cc58db640 1 --2- 10.20.193.104:0/4187637321 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f9c940775a0 0x7f9c94079a60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.410 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.406+0000 7f9cc58db640 1 --2- 10.20.193.104:0/4187637321 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f9cc0108660 0x7f9cc01a0970 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.410 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.406+0000 7f9cc58db640 1 --2- 10.20.193.104:0/4187637321 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f9cc0102660 0x7f9cc01a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.410 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.406+0000 7f9cc58db640 1 -- 10.20.193.104:0/4187637321 >> 10.20.193.104:0/4187637321 conn(0x7f9cc00fe360 msgr2=0x7f9cc00ff1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:54.410 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.406+0000 7f9cc58db640 1 -- 10.20.193.104:0/4187637321 shutdown_connections 2026-02-17T20:58:54.410 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.406+0000 7f9cc58db640 1 -- 10.20.193.104:0/4187637321 wait complete. 2026-02-17T20:58:54.445 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2026-02-17T20:58:49.029526+0000', 'modified': '2026-02-17T20:58:54.052009+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 57, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24351}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24351': {'gid': 24351, 'name': 'bar.trial153.cedikz', 'rank': 0, 'incarnation': 8, 'state': 'up:active', 'state_seq': 4, 'addr': '10.20.193.153:6835/3684943307', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '10.20.193.153:6834', 'nonce': 3684943307}, {'type': 'v1', 'addr': '10.20.193.153:6835', 'nonce': 3684943307}]}, 'join_fscid': 2, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'bar', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24351, 'qdb_cluster': [24351]} 2026-02-17T20:58:54.445 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2026-02-17T20:58:54.445 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph tell mds.bar.trial153.cedikz status 2026-02-17T20:58:54.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:54 trial153 ceph-mon[25357]: mds.? [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] up:rejoin 2026-02-17T20:58:54.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:54 trial153 ceph-mon[25357]: fsmap foo:1 bar:1/1 {bar:0=bar.trial153.cedikz=up:rejoin,foo:0=foo.trial104.gnmuyp=up:active} 2 up:standby 2026-02-17T20:58:54.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:54 trial153 ceph-mon[25357]: daemon mds.bar.trial153.cedikz is now active in filesystem bar as rank 0 2026-02-17T20:58:54.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:54 trial153 ceph-mon[25357]: pgmap v100: 129 pgs: 19 creating+peering, 3 unknown, 107 active+clean; 581 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 667 B/s rd, 5.2 KiB/s wr, 17 op/s 2026-02-17T20:58:54.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:54 trial153 ceph-mon[25357]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2026-02-17T20:58:54.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:54 trial153 ceph-mon[25357]: Cluster is now healthy 2026-02-17T20:58:54.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:54 trial153 ceph-mon[25357]: mds.? [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] up:active 2026-02-17T20:58:54.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:54 trial153 ceph-mon[25357]: fsmap foo:1 bar:1 {bar:0=bar.trial153.cedikz=up:active,foo:0=foo.trial104.gnmuyp=up:active} 2 up:standby 2026-02-17T20:58:54.601 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:54.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.703+0000 7f67692c6640 1 -- 10.20.193.104:0/2115130241 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6764075d30 msgr2=0x7f676410ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:54.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.703+0000 7f67692c6640 1 --2- 10.20.193.104:0/2115130241 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6764075d30 0x7f676410ea60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f674c0099b0 tx=0x7f674c02f2b0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.703+0000 7f67692c6640 1 -- 10.20.193.104:0/2115130241 shutdown_connections 2026-02-17T20:58:54.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.703+0000 7f67692c6640 1 --2- 10.20.193.104:0/2115130241 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6764075d30 0x7f676410ea60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.703+0000 7f67692c6640 1 --2- 10.20.193.104:0/2115130241 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6764075410 0x7f67640757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.703+0000 7f67692c6640 1 -- 10.20.193.104:0/2115130241 >> 10.20.193.104:0/2115130241 conn(0x7f67640fe380 msgr2=0x7f67641007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:54.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.703+0000 7f67692c6640 1 -- 10.20.193.104:0/2115130241 shutdown_connections 2026-02-17T20:58:54.708 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.703+0000 7f67692c6640 1 -- 10.20.193.104:0/2115130241 wait complete. 2026-02-17T20:58:54.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f67692c6640 1 Processor -- start 2026-02-17T20:58:54.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f67692c6640 1 -- start start 2026-02-17T20:58:54.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f67692c6640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6764075410 0x7f67641a2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:54.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f67692c6640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6764075d30 0x7f67641a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:54.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f67692c6640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f6764111b10 con 0x7f6764075d30 2026-02-17T20:58:54.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f67692c6640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f6764111990 con 0x7f6764075410 2026-02-17T20:58:54.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f67627fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6764075d30 0x7f67641a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:54.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f67627fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6764075d30 0x7f67641a2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38500/0 (socket says 10.20.193.104:38500) 2026-02-17T20:58:54.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f67627fc640 1 -- 10.20.193.104:0/1983426066 learned_addr learned my addr 10.20.193.104:0/1983426066 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:54.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f6762ffd640 1 --2- 10.20.193.104:0/1983426066 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6764075410 0x7f67641a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:54.709 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f67627fc640 1 -- 10.20.193.104:0/1983426066 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6764075410 msgr2=0x7f67641a2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:54.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f67627fc640 1 --2- 10.20.193.104:0/1983426066 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6764075410 0x7f67641a2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f67627fc640 1 -- 10.20.193.104:0/1983426066 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676419c7c0 con 0x7f6764075d30 2026-02-17T20:58:54.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f6762ffd640 1 --2- 10.20.193.104:0/1983426066 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6764075410 0x7f67641a2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-17T20:58:54.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f67627fc640 1 --2- 10.20.193.104:0/1983426066 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6764075d30 0x7f67641a2b80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f674c002410 tx=0x7f674c002910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:54.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f6743fff640 1 -- 10.20.193.104:0/1983426066 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f674c046070 con 0x7f6764075d30 2026-02-17T20:58:54.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f6743fff640 1 -- 10.20.193.104:0/1983426066 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f674c002e00 con 0x7f6764075d30 2026-02-17T20:58:54.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f67692c6640 1 -- 10.20.193.104:0/1983426066 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f676419ca50 con 0x7f6764075d30 2026-02-17T20:58:54.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f6743fff640 1 -- 10.20.193.104:0/1983426066 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f674c041790 con 0x7f6764075d30 2026-02-17T20:58:54.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.704+0000 7f67692c6640 1 -- 10.20.193.104:0/1983426066 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f676419cf80 con 0x7f6764075d30 2026-02-17T20:58:54.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.705+0000 7f6743fff640 1 -- 10.20.193.104:0/1983426066 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f674c038b20 con 0x7f6764075d30 2026-02-17T20:58:54.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.706+0000 7f6743fff640 1 --2- 10.20.193.104:0/1983426066 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f67380775a0 0x7f6738079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:54.710 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.706+0000 7f6762ffd640 1 --2- 10.20.193.104:0/1983426066 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f67380775a0 0x7f6738079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:54.711 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.706+0000 7f6743fff640 1 -- 10.20.193.104:0/1983426066 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 7220+0+0 (secure 0 0 0) 0x7f674c03e070 con 0x7f6764075d30 2026-02-17T20:58:54.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.706+0000 7f6762ffd640 1 --2- 10.20.193.104:0/1983426066 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f67380775a0 0x7f6738079a60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6758008b70 tx=0x7f6758005e90 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:54.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.706+0000 7f676b7cbe00 1 Processor -- start 2026-02-17T20:58:54.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.706+0000 7f676b7cbe00 1 -- start start 2026-02-17T20:58:54.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f676b7cbe00 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x559aa9537940 0x559aa9537d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:54.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f676b7cbe00 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa95364e0 0x559aa9536960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:54.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f676b7cbe00 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x559aa94b7120 con 0x559aa95364e0 2026-02-17T20:58:54.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f676b7cbe00 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x559aa9489a40 con 0x559aa9537940 2026-02-17T20:58:54.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f67627fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa95364e0 0x559aa9536960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:54.717 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f67627fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa95364e0 0x559aa9536960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38508/0 (socket says 10.20.193.104:38508) 2026-02-17T20:58:54.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f67627fc640 1 -- 10.20.193.104:0/2812133095 learned_addr learned my addr 10.20.193.104:0/2812133095 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:54.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f67627fc640 1 -- 10.20.193.104:0/2812133095 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x559aa9537940 msgr2=0x559aa9537d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:58:54.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f67627fc640 1 --2- 10.20.193.104:0/2812133095 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x559aa9537940 0x559aa9537d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f67627fc640 1 -- 10.20.193.104:0/2812133095 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa943f4b0 con 0x559aa95364e0 2026-02-17T20:58:54.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f67627fc640 1 --2- 10.20.193.104:0/2812133095 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa95364e0 0x559aa9536960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f674c032040 tx=0x7f674c009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2781afb6c88f165 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:54.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f672f7fe640 1 -- 10.20.193.104:0/2812133095 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f674c09d070 con 0x559aa95364e0 2026-02-17T20:58:54.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f672f7fe640 1 -- 10.20.193.104:0/2812133095 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f674c033070 con 0x559aa95364e0 2026-02-17T20:58:54.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f672f7fe640 1 -- 10.20.193.104:0/2812133095 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f674c08d450 con 0x559aa95364e0 2026-02-17T20:58:54.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f676b7cbe00 1 -- 10.20.193.104:0/2812133095 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa95364e0 msgr2=0x559aa9536960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:54.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f676b7cbe00 1 --2- 10.20.193.104:0/2812133095 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa95364e0 0x559aa9536960 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f674c032040 tx=0x7f674c009340 comp rx=0 tx=0).stop 2026-02-17T20:58:54.718 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f676b7cbe00 1 -- 10.20.193.104:0/2812133095 shutdown_connections 2026-02-17T20:58:54.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f676b7cbe00 1 --2- 10.20.193.104:0/2812133095 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa95364e0 0x559aa9536960 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f676b7cbe00 1 --2- 10.20.193.104:0/2812133095 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x559aa9537940 0x559aa9537d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f676b7cbe00 1 -- 10.20.193.104:0/2812133095 >> 10.20.193.104:0/2812133095 conn(0x559aa952df40 msgr2=0x559aa9534dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:54.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f676b7cbe00 1 -- 10.20.193.104:0/2812133095 shutdown_connections 2026-02-17T20:58:54.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.707+0000 7f676b7cbe00 1 -- 10.20.193.104:0/2812133095 wait complete. 2026-02-17T20:58:54.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.708+0000 7f676b7cbe00 1 -- start start 2026-02-17T20:58:54.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.708+0000 7f676b7cbe00 1 Processor -- start 2026-02-17T20:58:54.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.708+0000 7f676b7cbe00 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x559aa95364e0 0x559aa9550540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:54.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.708+0000 7f676b7cbe00 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa9537940 0x559aa9550a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:54.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.708+0000 7f676b7cbe00 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x559aa9437250 con 0x559aa9537940 2026-02-17T20:58:54.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.708+0000 7f676b7cbe00 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x559aa9431030 con 0x559aa95364e0 2026-02-17T20:58:54.719 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.708+0000 7f67627fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa9537940 0x559aa9550a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:54.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.708+0000 7f67627fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa9537940 0x559aa9550a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38514/0 (socket says 10.20.193.104:38514) 2026-02-17T20:58:54.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.708+0000 7f67627fc640 1 -- 10.20.193.104:0/1555457794 learned_addr learned my addr 10.20.193.104:0/1555457794 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:54.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.708+0000 7f67627fc640 1 -- 10.20.193.104:0/1555457794 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x559aa95364e0 msgr2=0x559aa9550540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2026-02-17T20:58:54.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.708+0000 7f67627fc640 1 --2- 10.20.193.104:0/1555457794 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x559aa95364e0 0x559aa9550540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f67627fc640 1 -- 10.20.193.104:0/1555457794 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa9548200 con 0x559aa9537940 2026-02-17T20:58:54.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f67627fc640 1 --2- 10.20.193.104:0/1555457794 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa9537940 0x559aa9550a80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f674c08b410 tx=0x7f674c0ad590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac3f32422106392 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:54.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f672cff9640 10 client.0 ms_handle_connect on v2:10.20.193.104:3300/0 2026-02-17T20:58:54.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f672cff9640 1 -- 10.20.193.104:0/1555457794 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f674c0a6070 con 0x559aa9537940 2026-02-17T20:58:54.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f672cff9640 1 -- 10.20.193.104:0/1555457794 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f674c09f070 con 0x559aa9537940 2026-02-17T20:58:54.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f672cff9640 1 -- 10.20.193.104:0/1555457794 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f674c09d070 con 0x559aa9537940 2026-02-17T20:58:54.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f676b7cbe00 1 -- 10.20.193.104:0/1555457794 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa925a950 con 0x559aa9537940 2026-02-17T20:58:54.720 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f672cff9640 1 -- 10.20.193.104:0/1555457794 <== mon.0 v2:10.20.193.104:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 7220+0+0 (secure 0 0 0) 0x7f674c089070 con 0x559aa9537940 2026-02-17T20:58:54.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f672cff9640 10 client.14582 inactive, discarding osd_map(57..57 src has 1..57) 2026-02-17T20:58:54.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f676b7cbe00 10 client.14582 _ll_register_callbacks cb 0x559aa942aa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-17T20:58:54.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f676b7cbe00 1 -- 10.20.193.104:0/1555457794 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559aa9491630 con 0x559aa9537940 2026-02-17T20:58:54.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f672cff9640 1 -- 10.20.193.104:0/1555457794 <== mon.0 v2:10.20.193.104:3300/0 5 ==== mon_get_version_reply(handle=1 version=11) ==== 24+0+0 (secure 0 0 0) 0x7f674c086140 con 0x559aa9537940 2026-02-17T20:58:54.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f676b7cbe00 10 client.14582 fetch_fsmap learned FSMap version 11 2026-02-17T20:58:54.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f676b7cbe00 1 -- 10.20.193.104:0/1555457794 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({fsmap=11}) -- 0x559aa94443a0 con 0x559aa9537940 2026-02-17T20:58:54.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f672cff9640 1 -- 10.20.193.104:0/1555457794 <== mon.0 v2:10.20.193.104:3300/0 6 ==== fsmap(e 11) ==== 4212+0+0 (secure 0 0 0) 0x7f674c0a9360 con 0x559aa9537940 2026-02-17T20:58:54.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f676b7cbe00 10 client.14582 fetch_fsmap finished waiting for FSMap version 11 2026-02-17T20:58:54.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f676b7cbe00 10 client.14582 resolve_mds: resolved name 'bar.trial153.cedikz' to daemon mds.bar.trial153.cedikz 2026-02-17T20:58:54.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f676b7cbe00 20 client.14582 populate_metadata read hostname 'trial104' 2026-02-17T20:58:54.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f676b7cbe00 1 --2- 10.20.193.104:0/1555457794 >> [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] conn(0x559aa955bae0 0x559aa955f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:54.721 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f676b7cbe00 4 client.14582 mds_command: new command op to 24351 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2026-02-17T20:58:54.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f676b7cbe00 1 -- 10.20.193.104:0/1555457794 --> [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559aa940bbd0 con 0x559aa955bae0 2026-02-17T20:58:54.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.709+0000 7f6762ffd640 1 --2- 10.20.193.104:0/1555457794 >> [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] conn(0x559aa955bae0 0x559aa955f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:54.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.710+0000 7f6762ffd640 1 --2- 10.20.193.104:0/1555457794 >> [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] conn(0x559aa955bae0 0x559aa955f7b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99e4fd5f29db8582 server_cookie=8ac93dfd18e6bc09 in_seq=0 out_seq=0 2026-02-17T20:58:54.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.710+0000 7f672cff9640 10 client.14582 ms_handle_connect on v2:10.20.193.153:6834/3684943307 2026-02-17T20:58:54.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.711+0000 7f672cff9640 1 -- 10.20.193.104:0/1555457794 <== mds.0 v2:10.20.193.153:6834/3684943307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24427 (crc 0 0 0) 0x559aa940bbd0 con 0x559aa955bae0 2026-02-17T20:58:54.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.711+0000 7f672cff9640 10 client.14582 handle_command_reply: tid=0 2026-02-17T20:58:54.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.711+0000 7f676b7cbe00 1 client.14582 shutdown 2026-02-17T20:58:54.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.711+0000 7f676b7cbe00 1 -- 10.20.193.104:0/1555457794 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa9537940 msgr2=0x559aa9550a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:54.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.711+0000 7f676b7cbe00 1 --2- 10.20.193.104:0/1555457794 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa9537940 0x559aa9550a80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f674c08b410 tx=0x7f674c0ad590 comp rx=0 tx=0).stop 2026-02-17T20:58:54.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.711+0000 7f676b7cbe00 1 -- 10.20.193.104:0/1555457794 shutdown_connections 2026-02-17T20:58:54.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.711+0000 7f676b7cbe00 1 --2- 10.20.193.104:0/1555457794 >> [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] conn(0x559aa955bae0 0x559aa955f7b0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.711+0000 7f676b7cbe00 1 --2- 10.20.193.104:0/1555457794 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa9537940 0x559aa9550a80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.722 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.711+0000 7f676b7cbe00 1 --2- 10.20.193.104:0/1555457794 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x559aa95364e0 0x559aa9550540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.711+0000 7f672cff9640 0 client.14582 ms_handle_reset on v2:10.20.193.153:6834/3684943307 2026-02-17T20:58:54.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.711+0000 7f676b7cbe00 1 -- 10.20.193.104:0/1555457794 >> 10.20.193.104:0/1555457794 conn(0x559aa952df40 msgr2=0x559aa953a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:54.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.711+0000 7f676b7cbe00 1 -- 10.20.193.104:0/1555457794 shutdown_connections 2026-02-17T20:58:54.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.711+0000 7f676b7cbe00 1 -- 10.20.193.104:0/1555457794 wait complete. 2026-02-17T20:58:54.723 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.711+0000 7f676b7cbe00 20 client.14582 trim_cache size 0 max 16384 2026-02-17T20:58:54.729 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f676b7cbe00 1 Processor -- start 2026-02-17T20:58:54.729 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f676b7cbe00 1 -- start start 2026-02-17T20:58:54.729 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f676b7cbe00 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa95364e0 0x559aa95345a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:54.729 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f676b7cbe00 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x559aa9537940 0x559aa954da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:54.729 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f676b7cbe00 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f670800e990 con 0x559aa95364e0 2026-02-17T20:58:54.729 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f676b7cbe00 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f670800c2e0 con 0x559aa9537940 2026-02-17T20:58:54.729 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f6762ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa95364e0 0x559aa95345a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:54.729 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f6762ffd640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa95364e0 0x559aa95345a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38516/0 (socket says 10.20.193.104:38516) 2026-02-17T20:58:54.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f6762ffd640 1 -- 10.20.193.104:0/562782009 learned_addr learned my addr 10.20.193.104:0/562782009 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:54.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f6762ffd640 1 -- 10.20.193.104:0/562782009 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x559aa9537940 msgr2=0x559aa954da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:58:54.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f6762ffd640 1 --2- 10.20.193.104:0/562782009 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x559aa9537940 0x559aa954da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f6762ffd640 1 -- 10.20.193.104:0/562782009 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa9548030 con 0x559aa95364e0 2026-02-17T20:58:54.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f6762ffd640 1 --2- 10.20.193.104:0/562782009 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa95364e0 0x559aa95345a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x559aa94443a0 tx=0x7f67580047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2241d23395cfece server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:54.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f672effd640 1 -- 10.20.193.104:0/562782009 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f675802a070 con 0x559aa95364e0 2026-02-17T20:58:54.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f672effd640 1 -- 10.20.193.104:0/562782009 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f6758002cf0 con 0x559aa95364e0 2026-02-17T20:58:54.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f672effd640 1 -- 10.20.193.104:0/562782009 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f675801e670 con 0x559aa95364e0 2026-02-17T20:58:54.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f676b7cbe00 1 -- 10.20.193.104:0/562782009 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa95364e0 msgr2=0x559aa95345a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:54.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.720+0000 7f676b7cbe00 1 --2- 10.20.193.104:0/562782009 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa95364e0 0x559aa95345a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x559aa94443a0 tx=0x7f67580047c0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f676b7cbe00 1 -- 10.20.193.104:0/562782009 shutdown_connections 2026-02-17T20:58:54.730 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f676b7cbe00 1 --2- 10.20.193.104:0/562782009 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x559aa9537940 0x559aa954da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.731 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f676b7cbe00 1 --2- 10.20.193.104:0/562782009 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa95364e0 0x559aa95345a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.731 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f676b7cbe00 1 -- 10.20.193.104:0/562782009 >> 10.20.193.104:0/562782009 conn(0x559aa952df40 msgr2=0x559aa954d370 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:54.731 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f676b7cbe00 1 -- 10.20.193.104:0/562782009 shutdown_connections 2026-02-17T20:58:54.731 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f676b7cbe00 1 -- 10.20.193.104:0/562782009 wait complete. 2026-02-17T20:58:54.731 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f676b7cbe00 1 -- start start 2026-02-17T20:58:54.731 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f676b7cbe00 1 Processor -- start 2026-02-17T20:58:54.731 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f676b7cbe00 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x559aa95364e0 0x559aa95c3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:54.731 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f676b7cbe00 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa9537940 0x559aa95c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:54.731 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f676b7cbe00 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x559aa955b960 con 0x559aa9537940 2026-02-17T20:58:54.731 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f676b7cbe00 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f670800c950 con 0x559aa95364e0 2026-02-17T20:58:54.731 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f67627fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa9537940 0x559aa95c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:54.731 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f67627fc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa9537940 0x559aa95c3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38522/0 (socket says 10.20.193.104:38522) 2026-02-17T20:58:54.731 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f67627fc640 1 -- 10.20.193.104:0/3559537004 learned_addr learned my addr 10.20.193.104:0/3559537004 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:54.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f6762ffd640 1 --2- 10.20.193.104:0/3559537004 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x559aa95364e0 0x559aa95c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:54.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f67627fc640 1 -- 10.20.193.104:0/3559537004 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x559aa95364e0 msgr2=0x559aa95c3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-17T20:58:54.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f67627fc640 1 --2- 10.20.193.104:0/3559537004 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x559aa95364e0 0x559aa95c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.721+0000 7f67627fc640 1 -- 10.20.193.104:0/3559537004 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa9168680 con 0x559aa9537940 2026-02-17T20:58:54.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f67627fc640 1 --2- 10.20.193.104:0/3559537004 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa9537940 0x559aa95c3ed0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f674c0ad680 tx=0x7f674c0862e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d18b8f58fcdc5cc server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:54.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f672cff9640 10 client.0 ms_handle_connect on v2:10.20.193.104:3300/0 2026-02-17T20:58:54.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f672cff9640 1 -- 10.20.193.104:0/3559537004 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f674c09d070 con 0x559aa9537940 2026-02-17T20:58:54.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f672cff9640 1 -- 10.20.193.104:0/3559537004 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x559aa9491630 con 0x559aa9537940 2026-02-17T20:58:54.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f676b7cbe00 1 -- 10.20.193.104:0/3559537004 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa9429450 con 0x559aa9537940 2026-02-17T20:58:54.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f672cff9640 1 -- 10.20.193.104:0/3559537004 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f674c0a6070 con 0x559aa9537940 2026-02-17T20:58:54.732 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f676b7cbe00 10 client.14586 _ll_register_callbacks cb 0x7f674c0863c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2026-02-17T20:58:54.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f676b7cbe00 1 -- 10.20.193.104:0/3559537004 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f674c033070 con 0x559aa9537940 2026-02-17T20:58:54.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f672cff9640 1 -- 10.20.193.104:0/3559537004 <== mon.0 v2:10.20.193.104:3300/0 4 ==== osd_map(57..57 src has 1..57) ==== 7220+0+0 (secure 0 0 0) 0x7f674c089070 con 0x559aa9537940 2026-02-17T20:58:54.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f672cff9640 1 -- 10.20.193.104:0/3559537004 <== mon.0 v2:10.20.193.104:3300/0 5 ==== mon_get_version_reply(handle=1 version=11) ==== 24+0+0 (secure 0 0 0) 0x7f674c0afd00 con 0x559aa9537940 2026-02-17T20:58:54.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f676b7cbe00 10 client.14586 fetch_fsmap learned FSMap version 11 2026-02-17T20:58:54.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f676b7cbe00 1 -- 10.20.193.104:0/3559537004 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({fsmap=11}) -- 0x559aa9548d20 con 0x559aa9537940 2026-02-17T20:58:54.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f672cff9640 1 -- 10.20.193.104:0/3559537004 <== mon.0 v2:10.20.193.104:3300/0 6 ==== fsmap(e 11) ==== 4212+0+0 (secure 0 0 0) 0x7f674c08f040 con 0x559aa9537940 2026-02-17T20:58:54.733 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f676b7cbe00 10 client.14586 fetch_fsmap finished waiting for FSMap version 11 2026-02-17T20:58:54.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f676b7cbe00 10 client.14586 resolve_mds: resolved name 'bar.trial153.cedikz' to daemon mds.bar.trial153.cedikz 2026-02-17T20:58:54.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f676b7cbe00 20 client.14586 populate_metadata read hostname 'trial104' 2026-02-17T20:58:54.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f676b7cbe00 1 --2- 10.20.193.104:0/3559537004 >> [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] conn(0x559aa95c9700 0x559aa95cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:54.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f676b7cbe00 4 client.14586 mds_command: new command op to 24351 tid=0 multi_id=0 [{"prefix": "status"}] 2026-02-17T20:58:54.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f676b7cbe00 1 -- 10.20.193.104:0/3559537004 --> [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] -- command(tid 0: {"prefix": "status"}) -- 0x559aa91f97a0 con 0x559aa95c9700 2026-02-17T20:58:54.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.722+0000 7f6762ffd640 1 --2- 10.20.193.104:0/3559537004 >> [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] conn(0x559aa95c9700 0x559aa95cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:54.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f6762ffd640 1 --2- 10.20.193.104:0/3559537004 >> [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] conn(0x559aa95c9700 0x559aa95cbaf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af00e9a00dd5363 server_cookie=c5777a07b7fe77b5 in_seq=0 out_seq=0 2026-02-17T20:58:54.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f672cff9640 10 client.14586 ms_handle_connect on v2:10.20.193.153:6834/3684943307 2026-02-17T20:58:54.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f672cff9640 1 -- 10.20.193.104:0/3559537004 <== mds.0 v2:10.20.193.153:6834/3684943307 1 ==== command_reply(tid 0: 0 ) ==== 8+0+329 (crc 0 0 0) 0x559aa91f97a0 con 0x559aa95c9700 2026-02-17T20:58:54.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f672cff9640 10 client.14586 handle_command_reply: tid=0 2026-02-17T20:58:54.734 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f676b7cbe00 1 client.14586 shutdown 2026-02-17T20:58:54.735 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f676b7cbe00 1 -- 10.20.193.104:0/3559537004 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa9537940 msgr2=0x559aa95c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:54.735 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f676b7cbe00 1 --2- 10.20.193.104:0/3559537004 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa9537940 0x559aa95c3ed0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f674c0ad680 tx=0x7f674c0862e0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.735 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f676b7cbe00 1 -- 10.20.193.104:0/3559537004 shutdown_connections 2026-02-17T20:58:54.735 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f676b7cbe00 1 --2- 10.20.193.104:0/3559537004 >> [v2:10.20.193.153:6834/3684943307,v1:10.20.193.153:6835/3684943307] conn(0x559aa95c9700 0x559aa95cbaf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.735 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f676b7cbe00 1 --2- 10.20.193.104:0/3559537004 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x559aa9537940 0x559aa95c3ed0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.735 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f676b7cbe00 1 --2- 10.20.193.104:0/3559537004 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x559aa95364e0 0x559aa95c3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.735 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f672cff9640 0 client.14586 ms_handle_reset on v2:10.20.193.153:6834/3684943307 2026-02-17T20:58:54.735 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f676b7cbe00 1 -- 10.20.193.104:0/3559537004 >> 10.20.193.104:0/3559537004 conn(0x559aa952df40 msgr2=0x559aa954db90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:54.735 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f676b7cbe00 1 -- 10.20.193.104:0/3559537004 shutdown_connections 2026-02-17T20:58:54.735 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f676b7cbe00 1 -- 10.20.193.104:0/3559537004 wait complete. 2026-02-17T20:58:54.735 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f676b7cbe00 20 client.14586 trim_cache size 0 max 16384 2026-02-17T20:58:54.736 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-17T20:58:54.736 INFO:teuthology.orchestra.run.trial104.stdout: "cluster_fsid": "19072504-0c43-11f1-93a3-d404e6e7d460", 2026-02-17T20:58:54.736 INFO:teuthology.orchestra.run.trial104.stdout: "whoami": 0, 2026-02-17T20:58:54.736 INFO:teuthology.orchestra.run.trial104.stdout: "id": 24351, 2026-02-17T20:58:54.736 INFO:teuthology.orchestra.run.trial104.stdout: "want_state": "up:active", 2026-02-17T20:58:54.736 INFO:teuthology.orchestra.run.trial104.stdout: "state": "up:active", 2026-02-17T20:58:54.736 INFO:teuthology.orchestra.run.trial104.stdout: "fs_name": "bar", 2026-02-17T20:58:54.736 INFO:teuthology.orchestra.run.trial104.stdout: "rank_uptime": 3.6722448339999998, 2026-02-17T20:58:54.737 INFO:teuthology.orchestra.run.trial104.stdout: "mdsmap_epoch": 11, 2026-02-17T20:58:54.737 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap_epoch": 57, 2026-02-17T20:58:54.737 INFO:teuthology.orchestra.run.trial104.stdout: "osdmap_epoch_barrier": 57, 2026-02-17T20:58:54.737 INFO:teuthology.orchestra.run.trial104.stdout: "uptime": 3.8974505110000002 2026-02-17T20:58:54.737 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-17T20:58:54.738 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f67692c6640 1 -- 10.20.193.104:0/1983426066 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f67380775a0 msgr2=0x7f6738079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:54.738 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f67692c6640 1 --2- 10.20.193.104:0/1983426066 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f67380775a0 0x7f6738079a60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6758008b70 tx=0x7f6758005e90 comp rx=0 tx=0).stop 2026-02-17T20:58:54.738 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f67692c6640 1 -- 10.20.193.104:0/1983426066 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6764075d30 msgr2=0x7f67641a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:54.738 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f67692c6640 1 --2- 10.20.193.104:0/1983426066 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6764075d30 0x7f67641a2b80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f674c002410 tx=0x7f674c002910 comp rx=0 tx=0).stop 2026-02-17T20:58:54.738 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f67692c6640 1 -- 10.20.193.104:0/1983426066 shutdown_connections 2026-02-17T20:58:54.738 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f67692c6640 1 --2- 10.20.193.104:0/1983426066 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f67380775a0 0x7f6738079a60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.738 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f67692c6640 1 --2- 10.20.193.104:0/1983426066 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f6764075d30 0x7f67641a2b80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.738 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f67692c6640 1 --2- 10.20.193.104:0/1983426066 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f6764075410 0x7f67641a2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:54.739 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f67692c6640 1 -- 10.20.193.104:0/1983426066 >> 10.20.193.104:0/1983426066 conn(0x7f67640fe380 msgr2=0x7f6764106f40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:54.739 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f67692c6640 1 -- 10.20.193.104:0/1983426066 shutdown_connections 2026-02-17T20:58:54.739 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:54.723+0000 7f67692c6640 1 -- 10.20.193.104:0/1983426066 wait complete. 2026-02-17T20:58:54.759 INFO:teuthology.run_tasks:Running task ceph-fuse... 2026-02-17T20:58:54.845 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2026-02-17T20:58:54.845 INFO:tasks.ceph_fuse:config is {'client.0': {'cephfs_name': 'foo'}} 2026-02-17T20:58:54.846 INFO:tasks.ceph_fuse:client.0 config is {'cephfs_name': 'foo'} 2026-02-17T20:58:54.846 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2026-02-17T20:58:54.846 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2026-02-17T20:58:54.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:58:54.846 DEBUG:teuthology.orchestra.run.trial104:> ip netns list 2026-02-17T20:58:54.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:58:54.863 DEBUG:teuthology.orchestra.run.trial104:> sudo ip link delete ceph-brx 2026-02-17T20:58:54.929 INFO:teuthology.orchestra.run.trial104.stderr:Cannot find device "ceph-brx" 2026-02-17T20:58:54.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:58:54.931 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2026-02-17T20:58:54.931 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2026-02-17T20:58:54.931 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph fs ls 2026-02-17T20:58:55.131 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:55.176 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:55 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/4187637321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-17T20:58:55.237 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f5484a33640 1 -- 10.20.193.104:0/3567158915 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f548010a8c0 msgr2=0x7f548010aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:55.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f5484a33640 1 --2- 10.20.193.104:0/3567158915 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f548010a8c0 0x7f548010aca0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f54740099b0 tx=0x7f547402f220 comp rx=0 tx=0).stop 2026-02-17T20:58:55.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f5484a33640 1 -- 10.20.193.104:0/3567158915 shutdown_connections 2026-02-17T20:58:55.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f5484a33640 1 --2- 10.20.193.104:0/3567158915 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f54801048c0 0x7f5480104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:55.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f5484a33640 1 --2- 10.20.193.104:0/3567158915 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f548010a8c0 0x7f548010aca0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:55.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f5484a33640 1 -- 10.20.193.104:0/3567158915 >> 10.20.193.104:0/3567158915 conn(0x7f54801005c0 msgr2=0x7f54801029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:55.238 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f5484a33640 1 -- 10.20.193.104:0/3567158915 shutdown_connections 2026-02-17T20:58:55.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f5484a33640 1 -- 10.20.193.104:0/3567158915 wait complete. 2026-02-17T20:58:55.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f5484a33640 1 Processor -- start 2026-02-17T20:58:55.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f5484a33640 1 -- start start 2026-02-17T20:58:55.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f5484a33640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f54801048c0 0x7f54801a2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:55.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f5484a33640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f548010a8c0 0x7f54801a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:55.239 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f5484a33640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f5480111b00 con 0x7f548010a8c0 2026-02-17T20:58:55.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f5484a33640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f5480111980 con 0x7f54801048c0 2026-02-17T20:58:55.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f547dd74640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f548010a8c0 0x7f54801a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:55.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f547dd74640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f548010a8c0 0x7f54801a2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38534/0 (socket says 10.20.193.104:38534) 2026-02-17T20:58:55.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f547dd74640 1 -- 10.20.193.104:0/2053937657 learned_addr learned my addr 10.20.193.104:0/2053937657 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:55.240 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f547e575640 1 --2- 10.20.193.104:0/2053937657 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f54801048c0 0x7f54801a2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:55.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f547dd74640 1 -- 10.20.193.104:0/2053937657 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f54801048c0 msgr2=0x7f54801a2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:55.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f547dd74640 1 --2- 10.20.193.104:0/2053937657 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f54801048c0 0x7f54801a2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:55.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.234+0000 7f547dd74640 1 -- 10.20.193.104:0/2053937657 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548019c6f0 con 0x7f548010a8c0 2026-02-17T20:58:55.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.235+0000 7f547dd74640 1 --2- 10.20.193.104:0/2053937657 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f548010a8c0 0x7f54801a2b60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f546800d900 tx=0x7f546800ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:55.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.235+0000 7f54677fe640 1 -- 10.20.193.104:0/2053937657 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f5468014070 con 0x7f548010a8c0 2026-02-17T20:58:55.241 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.235+0000 7f54677fe640 1 -- 10.20.193.104:0/2053937657 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f54680044a0 con 0x7f548010a8c0 2026-02-17T20:58:55.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.235+0000 7f5484a33640 1 -- 10.20.193.104:0/2053937657 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f548019c9e0 con 0x7f548010a8c0 2026-02-17T20:58:55.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.235+0000 7f54677fe640 1 -- 10.20.193.104:0/2053937657 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f546800be00 con 0x7f548010a8c0 2026-02-17T20:58:55.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.235+0000 7f5484a33640 1 -- 10.20.193.104:0/2053937657 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f548019cf40 con 0x7f548010a8c0 2026-02-17T20:58:55.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.235+0000 7f5484a33640 1 -- 10.20.193.104:0/2053937657 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5480106000 con 0x7f548010a8c0 2026-02-17T20:58:55.242 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.236+0000 7f54677fe640 1 -- 10.20.193.104:0/2053937657 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f54680047c0 con 0x7f548010a8c0 2026-02-17T20:58:55.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.236+0000 7f54677fe640 1 --2- 10.20.193.104:0/2053937657 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f54580775a0 0x7f5458079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:55.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.236+0000 7f547e575640 1 --2- 10.20.193.104:0/2053937657 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f54580775a0 0x7f5458079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:55.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.236+0000 7f54677fe640 1 -- 10.20.193.104:0/2053937657 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 7220+0+0 (secure 0 0 0) 0x7f546809a190 con 0x7f548010a8c0 2026-02-17T20:58:55.244 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.236+0000 7f547e575640 1 --2- 10.20.193.104:0/2053937657 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f54580775a0 0x7f5458079a60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5474009980 tx=0x7f547403a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:55.245 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.238+0000 7f54677fe640 1 -- 10.20.193.104:0/2053937657 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f5468066be0 con 0x7f548010a8c0 2026-02-17T20:58:55.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.338+0000 7f5484a33640 1 -- 10.20.193.104:0/2053937657 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f548019d1f0 con 0x7f548010a8c0 2026-02-17T20:58:55.341 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.338+0000 7f54677fe640 1 -- 10.20.193.104:0/2053937657 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) ==== 53+0+148 (secure 0 0 0) 0x7f546806ba90 con 0x7f548010a8c0 2026-02-17T20:58:55.341 INFO:teuthology.orchestra.run.trial104.stdout:name: foo, metadata pool: cephfs.foo.meta, data pools: [cephfs.foo.data ] 2026-02-17T20:58:55.342 INFO:teuthology.orchestra.run.trial104.stdout:name: bar, metadata pool: cephfs.bar.meta, data pools: [cephfs.bar.data ] 2026-02-17T20:58:55.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.339+0000 7f5484a33640 1 -- 10.20.193.104:0/2053937657 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f54580775a0 msgr2=0x7f5458079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:55.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.339+0000 7f5484a33640 1 --2- 10.20.193.104:0/2053937657 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f54580775a0 0x7f5458079a60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5474009980 tx=0x7f547403a040 comp rx=0 tx=0).stop 2026-02-17T20:58:55.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.339+0000 7f5484a33640 1 -- 10.20.193.104:0/2053937657 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f548010a8c0 msgr2=0x7f54801a2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:55.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.339+0000 7f5484a33640 1 --2- 10.20.193.104:0/2053937657 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f548010a8c0 0x7f54801a2b60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f546800d900 tx=0x7f546800ddd0 comp rx=0 tx=0).stop 2026-02-17T20:58:55.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.339+0000 7f5484a33640 1 -- 10.20.193.104:0/2053937657 shutdown_connections 2026-02-17T20:58:55.343 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.339+0000 7f5484a33640 1 --2- 10.20.193.104:0/2053937657 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f54580775a0 0x7f5458079a60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:55.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.339+0000 7f5484a33640 1 --2- 10.20.193.104:0/2053937657 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f548010a8c0 0x7f54801a2b60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:55.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.339+0000 7f5484a33640 1 --2- 10.20.193.104:0/2053937657 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f54801048c0 0x7f54801a2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:55.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.339+0000 7f5484a33640 1 -- 10.20.193.104:0/2053937657 >> 10.20.193.104:0/2053937657 conn(0x7f54801005c0 msgr2=0x7f5480101330 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:55.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.339+0000 7f5484a33640 1 -- 10.20.193.104:0/2053937657 shutdown_connections 2026-02-17T20:58:55.344 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55.339+0000 7f5484a33640 1 -- 10.20.193.104:0/2053937657 wait complete. 2026-02-17T20:58:55.376 INFO:tasks.cephfs.mount:Mounting Ceph FS foo; just confirmed its presence on cluster 2026-02-17T20:58:55.376 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2026-02-17T20:58:55.376 INFO:tasks.cephfs.mount:self.client_remote.hostname = trial104.front.sepia.ceph.com 2026-02-17T20:58:55.377 INFO:tasks.cephfs.mount:self.client.name = client.0 2026-02-17T20:58:55.377 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2026-02-17T20:58:55.377 INFO:tasks.cephfs.mount:self.cephfs_name = foo 2026-02-17T20:58:55.377 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2026-02-17T20:58:55.377 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2026-02-17T20:58:55.377 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2026-02-17T20:58:55.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:58:55.377 DEBUG:teuthology.orchestra.run.trial104:> ip addr 2026-02-17T20:58:55.395 INFO:teuthology.orchestra.run.trial104.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2026-02-17T20:58:55.395 INFO:teuthology.orchestra.run.trial104.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2026-02-17T20:58:55.395 INFO:teuthology.orchestra.run.trial104.stdout: inet 127.0.0.1/8 scope host lo 2026-02-17T20:58:55.395 INFO:teuthology.orchestra.run.trial104.stdout: valid_lft forever preferred_lft forever 2026-02-17T20:58:55.395 INFO:teuthology.orchestra.run.trial104.stdout: inet6 ::1/128 scope host 2026-02-17T20:58:55.395 INFO:teuthology.orchestra.run.trial104.stdout: valid_lft forever preferred_lft forever 2026-02-17T20:58:55.395 INFO:teuthology.orchestra.run.trial104.stdout:2: enp7s0f4u2u2c2: mtu 1500 qdisc fq_codel state UNKNOWN group default qlen 1000 2026-02-17T20:58:55.396 INFO:teuthology.orchestra.run.trial104.stdout: link/ether a6:3f:e1:df:df:ad brd ff:ff:ff:ff:ff:ff 2026-02-17T20:58:55.396 INFO:teuthology.orchestra.run.trial104.stdout: inet 169.254.3.1/24 brd 169.254.3.255 scope link dynamic noprefixroute enp7s0f4u2u2c2 2026-02-17T20:58:55.396 INFO:teuthology.orchestra.run.trial104.stdout: valid_lft 863691sec preferred_lft 863691sec 2026-02-17T20:58:55.396 INFO:teuthology.orchestra.run.trial104.stdout: inet6 fe80::e028:ad31:1ea:b356/64 scope link noprefixroute 2026-02-17T20:58:55.396 INFO:teuthology.orchestra.run.trial104.stdout: valid_lft forever preferred_lft forever 2026-02-17T20:58:55.396 INFO:teuthology.orchestra.run.trial104.stdout:3: enp1s0f0: mtu 1500 qdisc mq state UP group default qlen 1000 2026-02-17T20:58:55.396 INFO:teuthology.orchestra.run.trial104.stdout: link/ether 90:5a:08:77:64:5e brd ff:ff:ff:ff:ff:ff 2026-02-17T20:58:55.396 INFO:teuthology.orchestra.run.trial104.stdout: inet 10.20.193.104/20 brd 10.20.207.255 scope global dynamic noprefixroute enp1s0f0 2026-02-17T20:58:55.396 INFO:teuthology.orchestra.run.trial104.stdout: valid_lft 591sec preferred_lft 591sec 2026-02-17T20:58:55.396 INFO:teuthology.orchestra.run.trial104.stdout: inet6 fe80::925a:8ff:fe77:645e/64 scope link 2026-02-17T20:58:55.396 INFO:teuthology.orchestra.run.trial104.stdout: valid_lft forever preferred_lft forever 2026-02-17T20:58:55.397 INFO:teuthology.orchestra.run.trial104.stdout:4: enp1s0f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2026-02-17T20:58:55.397 INFO:teuthology.orchestra.run.trial104.stdout: link/ether 90:5a:08:77:64:5f brd ff:ff:ff:ff:ff:ff 2026-02-17T20:58:55.397 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.159.254/20 2026-02-17T20:58:55.398 DEBUG:teuthology.orchestra.run.trial104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-17T20:58:55.398 DEBUG:teuthology.orchestra.run.trial104:> set -e 2026-02-17T20:58:55.398 DEBUG:teuthology.orchestra.run.trial104:> sudo ip link add name ceph-brx type bridge 2026-02-17T20:58:55.398 DEBUG:teuthology.orchestra.run.trial104:> sudo ip addr flush dev ceph-brx 2026-02-17T20:58:55.398 DEBUG:teuthology.orchestra.run.trial104:> sudo ip link set ceph-brx up 2026-02-17T20:58:55.398 DEBUG:teuthology.orchestra.run.trial104:> sudo ip addr add 192.168.159.254/20 brd 192.168.159.255 dev ceph-brx 2026-02-17T20:58:55.398 DEBUG:teuthology.orchestra.run.trial104:> ') 2026-02-17T20:58:55.469 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-17T20:58:55.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:55 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/4187637321' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2026-02-17T20:58:55.541 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-17T20:58:55.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:58:55.546 DEBUG:teuthology.orchestra.run.trial104:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2026-02-17T20:58:55.611 INFO:teuthology.orchestra.run.trial104.stdout:1 2026-02-17T20:58:55.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:58:55.613 DEBUG:teuthology.orchestra.run.trial104:> ip r 2026-02-17T20:58:55.669 INFO:teuthology.orchestra.run.trial104.stdout:default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.104 metric 102 2026-02-17T20:58:55.670 INFO:teuthology.orchestra.run.trial104.stdout:10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.104 metric 102 2026-02-17T20:58:55.670 INFO:teuthology.orchestra.run.trial104.stdout:169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-17T20:58:55.670 INFO:teuthology.orchestra.run.trial104.stdout:192.168.144.0/20 dev ceph-brx proto kernel scope link src 192.168.159.254 2026-02-17T20:58:55.671 DEBUG:teuthology.orchestra.run.trial104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-17T20:58:55.671 DEBUG:teuthology.orchestra.run.trial104:> set -e 2026-02-17T20:58:55.671 DEBUG:teuthology.orchestra.run.trial104:> sudo iptables -A FORWARD -o enp1s0f0 -i ceph-brx -j ACCEPT 2026-02-17T20:58:55.671 DEBUG:teuthology.orchestra.run.trial104:> sudo iptables -A FORWARD -i enp1s0f0 -o ceph-brx -j ACCEPT 2026-02-17T20:58:55.671 DEBUG:teuthology.orchestra.run.trial104:> sudo iptables -t nat -A POSTROUTING -s 192.168.159.254/20 -o enp1s0f0 -j MASQUERADE 2026-02-17T20:58:55.671 DEBUG:teuthology.orchestra.run.trial104:> ') 2026-02-17T20:58:55.747 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-17T20:58:55.874 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-17T20:58:55.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:58:55.880 DEBUG:teuthology.orchestra.run.trial104:> ip netns list 2026-02-17T20:58:55.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:58:55.938 DEBUG:teuthology.orchestra.run.trial104:> ip netns list-id 2026-02-17T20:58:55.994 DEBUG:teuthology.orchestra.run.trial104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-17T20:58:55.994 DEBUG:teuthology.orchestra.run.trial104:> set -e 2026-02-17T20:58:55.994 DEBUG:teuthology.orchestra.run.trial104:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-17T20:58:55.995 DEBUG:teuthology.orchestra.run.trial104:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2026-02-17T20:58:55.995 DEBUG:teuthology.orchestra.run.trial104:> ') 2026-02-17T20:58:56.069 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-17T20:58:56.090 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-17T20:58:56.094 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.144.1/20 2026-02-17T20:58:56.095 DEBUG:teuthology.orchestra.run.trial104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-17T20:58:56.095 DEBUG:teuthology.orchestra.run.trial104:> set -e 2026-02-17T20:58:56.095 DEBUG:teuthology.orchestra.run.trial104:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2026-02-17T20:58:56.095 DEBUG:teuthology.orchestra.run.trial104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.144.1/20 brd 192.168.159.255 dev veth0 2026-02-17T20:58:56.095 DEBUG:teuthology.orchestra.run.trial104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2026-02-17T20:58:56.095 DEBUG:teuthology.orchestra.run.trial104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2026-02-17T20:58:56.095 DEBUG:teuthology.orchestra.run.trial104:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.159.254 2026-02-17T20:58:56.095 DEBUG:teuthology.orchestra.run.trial104:> ') 2026-02-17T20:58:56.170 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-17T20:58:56.224 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-17T20:58:56.230 DEBUG:teuthology.orchestra.run.trial104:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-17T20:58:56.230 DEBUG:teuthology.orchestra.run.trial104:> set -e 2026-02-17T20:58:56.230 DEBUG:teuthology.orchestra.run.trial104:> sudo ip link set brx.0 up 2026-02-17T20:58:56.230 DEBUG:teuthology.orchestra.run.trial104:> sudo ip link set dev brx.0 master ceph-brx 2026-02-17T20:58:56.230 DEBUG:teuthology.orchestra.run.trial104:> ') 2026-02-17T20:58:56.305 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-17T20:58:56.312 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:56 trial104 ceph-mon[20612]: mds.? [v2:10.20.193.104:6836/347975304,v1:10.20.193.104:6837/347975304] up:standby 2026-02-17T20:58:56.312 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:56 trial104 ceph-mon[20612]: fsmap foo:1 bar:1 {bar:0=bar.trial153.cedikz=up:active,foo:0=foo.trial104.gnmuyp=up:active} 2 up:standby 2026-02-17T20:58:56.312 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:56.312 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:56 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/2053937657' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2026-02-17T20:58:56.313 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:56 trial104 ceph-mon[20612]: pgmap v101: 129 pgs: 129 active+clean; 581 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 14 op/s 2026-02-17T20:58:56.328 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-17T20:58:56.333 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'cephfs_name': 'foo'} 2026-02-17T20:58:56.333 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-17T20:58:56.334 DEBUG:teuthology.orchestra.run.trial104:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2026-02-17T20:58:56.390 INFO:teuthology.orchestra.run.trial104.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2026-02-17T20:58:56.390 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-17T20:58:56.391 DEBUG:teuthology.orchestra.run.trial104:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2026-02-17T20:58:56.446 DEBUG:teuthology.orchestra.run.trial104:> sudo modprobe fuse 2026-02-17T20:58:56.511 DEBUG:teuthology.orchestra.run.trial104:> cat /proc/self/mounts | awk '{print $2}' 2026-02-17T20:58:56.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:56 trial153 ceph-mon[25357]: mds.? [v2:10.20.193.104:6836/347975304,v1:10.20.193.104:6837/347975304] up:standby 2026-02-17T20:58:56.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:56 trial153 ceph-mon[25357]: fsmap foo:1 bar:1 {bar:0=bar.trial153.cedikz=up:active,foo:0=foo.trial104.gnmuyp=up:active} 2 up:standby 2026-02-17T20:58:56.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:58:56.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:56 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/2053937657' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2026-02-17T20:58:56.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:56 trial153 ceph-mon[25357]: pgmap v101: 129 pgs: 129 active+clean; 581 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 682 B/s wr, 14 op/s 2026-02-17T20:58:56.569 INFO:teuthology.orchestra.run.trial104.stdout:/proc 2026-02-17T20:58:56.570 INFO:teuthology.orchestra.run.trial104.stdout:/sys 2026-02-17T20:58:56.570 INFO:teuthology.orchestra.run.trial104.stdout:/dev 2026-02-17T20:58:56.570 INFO:teuthology.orchestra.run.trial104.stdout:/sys/kernel/security 2026-02-17T20:58:56.570 INFO:teuthology.orchestra.run.trial104.stdout:/dev/shm 2026-02-17T20:58:56.570 INFO:teuthology.orchestra.run.trial104.stdout:/dev/pts 2026-02-17T20:58:56.570 INFO:teuthology.orchestra.run.trial104.stdout:/run 2026-02-17T20:58:56.570 INFO:teuthology.orchestra.run.trial104.stdout:/sys/fs/cgroup 2026-02-17T20:58:56.570 INFO:teuthology.orchestra.run.trial104.stdout:/sys/fs/pstore 2026-02-17T20:58:56.570 INFO:teuthology.orchestra.run.trial104.stdout:/sys/firmware/efi/efivars 2026-02-17T20:58:56.570 INFO:teuthology.orchestra.run.trial104.stdout:/sys/fs/bpf 2026-02-17T20:58:56.571 INFO:teuthology.orchestra.run.trial104.stdout:/sys/kernel/config 2026-02-17T20:58:56.571 INFO:teuthology.orchestra.run.trial104.stdout:/ 2026-02-17T20:58:56.571 INFO:teuthology.orchestra.run.trial104.stdout:/sys/fs/selinux 2026-02-17T20:58:56.571 INFO:teuthology.orchestra.run.trial104.stdout:/proc/sys/fs/binfmt_misc 2026-02-17T20:58:56.571 INFO:teuthology.orchestra.run.trial104.stdout:/dev/hugepages 2026-02-17T20:58:56.571 INFO:teuthology.orchestra.run.trial104.stdout:/dev/mqueue 2026-02-17T20:58:56.571 INFO:teuthology.orchestra.run.trial104.stdout:/sys/kernel/debug 2026-02-17T20:58:56.571 INFO:teuthology.orchestra.run.trial104.stdout:/sys/kernel/tracing 2026-02-17T20:58:56.571 INFO:teuthology.orchestra.run.trial104.stdout:/sys/fs/fuse/connections 2026-02-17T20:58:56.571 INFO:teuthology.orchestra.run.trial104.stdout:/run/credentials/systemd-sysctl.service 2026-02-17T20:58:56.571 INFO:teuthology.orchestra.run.trial104.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2026-02-17T20:58:56.572 INFO:teuthology.orchestra.run.trial104.stdout:/boot/efi 2026-02-17T20:58:56.572 INFO:teuthology.orchestra.run.trial104.stdout:/run/credentials/systemd-tmpfiles-setup.service 2026-02-17T20:58:56.572 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/nfs/rpc_pipefs 2026-02-17T20:58:56.572 INFO:teuthology.orchestra.run.trial104.stdout:/run/user/1000 2026-02-17T20:58:56.572 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/ceph 2026-02-17T20:58:56.572 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay 2026-02-17T20:58:56.572 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/32dacc8ff1b1e3f11629b9b0fd9702e58e26c332edcb7d49bf24d77e3709b319/merged 2026-02-17T20:58:56.572 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/c3f35380742edb55398d0c6bbaaea038d47980494c8b5fc921523d5acf465f23/merged 2026-02-17T20:58:56.572 INFO:teuthology.orchestra.run.trial104.stdout:/run/user/0 2026-02-17T20:58:56.572 INFO:teuthology.orchestra.run.trial104.stdout:/proc/sys/fs/binfmt_misc 2026-02-17T20:58:56.572 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/8d141a51328cd48fdb246930459838c1ca0cae66d66a08696103b01b7d87750e/merged 2026-02-17T20:58:56.572 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/3a483834ad9e37d2c386f506fdba564dc86dec3b34a33301271ffc76188c93cc/merged 2026-02-17T20:58:56.573 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/8c42e967ae9a3ee4652b2fa7e2d1cfc45007ef832cc53bd7b15fafd3ffcf293b/merged 2026-02-17T20:58:56.573 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/9081f17405dbb9cd341f5e74c00d99430ccf8a90a3822fb886e9822d51ff25e7/merged 2026-02-17T20:58:56.573 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/144f546a6985580c2cc15c876304789ed0decf297c2e068cb75b113e8e588dc4/merged 2026-02-17T20:58:56.573 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/417b31db64f9c2b6cd5a11fb1ab89b050051c11d071ebe75ed1e940c396dc310/merged 2026-02-17T20:58:56.573 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/c109abf4500e69158f7858d0ff15c2132cd4a1ad26b7ce0c25e4c11c7f40db22/merged 2026-02-17T20:58:56.573 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/1bae539107a5266ce84b07ee64557b8e2cf1ea69a42086ead17959824de904b1/merged 2026-02-17T20:58:56.573 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/2001c86622aedda3163f38ad139bafd9a66aeff5a2c2983f83029f67cb5fe32a/merged 2026-02-17T20:58:56.573 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/b0db91605f25e7338e39c1819a00beb5a570807e2d004e82ab33eed40c11193c/merged 2026-02-17T20:58:56.573 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/57ab8cb498ddc711d645c41ae8242f36604c4f716740b019a7eb481fe83aaf6a/merged 2026-02-17T20:58:56.573 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/3d851619b6aa949ab93fdea3d6f968a54344060bdf5163e4ac2dd9ea6681f0cb/merged 2026-02-17T20:58:56.573 INFO:teuthology.orchestra.run.trial104.stdout:/run/netns 2026-02-17T20:58:56.573 INFO:teuthology.orchestra.run.trial104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-17T20:58:56.574 INFO:teuthology.orchestra.run.trial104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-17T20:58:56.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:58:56.574 DEBUG:teuthology.orchestra.run.trial104:> ls /sys/fs/fuse/connections 2026-02-17T20:58:56.626 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2026-02-17T20:58:56.627 DEBUG:teuthology.orchestra.run.trial104:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_fs=foo) 2026-02-17T20:58:56.669 DEBUG:teuthology.orchestra.run.trial104:> sudo modprobe fuse 2026-02-17T20:58:56.693 DEBUG:teuthology.orchestra.run.trial104:> cat /proc/self/mounts | awk '{print $2}' 2026-02-17T20:58:56.749 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.trial104.stderr:2026-02-17T20:58:56.748+0000 7fbffc00c580 -1 init, newargv = 0x55ec2a5f5340 newargc=15 2026-02-17T20:58:56.750 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.trial104.stderr:ceph-fuse[71016]: starting ceph client 2026-02-17T20:58:56.751 INFO:teuthology.orchestra.run.trial104.stdout:/proc 2026-02-17T20:58:56.752 INFO:teuthology.orchestra.run.trial104.stdout:/sys 2026-02-17T20:58:56.752 INFO:teuthology.orchestra.run.trial104.stdout:/dev 2026-02-17T20:58:56.752 INFO:teuthology.orchestra.run.trial104.stdout:/sys/kernel/security 2026-02-17T20:58:56.752 INFO:teuthology.orchestra.run.trial104.stdout:/dev/shm 2026-02-17T20:58:56.752 INFO:teuthology.orchestra.run.trial104.stdout:/dev/pts 2026-02-17T20:58:56.752 INFO:teuthology.orchestra.run.trial104.stdout:/run 2026-02-17T20:58:56.752 INFO:teuthology.orchestra.run.trial104.stdout:/sys/fs/cgroup 2026-02-17T20:58:56.752 INFO:teuthology.orchestra.run.trial104.stdout:/sys/fs/pstore 2026-02-17T20:58:56.752 INFO:teuthology.orchestra.run.trial104.stdout:/sys/firmware/efi/efivars 2026-02-17T20:58:56.752 INFO:teuthology.orchestra.run.trial104.stdout:/sys/fs/bpf 2026-02-17T20:58:56.753 INFO:teuthology.orchestra.run.trial104.stdout:/sys/kernel/config 2026-02-17T20:58:56.753 INFO:teuthology.orchestra.run.trial104.stdout:/ 2026-02-17T20:58:56.753 INFO:teuthology.orchestra.run.trial104.stdout:/sys/fs/selinux 2026-02-17T20:58:56.753 INFO:teuthology.orchestra.run.trial104.stdout:/proc/sys/fs/binfmt_misc 2026-02-17T20:58:56.753 INFO:teuthology.orchestra.run.trial104.stdout:/dev/hugepages 2026-02-17T20:58:56.753 INFO:teuthology.orchestra.run.trial104.stdout:/dev/mqueue 2026-02-17T20:58:56.753 INFO:teuthology.orchestra.run.trial104.stdout:/sys/kernel/debug 2026-02-17T20:58:56.753 INFO:teuthology.orchestra.run.trial104.stdout:/sys/kernel/tracing 2026-02-17T20:58:56.753 INFO:teuthology.orchestra.run.trial104.stdout:/sys/fs/fuse/connections 2026-02-17T20:58:56.753 INFO:teuthology.orchestra.run.trial104.stdout:/run/credentials/systemd-sysctl.service 2026-02-17T20:58:56.753 INFO:teuthology.orchestra.run.trial104.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2026-02-17T20:58:56.753 INFO:teuthology.orchestra.run.trial104.stdout:/boot/efi 2026-02-17T20:58:56.754 INFO:teuthology.orchestra.run.trial104.stdout:/run/credentials/systemd-tmpfiles-setup.service 2026-02-17T20:58:56.754 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/nfs/rpc_pipefs 2026-02-17T20:58:56.754 INFO:teuthology.orchestra.run.trial104.stdout:/run/user/1000 2026-02-17T20:58:56.754 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/ceph 2026-02-17T20:58:56.754 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay 2026-02-17T20:58:56.754 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/32dacc8ff1b1e3f11629b9b0fd9702e58e26c332edcb7d49bf24d77e3709b319/merged 2026-02-17T20:58:56.754 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/c3f35380742edb55398d0c6bbaaea038d47980494c8b5fc921523d5acf465f23/merged 2026-02-17T20:58:56.754 INFO:teuthology.orchestra.run.trial104.stdout:/run/user/0 2026-02-17T20:58:56.754 INFO:teuthology.orchestra.run.trial104.stdout:/proc/sys/fs/binfmt_misc 2026-02-17T20:58:56.754 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/8d141a51328cd48fdb246930459838c1ca0cae66d66a08696103b01b7d87750e/merged 2026-02-17T20:58:56.754 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/3a483834ad9e37d2c386f506fdba564dc86dec3b34a33301271ffc76188c93cc/merged 2026-02-17T20:58:56.754 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/8c42e967ae9a3ee4652b2fa7e2d1cfc45007ef832cc53bd7b15fafd3ffcf293b/merged 2026-02-17T20:58:56.755 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/9081f17405dbb9cd341f5e74c00d99430ccf8a90a3822fb886e9822d51ff25e7/merged 2026-02-17T20:58:56.755 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/144f546a6985580c2cc15c876304789ed0decf297c2e068cb75b113e8e588dc4/merged 2026-02-17T20:58:56.755 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/417b31db64f9c2b6cd5a11fb1ab89b050051c11d071ebe75ed1e940c396dc310/merged 2026-02-17T20:58:56.755 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/c109abf4500e69158f7858d0ff15c2132cd4a1ad26b7ce0c25e4c11c7f40db22/merged 2026-02-17T20:58:56.755 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/1bae539107a5266ce84b07ee64557b8e2cf1ea69a42086ead17959824de904b1/merged 2026-02-17T20:58:56.755 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/2001c86622aedda3163f38ad139bafd9a66aeff5a2c2983f83029f67cb5fe32a/merged 2026-02-17T20:58:56.755 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/b0db91605f25e7338e39c1819a00beb5a570807e2d004e82ab33eed40c11193c/merged 2026-02-17T20:58:56.755 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/57ab8cb498ddc711d645c41ae8242f36604c4f716740b019a7eb481fe83aaf6a/merged 2026-02-17T20:58:56.755 INFO:teuthology.orchestra.run.trial104.stdout:/var/lib/containers/storage/overlay/3d851619b6aa949ab93fdea3d6f968a54344060bdf5163e4ac2dd9ea6681f0cb/merged 2026-02-17T20:58:56.755 INFO:teuthology.orchestra.run.trial104.stdout:/run/netns 2026-02-17T20:58:56.755 INFO:teuthology.orchestra.run.trial104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-17T20:58:56.755 INFO:teuthology.orchestra.run.trial104.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-17T20:58:56.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:58:56.757 DEBUG:teuthology.orchestra.run.trial104:> ls /sys/fs/fuse/connections 2026-02-17T20:58:56.757 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.trial104.stderr:ceph-fuse[71016]: starting fuse 2026-02-17T20:58:56.813 INFO:teuthology.orchestra.run.trial104.stdout:43 2026-02-17T20:58:56.814 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2026-02-17T20:58:56.814 DEBUG:teuthology.orchestra.run.trial104:> sudo stdin-killer -- python3 -c ' 2026-02-17T20:58:56.814 DEBUG:teuthology.orchestra.run.trial104:> import glob 2026-02-17T20:58:56.814 DEBUG:teuthology.orchestra.run.trial104:> import re 2026-02-17T20:58:56.815 DEBUG:teuthology.orchestra.run.trial104:> import os 2026-02-17T20:58:56.815 DEBUG:teuthology.orchestra.run.trial104:> import subprocess 2026-02-17T20:58:56.815 DEBUG:teuthology.orchestra.run.trial104:> 2026-02-17T20:58:56.815 DEBUG:teuthology.orchestra.run.trial104:> def _find_admin_socket(client_name): 2026-02-17T20:58:56.815 DEBUG:teuthology.orchestra.run.trial104:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2026-02-17T20:58:56.815 DEBUG:teuthology.orchestra.run.trial104:> files = glob.glob(asok_path) 2026-02-17T20:58:56.815 DEBUG:teuthology.orchestra.run.trial104:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2026-02-17T20:58:56.815 DEBUG:teuthology.orchestra.run.trial104:> 2026-02-17T20:58:56.815 DEBUG:teuthology.orchestra.run.trial104:> # Given a non-glob path, it better be there 2026-02-17T20:58:56.815 DEBUG:teuthology.orchestra.run.trial104:> if "*" not in asok_path: 2026-02-17T20:58:56.815 DEBUG:teuthology.orchestra.run.trial104:> assert(len(files) == 1) 2026-02-17T20:58:56.815 DEBUG:teuthology.orchestra.run.trial104:> return files[0] 2026-02-17T20:58:56.815 DEBUG:teuthology.orchestra.run.trial104:> 2026-02-17T20:58:56.816 DEBUG:teuthology.orchestra.run.trial104:> for f in files: 2026-02-17T20:58:56.816 DEBUG:teuthology.orchestra.run.trial104:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2026-02-17T20:58:56.816 DEBUG:teuthology.orchestra.run.trial104:> if os.path.exists("/proc/{0}".format(pid)): 2026-02-17T20:58:56.816 DEBUG:teuthology.orchestra.run.trial104:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2026-02-17T20:58:56.816 DEBUG:teuthology.orchestra.run.trial104:> contents = proc_f.read() 2026-02-17T20:58:56.816 DEBUG:teuthology.orchestra.run.trial104:> if mountpoint in contents: 2026-02-17T20:58:56.816 DEBUG:teuthology.orchestra.run.trial104:> return f 2026-02-17T20:58:56.816 DEBUG:teuthology.orchestra.run.trial104:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2026-02-17T20:58:56.816 DEBUG:teuthology.orchestra.run.trial104:> 2026-02-17T20:58:56.816 DEBUG:teuthology.orchestra.run.trial104:> print(_find_admin_socket("client.0")) 2026-02-17T20:58:56.816 DEBUG:teuthology.orchestra.run.trial104:> ' 2026-02-17T20:58:56.907 INFO:teuthology.orchestra.run.trial104.stdout:/var/run/ceph/ceph-client.0.71016.asok 2026-02-17T20:58:56.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-17T20:58:56.914 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.71016.asok 2026-02-17T20:58:56.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:58:56.915 DEBUG:teuthology.orchestra.run.trial104:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.71016.asok status 2026-02-17T20:58:57.019 INFO:teuthology.orchestra.run.trial104.stdout:{ 2026-02-17T20:58:57.019 INFO:teuthology.orchestra.run.trial104.stdout: "metadata": { 2026-02-17T20:58:57.019 INFO:teuthology.orchestra.run.trial104.stdout: "ceph_sha1": "76b494d6529326129dc43abf3fffd48fbf35c395", 2026-02-17T20:58:57.020 INFO:teuthology.orchestra.run.trial104.stdout: "ceph_version": "ceph version 19.2.3-683-g76b494d6 (76b494d6529326129dc43abf3fffd48fbf35c395) squid (stable)", 2026-02-17T20:58:57.020 INFO:teuthology.orchestra.run.trial104.stdout: "entity_id": "0", 2026-02-17T20:58:57.020 INFO:teuthology.orchestra.run.trial104.stdout: "hostname": "trial104", 2026-02-17T20:58:57.020 INFO:teuthology.orchestra.run.trial104.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2026-02-17T20:58:57.020 INFO:teuthology.orchestra.run.trial104.stdout: "pid": "71016", 2026-02-17T20:58:57.020 INFO:teuthology.orchestra.run.trial104.stdout: "root": "/" 2026-02-17T20:58:57.020 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-17T20:58:57.020 INFO:teuthology.orchestra.run.trial104.stdout: "dentry_count": 0, 2026-02-17T20:58:57.020 INFO:teuthology.orchestra.run.trial104.stdout: "dentry_pinned_count": 0, 2026-02-17T20:58:57.020 INFO:teuthology.orchestra.run.trial104.stdout: "id": 14594, 2026-02-17T20:58:57.020 INFO:teuthology.orchestra.run.trial104.stdout: "inst": { 2026-02-17T20:58:57.021 INFO:teuthology.orchestra.run.trial104.stdout: "name": { 2026-02-17T20:58:57.021 INFO:teuthology.orchestra.run.trial104.stdout: "type": "client", 2026-02-17T20:58:57.021 INFO:teuthology.orchestra.run.trial104.stdout: "num": 14594 2026-02-17T20:58:57.021 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-17T20:58:57.021 INFO:teuthology.orchestra.run.trial104.stdout: "addr": { 2026-02-17T20:58:57.021 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-17T20:58:57.021 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "192.168.144.1:0", 2026-02-17T20:58:57.021 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 835706642 2026-02-17T20:58:57.021 INFO:teuthology.orchestra.run.trial104.stdout: } 2026-02-17T20:58:57.021 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-17T20:58:57.021 INFO:teuthology.orchestra.run.trial104.stdout: "addr": { 2026-02-17T20:58:57.021 INFO:teuthology.orchestra.run.trial104.stdout: "type": "v1", 2026-02-17T20:58:57.022 INFO:teuthology.orchestra.run.trial104.stdout: "addr": "192.168.144.1:0", 2026-02-17T20:58:57.022 INFO:teuthology.orchestra.run.trial104.stdout: "nonce": 835706642 2026-02-17T20:58:57.022 INFO:teuthology.orchestra.run.trial104.stdout: }, 2026-02-17T20:58:57.022 INFO:teuthology.orchestra.run.trial104.stdout: "inst_str": "client.14594 192.168.144.1:0/835706642", 2026-02-17T20:58:57.022 INFO:teuthology.orchestra.run.trial104.stdout: "addr_str": "192.168.144.1:0/835706642", 2026-02-17T20:58:57.022 INFO:teuthology.orchestra.run.trial104.stdout: "inode_count": 1, 2026-02-17T20:58:57.022 INFO:teuthology.orchestra.run.trial104.stdout: "mds_epoch": 9, 2026-02-17T20:58:57.022 INFO:teuthology.orchestra.run.trial104.stdout: "osd_epoch": 57, 2026-02-17T20:58:57.022 INFO:teuthology.orchestra.run.trial104.stdout: "osd_epoch_barrier": 0, 2026-02-17T20:58:57.022 INFO:teuthology.orchestra.run.trial104.stdout: "blocklisted": false, 2026-02-17T20:58:57.022 INFO:teuthology.orchestra.run.trial104.stdout: "fs_name": "foo" 2026-02-17T20:58:57.022 INFO:teuthology.orchestra.run.trial104.stdout:} 2026-02-17T20:58:57.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:58:57.025 DEBUG:teuthology.orchestra.run.trial104:> stat --file-system '--printf=%T 2026-02-17T20:58:57.025 DEBUG:teuthology.orchestra.run.trial104:> ' -- /home/ubuntu/cephtest/mnt.0 2026-02-17T20:58:57.042 INFO:teuthology.orchestra.run.trial104.stdout:fuseblk 2026-02-17T20:58:57.042 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2026-02-17T20:58:57.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:58:57.043 DEBUG:teuthology.orchestra.run.trial104:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2026-02-17T20:58:57.108 INFO:teuthology.run_tasks:Running task ceph-fuse... 2026-02-17T20:58:57.123 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2026-02-17T20:58:57.123 INFO:tasks.ceph_fuse:config is {'client.1': {'cephfs_name': 'bar'}} 2026-02-17T20:58:57.123 INFO:tasks.ceph_fuse:client.1 config is {'cephfs_name': 'bar'} 2026-02-17T20:58:57.124 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2026-02-17T20:58:57.124 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2026-02-17T20:58:57.124 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:58:57.124 DEBUG:teuthology.orchestra.run.trial104:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-17T20:58:57.168 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:58:57.168 DEBUG:teuthology.orchestra.run.trial104:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-17T20:58:57.227 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd blocklist ls 2026-02-17T20:58:57.426 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:57.538 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.534+0000 7f0ec8c77640 1 -- 10.20.193.104:0/343896083 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0ec410a8b0 msgr2=0x7f0ec410ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:57.538 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.534+0000 7f0ec8c77640 1 --2- 10.20.193.104:0/343896083 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0ec410a8b0 0x7f0ec410ac90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0eb80099b0 tx=0x7f0eb802f220 comp rx=0 tx=0).stop 2026-02-17T20:58:57.538 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.534+0000 7f0ec8c77640 1 -- 10.20.193.104:0/343896083 shutdown_connections 2026-02-17T20:58:57.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.534+0000 7f0ec8c77640 1 --2- 10.20.193.104:0/343896083 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0ec41048b0 0x7f0ec4104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:57.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.534+0000 7f0ec8c77640 1 --2- 10.20.193.104:0/343896083 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0ec410a8b0 0x7f0ec410ac90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:57.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.534+0000 7f0ec8c77640 1 -- 10.20.193.104:0/343896083 >> 10.20.193.104:0/343896083 conn(0x7f0ec4100590 msgr2=0x7f0ec41029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:57.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.534+0000 7f0ec8c77640 1 -- 10.20.193.104:0/343896083 shutdown_connections 2026-02-17T20:58:57.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.534+0000 7f0ec8c77640 1 -- 10.20.193.104:0/343896083 wait complete. 2026-02-17T20:58:57.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.534+0000 7f0ec8c77640 1 Processor -- start 2026-02-17T20:58:57.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.534+0000 7f0ec8c77640 1 -- start start 2026-02-17T20:58:57.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.534+0000 7f0ec8c77640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0ec41048b0 0x7f0ec41a2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:57.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.534+0000 7f0ec8c77640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0ec410a8b0 0x7f0ec41a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:57.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.534+0000 7f0ec8c77640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec4111ad0 con 0x7f0ec410a8b0 2026-02-17T20:58:57.539 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.534+0000 7f0ec8c77640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f0ec4111950 con 0x7f0ec41048b0 2026-02-17T20:58:57.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.534+0000 7f0ec1d74640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0ec410a8b0 0x7f0ec41a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:57.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.534+0000 7f0ec1d74640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0ec410a8b0 0x7f0ec41a2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:38552/0 (socket says 10.20.193.104:38552) 2026-02-17T20:58:57.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.534+0000 7f0ec1d74640 1 -- 10.20.193.104:0/1758355915 learned_addr learned my addr 10.20.193.104:0/1758355915 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:57.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.535+0000 7f0ec2575640 1 --2- 10.20.193.104:0/1758355915 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0ec41048b0 0x7f0ec41a2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:57.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.535+0000 7f0ec1d74640 1 -- 10.20.193.104:0/1758355915 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0ec41048b0 msgr2=0x7f0ec41a2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:57.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.535+0000 7f0ec1d74640 1 --2- 10.20.193.104:0/1758355915 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0ec41048b0 0x7f0ec41a2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:57.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.535+0000 7f0ec1d74640 1 -- 10.20.193.104:0/1758355915 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec419c660 con 0x7f0ec410a8b0 2026-02-17T20:58:57.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.535+0000 7f0ec1d74640 1 --2- 10.20.193.104:0/1758355915 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0ec410a8b0 0x7f0ec41a2ad0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00d8d0 tx=0x7f0eac00dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:57.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.535+0000 7f0eab7fe640 1 -- 10.20.193.104:0/1758355915 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0eac014070 con 0x7f0ec410a8b0 2026-02-17T20:58:57.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.535+0000 7f0eab7fe640 1 -- 10.20.193.104:0/1758355915 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f0eac0044a0 con 0x7f0ec410a8b0 2026-02-17T20:58:57.540 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.535+0000 7f0ec8c77640 1 -- 10.20.193.104:0/1758355915 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec419c950 con 0x7f0ec410a8b0 2026-02-17T20:58:57.541 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.535+0000 7f0eab7fe640 1 -- 10.20.193.104:0/1758355915 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f0eac002dc0 con 0x7f0ec410a8b0 2026-02-17T20:58:57.541 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.535+0000 7f0ec8c77640 1 -- 10.20.193.104:0/1758355915 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ec419ceb0 con 0x7f0ec410a8b0 2026-02-17T20:58:57.541 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.535+0000 7f0ec8c77640 1 -- 10.20.193.104:0/1758355915 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ec4105ff0 con 0x7f0ec410a8b0 2026-02-17T20:58:57.541 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.536+0000 7f0eab7fe640 1 -- 10.20.193.104:0/1758355915 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f0eac00b840 con 0x7f0ec410a8b0 2026-02-17T20:58:57.541 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.536+0000 7f0eab7fe640 1 --2- 10.20.193.104:0/1758355915 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0e9c0775a0 0x7f0e9c079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:57.541 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.536+0000 7f0ec2575640 1 --2- 10.20.193.104:0/1758355915 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0e9c0775a0 0x7f0e9c079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:57.541 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.536+0000 7f0eab7fe640 1 -- 10.20.193.104:0/1758355915 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 7220+0+0 (secure 0 0 0) 0x7f0eac09a070 con 0x7f0ec410a8b0 2026-02-17T20:58:57.542 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.537+0000 7f0ec2575640 1 --2- 10.20.193.104:0/1758355915 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0e9c0775a0 0x7f0e9c079a60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009980 tx=0x7f0eb803a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:57.542 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.538+0000 7f0eab7fe640 1 -- 10.20.193.104:0/1758355915 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f0eac066ac0 con 0x7f0ec410a8b0 2026-02-17T20:58:57.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.626+0000 7f0ec8c77640 1 -- 10.20.193.104:0/1758355915 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0ec4104d10 con 0x7f0ec410a8b0 2026-02-17T20:58:57.628 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.626+0000 7f0eab7fe640 1 -- 10.20.193.104:0/1758355915 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v57) ==== 81+0+1021 (secure 0 0 0) 0x7f0eac06b970 con 0x7f0ec410a8b0 2026-02-17T20:58:57.628 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.153:6832/3911303877 2026-02-18T20:58:51.049644+0000 2026-02-17T20:58:57.629 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.153:6833/3911303877 2026-02-18T20:58:51.049644+0000 2026-02-17T20:58:57.629 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/2181220307 2026-02-18T20:57:03.624371+0000 2026-02-17T20:58:57.629 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1441972685 2026-02-18T20:57:03.624371+0000 2026-02-17T20:58:57.629 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1658112270 2026-02-18T20:56:38.012869+0000 2026-02-17T20:58:57.629 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/501037198 2026-02-18T20:56:38.012869+0000 2026-02-17T20:58:57.629 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6801/3247908774 2026-02-18T20:56:38.012869+0000 2026-02-17T20:58:57.629 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/2902766949 2026-02-18T20:56:38.012869+0000 2026-02-17T20:58:57.629 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1424534119 2026-02-18T20:56:47.530062+0000 2026-02-17T20:58:57.629 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/413298199 2026-02-18T20:56:47.530062+0000 2026-02-17T20:58:57.629 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6800/95322277 2026-02-18T20:56:47.530062+0000 2026-02-17T20:58:57.629 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1013639580 2026-02-18T20:57:03.624371+0000 2026-02-17T20:58:57.630 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6801/1034073782 2026-02-18T20:57:03.624371+0000 2026-02-17T20:58:57.630 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6800/3247908774 2026-02-18T20:56:38.012869+0000 2026-02-17T20:58:57.630 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6801/95322277 2026-02-18T20:56:47.530062+0000 2026-02-17T20:58:57.630 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1181662162 2026-02-18T20:56:47.530062+0000 2026-02-17T20:58:57.630 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6800/1034073782 2026-02-18T20:57:03.624371+0000 2026-02-17T20:58:57.631 INFO:teuthology.orchestra.run.trial104.stderr:listed 17 entries 2026-02-17T20:58:57.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.626+0000 7f0ec8c77640 1 -- 10.20.193.104:0/1758355915 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0e9c0775a0 msgr2=0x7f0e9c079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:57.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.626+0000 7f0ec8c77640 1 --2- 10.20.193.104:0/1758355915 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0e9c0775a0 0x7f0e9c079a60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009980 tx=0x7f0eb803a040 comp rx=0 tx=0).stop 2026-02-17T20:58:57.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.626+0000 7f0ec8c77640 1 -- 10.20.193.104:0/1758355915 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0ec410a8b0 msgr2=0x7f0ec41a2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:57.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.626+0000 7f0ec8c77640 1 --2- 10.20.193.104:0/1758355915 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0ec410a8b0 0x7f0ec41a2ad0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0eac00d8d0 tx=0x7f0eac00dda0 comp rx=0 tx=0).stop 2026-02-17T20:58:57.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.627+0000 7f0ec8c77640 1 -- 10.20.193.104:0/1758355915 shutdown_connections 2026-02-17T20:58:57.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.627+0000 7f0ec8c77640 1 --2- 10.20.193.104:0/1758355915 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f0e9c0775a0 0x7f0e9c079a60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:57.631 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.627+0000 7f0ec8c77640 1 --2- 10.20.193.104:0/1758355915 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f0ec410a8b0 0x7f0ec41a2ad0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:57.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.627+0000 7f0ec8c77640 1 --2- 10.20.193.104:0/1758355915 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f0ec41048b0 0x7f0ec41a2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:57.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.627+0000 7f0ec8c77640 1 -- 10.20.193.104:0/1758355915 >> 10.20.193.104:0/1758355915 conn(0x7f0ec4100590 msgr2=0x7f0ec4102720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:57.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.627+0000 7f0ec8c77640 1 -- 10.20.193.104:0/1758355915 shutdown_connections 2026-02-17T20:58:57.632 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:57.627+0000 7f0ec8c77640 1 -- 10.20.193.104:0/1758355915 wait complete. 2026-02-17T20:58:57.683 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:58:57.683 DEBUG:teuthology.orchestra.run.trial104:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-17T20:58:57.704 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd blocklist ls 2026-02-17T20:58:57.899 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:58:57.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:57 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/1758355915' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-17T20:58:58.005 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.001+0000 7fe7b6e72640 1 -- 10.20.193.104:0/2835315505 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe7b01048b0 msgr2=0x7fe7b0104d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:58.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.001+0000 7fe7b6e72640 1 --2- 10.20.193.104:0/2835315505 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe7b01048b0 0x7fe7b0104d10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fe7980099b0 tx=0x7fe79802f220 comp rx=0 tx=0).stop 2026-02-17T20:58:58.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.001+0000 7fe7b6e72640 1 -- 10.20.193.104:0/2835315505 shutdown_connections 2026-02-17T20:58:58.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.001+0000 7fe7b6e72640 1 --2- 10.20.193.104:0/2835315505 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe7b01048b0 0x7fe7b0104d10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:58.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.001+0000 7fe7b6e72640 1 --2- 10.20.193.104:0/2835315505 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe7b010a8b0 0x7fe7b010ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:58.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.001+0000 7fe7b6e72640 1 -- 10.20.193.104:0/2835315505 >> 10.20.193.104:0/2835315505 conn(0x7fe7b0100590 msgr2=0x7fe7b01029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:58.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.001+0000 7fe7b6e72640 1 -- 10.20.193.104:0/2835315505 shutdown_connections 2026-02-17T20:58:58.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.001+0000 7fe7b6e72640 1 -- 10.20.193.104:0/2835315505 wait complete. 2026-02-17T20:58:58.006 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7b6e72640 1 Processor -- start 2026-02-17T20:58:58.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7b6e72640 1 -- start start 2026-02-17T20:58:58.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7b6e72640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe7b01048b0 0x7fe7b01a25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:58.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7b6e72640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe7b010a8b0 0x7fe7b01a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:58.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7b6e72640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b0111af0 con 0x7fe7b010a8b0 2026-02-17T20:58:58.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7b6e72640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b0111970 con 0x7fe7b01048b0 2026-02-17T20:58:58.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7a7fff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe7b010a8b0 0x7fe7b01a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:58.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7a7fff640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe7b010a8b0 0x7fe7b01a2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:55968/0 (socket says 10.20.193.104:55968) 2026-02-17T20:58:58.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7a7fff640 1 -- 10.20.193.104:0/2938702101 learned_addr learned my addr 10.20.193.104:0/2938702101 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:58:58.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7b4be7640 1 --2- 10.20.193.104:0/2938702101 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe7b01048b0 0x7fe7b01a25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:58.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7a7fff640 1 -- 10.20.193.104:0/2938702101 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe7b01048b0 msgr2=0x7fe7b01a25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:58.007 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7a7fff640 1 --2- 10.20.193.104:0/2938702101 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe7b01048b0 0x7fe7b01a25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:58.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7a7fff640 1 -- 10.20.193.104:0/2938702101 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b019c680 con 0x7fe7b010a8b0 2026-02-17T20:58:58.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7a7fff640 1 --2- 10.20.193.104:0/2938702101 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe7b010a8b0 0x7fe7b01a2af0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe79802f730 tx=0x7fe79802fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:58.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7a5ffb640 1 -- 10.20.193.104:0/2938702101 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fe798004260 con 0x7fe7b010a8b0 2026-02-17T20:58:58.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7a5ffb640 1 -- 10.20.193.104:0/2938702101 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fe798004400 con 0x7fe7b010a8b0 2026-02-17T20:58:58.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7b6e72640 1 -- 10.20.193.104:0/2938702101 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7b019c910 con 0x7fe7b010a8b0 2026-02-17T20:58:58.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7a5ffb640 1 -- 10.20.193.104:0/2938702101 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fe7980417b0 con 0x7fe7b010a8b0 2026-02-17T20:58:58.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.002+0000 7fe7b6e72640 1 -- 10.20.193.104:0/2938702101 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7b019ce10 con 0x7fe7b010a8b0 2026-02-17T20:58:58.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.003+0000 7fe7b6e72640 1 -- 10.20.193.104:0/2938702101 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7b0105ff0 con 0x7fe7b010a8b0 2026-02-17T20:58:58.008 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.004+0000 7fe7a5ffb640 1 -- 10.20.193.104:0/2938702101 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7fe7980385d0 con 0x7fe7b010a8b0 2026-02-17T20:58:58.009 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.004+0000 7fe7a5ffb640 1 --2- 10.20.193.104:0/2938702101 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe7800775a0 0x7fe780079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:58:58.009 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.004+0000 7fe7b4be7640 1 --2- 10.20.193.104:0/2938702101 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe7800775a0 0x7fe780079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:58:58.009 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.004+0000 7fe7a5ffb640 1 -- 10.20.193.104:0/2938702101 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 7220+0+0 (secure 0 0 0) 0x7fe79803e070 con 0x7fe7b010a8b0 2026-02-17T20:58:58.010 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.005+0000 7fe7b4be7640 1 --2- 10.20.193.104:0/2938702101 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe7800775a0 0x7fe780079a60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0005fd0 tx=0x7fe7a0005950 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:58:58.010 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.006+0000 7fe7a5ffb640 1 -- 10.20.193.104:0/2938702101 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fe79808b730 con 0x7fe7b010a8b0 2026-02-17T20:58:58.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:57 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/1758355915' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-17T20:58:58.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.094+0000 7fe7b6e72640 1 -- 10.20.193.104:0/2938702101 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe7b0104d10 con 0x7fe7b010a8b0 2026-02-17T20:58:58.096 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.094+0000 7fe7a5ffb640 1 -- 10.20.193.104:0/2938702101 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v57) ==== 81+0+1021 (secure 0 0 0) 0x7fe7980905e0 con 0x7fe7b010a8b0 2026-02-17T20:58:58.097 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.153:6832/3911303877 2026-02-18T20:58:51.049644+0000 2026-02-17T20:58:58.097 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.153:6833/3911303877 2026-02-18T20:58:51.049644+0000 2026-02-17T20:58:58.097 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/2181220307 2026-02-18T20:57:03.624371+0000 2026-02-17T20:58:58.097 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1441972685 2026-02-18T20:57:03.624371+0000 2026-02-17T20:58:58.097 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1658112270 2026-02-18T20:56:38.012869+0000 2026-02-17T20:58:58.097 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/501037198 2026-02-18T20:56:38.012869+0000 2026-02-17T20:58:58.097 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6801/3247908774 2026-02-18T20:56:38.012869+0000 2026-02-17T20:58:58.097 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/2902766949 2026-02-18T20:56:38.012869+0000 2026-02-17T20:58:58.098 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1424534119 2026-02-18T20:56:47.530062+0000 2026-02-17T20:58:58.098 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/413298199 2026-02-18T20:56:47.530062+0000 2026-02-17T20:58:58.098 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6800/95322277 2026-02-18T20:56:47.530062+0000 2026-02-17T20:58:58.098 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1013639580 2026-02-18T20:57:03.624371+0000 2026-02-17T20:58:58.098 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6801/1034073782 2026-02-18T20:57:03.624371+0000 2026-02-17T20:58:58.098 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6800/3247908774 2026-02-18T20:56:38.012869+0000 2026-02-17T20:58:58.098 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6801/95322277 2026-02-18T20:56:47.530062+0000 2026-02-17T20:58:58.098 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1181662162 2026-02-18T20:56:47.530062+0000 2026-02-17T20:58:58.098 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6800/1034073782 2026-02-18T20:57:03.624371+0000 2026-02-17T20:58:58.099 INFO:teuthology.orchestra.run.trial104.stderr:listed 17 entries 2026-02-17T20:58:58.099 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.095+0000 7fe7b6e72640 1 -- 10.20.193.104:0/2938702101 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe7800775a0 msgr2=0x7fe780079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:58.099 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.095+0000 7fe7b6e72640 1 --2- 10.20.193.104:0/2938702101 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe7800775a0 0x7fe780079a60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0005fd0 tx=0x7fe7a0005950 comp rx=0 tx=0).stop 2026-02-17T20:58:58.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.095+0000 7fe7b6e72640 1 -- 10.20.193.104:0/2938702101 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe7b010a8b0 msgr2=0x7fe7b01a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:58:58.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.095+0000 7fe7b6e72640 1 --2- 10.20.193.104:0/2938702101 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe7b010a8b0 0x7fe7b01a2af0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fe79802f730 tx=0x7fe79802fd20 comp rx=0 tx=0).stop 2026-02-17T20:58:58.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.095+0000 7fe7b6e72640 1 -- 10.20.193.104:0/2938702101 shutdown_connections 2026-02-17T20:58:58.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.095+0000 7fe7b6e72640 1 --2- 10.20.193.104:0/2938702101 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fe7800775a0 0x7fe780079a60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:58.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.095+0000 7fe7b6e72640 1 --2- 10.20.193.104:0/2938702101 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fe7b010a8b0 0x7fe7b01a2af0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:58.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.095+0000 7fe7b6e72640 1 --2- 10.20.193.104:0/2938702101 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fe7b01048b0 0x7fe7b01a25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:58:58.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.095+0000 7fe7b6e72640 1 -- 10.20.193.104:0/2938702101 >> 10.20.193.104:0/2938702101 conn(0x7fe7b0100590 msgr2=0x7fe7b01016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:58:58.100 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.095+0000 7fe7b6e72640 1 -- 10.20.193.104:0/2938702101 shutdown_connections 2026-02-17T20:58:58.101 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:58:58.095+0000 7fe7b6e72640 1 -- 10.20.193.104:0/2938702101 wait complete. 2026-02-17T20:58:58.135 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@trial104.front.sepia.ceph.com... 2026-02-17T20:58:58.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:58:58.136 DEBUG:teuthology.orchestra.run.trial104:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2026-02-17T20:58:58.161 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.trial104.stderr:ceph-fuse[71016]: fuse finished with error 0 and tester_r 0 2026-02-17T20:58:58.163 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T20:58:59.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:58 trial153 ceph-mon[25357]: pgmap v102: 129 pgs: 129 active+clean; 581 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 538 B/s wr, 16 op/s 2026-02-17T20:58:59.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:58:58 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/2938702101' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-17T20:58:59.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:58 trial104 ceph-mon[20612]: pgmap v102: 129 pgs: 129 active+clean; 581 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 538 B/s wr, 16 op/s 2026-02-17T20:58:59.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:58:58 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/2938702101' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-17T20:59:01.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:00 trial153 ceph-mon[25357]: pgmap v103: 129 pgs: 129 active+clean; 583 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 833 B/s wr, 15 op/s 2026-02-17T20:59:01.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:00 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:59:01.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:00 trial104 ceph-mon[20612]: pgmap v103: 129 pgs: 129 active+clean; 583 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 833 B/s wr, 15 op/s 2026-02-17T20:59:01.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:00 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:59:03.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:02 trial153 ceph-mon[25357]: pgmap v104: 129 pgs: 129 active+clean; 583 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 676 B/s wr, 12 op/s 2026-02-17T20:59:03.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:02 trial104 ceph-mon[20612]: pgmap v104: 129 pgs: 129 active+clean; 583 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 676 B/s wr, 12 op/s 2026-02-17T20:59:04.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2026-02-17T20:59:04.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2026-02-17T20:59:04.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2026-02-17T20:59:04.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2026-02-17T20:59:04.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:59:04.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2026-02-17T20:59:04.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2026-02-17T20:59:04.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2026-02-17T20:59:04.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]: dispatch 2026-02-17T20:59:04.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:59:04.265 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@trial104.front.sepia.ceph.com 2026-02-17T20:59:04.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:59:04.265 DEBUG:teuthology.orchestra.run.trial104:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2026-02-17T20:59:04.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:59:04.284 DEBUG:teuthology.orchestra.run.trial153:> ip netns list 2026-02-17T20:59:04.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:59:04.305 DEBUG:teuthology.orchestra.run.trial153:> sudo ip link delete ceph-brx 2026-02-17T20:59:04.372 INFO:teuthology.orchestra.run.trial153.stderr:Cannot find device "ceph-brx" 2026-02-17T20:59:04.373 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:59:04.374 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2026-02-17T20:59:04.374 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2026-02-17T20:59:04.374 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph fs ls 2026-02-17T20:59:04.530 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T20:59:04.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca5c8bc640 1 -- 10.20.193.104:0/3225703171 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fca5410a8c0 msgr2=0x7fca5410aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:59:04.641 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca5c8bc640 1 --2- 10.20.193.104:0/3225703171 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fca5410a8c0 0x7fca5410aca0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fca4c0099b0 tx=0x7fca4c02f220 comp rx=0 tx=0).stop 2026-02-17T20:59:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca5c8bc640 1 -- 10.20.193.104:0/3225703171 shutdown_connections 2026-02-17T20:59:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca5c8bc640 1 --2- 10.20.193.104:0/3225703171 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fca541048c0 0x7fca54104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:59:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca5c8bc640 1 --2- 10.20.193.104:0/3225703171 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fca5410a8c0 0x7fca5410aca0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:59:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca5c8bc640 1 -- 10.20.193.104:0/3225703171 >> 10.20.193.104:0/3225703171 conn(0x7fca541005c0 msgr2=0x7fca541029e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:59:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca5c8bc640 1 -- 10.20.193.104:0/3225703171 shutdown_connections 2026-02-17T20:59:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca5c8bc640 1 -- 10.20.193.104:0/3225703171 wait complete. 2026-02-17T20:59:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca5c8bc640 1 Processor -- start 2026-02-17T20:59:04.642 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca5c8bc640 1 -- start start 2026-02-17T20:59:04.643 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca5c8bc640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fca541048c0 0x7fca541a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:59:04.643 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca5c8bc640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fca5410a8c0 0x7fca541a2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:59:04.643 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca5c8bc640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fca54111ae0 con 0x7fca5410a8c0 2026-02-17T20:59:04.643 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca5c8bc640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fca54111960 con 0x7fca541048c0 2026-02-17T20:59:04.643 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca59e30640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fca5410a8c0 0x7fca541a2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:59:04.643 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca59e30640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fca5410a8c0 0x7fca541a2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:55978/0 (socket says 10.20.193.104:55978) 2026-02-17T20:59:04.643 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca59e30640 1 -- 10.20.193.104:0/1062823006 learned_addr learned my addr 10.20.193.104:0/1062823006 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T20:59:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca5a631640 1 --2- 10.20.193.104:0/1062823006 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fca541048c0 0x7fca541a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:59:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca59e30640 1 -- 10.20.193.104:0/1062823006 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fca541048c0 msgr2=0x7fca541a2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:59:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca59e30640 1 --2- 10.20.193.104:0/1062823006 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fca541048c0 0x7fca541a2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:59:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca59e30640 1 -- 10.20.193.104:0/1062823006 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca5419c650 con 0x7fca5410a8c0 2026-02-17T20:59:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.636+0000 7fca59e30640 1 --2- 10.20.193.104:0/1062823006 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fca5410a8c0 0x7fca541a2ac0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fca4000d8d0 tx=0x7fca4000dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:59:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.637+0000 7fca3f7fe640 1 -- 10.20.193.104:0/1062823006 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fca40014070 con 0x7fca5410a8c0 2026-02-17T20:59:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.637+0000 7fca3f7fe640 1 -- 10.20.193.104:0/1062823006 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fca400044a0 con 0x7fca5410a8c0 2026-02-17T20:59:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.637+0000 7fca5c8bc640 1 -- 10.20.193.104:0/1062823006 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca5419c940 con 0x7fca5410a8c0 2026-02-17T20:59:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.637+0000 7fca3f7fe640 1 -- 10.20.193.104:0/1062823006 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fca40002dc0 con 0x7fca5410a8c0 2026-02-17T20:59:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.637+0000 7fca5c8bc640 1 -- 10.20.193.104:0/1062823006 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca5419cea0 con 0x7fca5410a8c0 2026-02-17T20:59:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.637+0000 7fca5c8bc640 1 -- 10.20.193.104:0/1062823006 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca54106000 con 0x7fca5410a8c0 2026-02-17T20:59:04.644 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.638+0000 7fca3f7fe640 1 -- 10.20.193.104:0/1062823006 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7fca4000b840 con 0x7fca5410a8c0 2026-02-17T20:59:04.645 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.638+0000 7fca3f7fe640 1 --2- 10.20.193.104:0/1062823006 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fca300775a0 0x7fca30079a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T20:59:04.645 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.638+0000 7fca5a631640 1 --2- 10.20.193.104:0/1062823006 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fca300775a0 0x7fca30079a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T20:59:04.645 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.638+0000 7fca3f7fe640 1 -- 10.20.193.104:0/1062823006 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 7336+0+0 (secure 0 0 0) 0x7fca4009a030 con 0x7fca5410a8c0 2026-02-17T20:59:04.645 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.639+0000 7fca5a631640 1 --2- 10.20.193.104:0/1062823006 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fca300775a0 0x7fca30079a60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009980 tx=0x7fca4c03a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T20:59:04.645 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.640+0000 7fca3f7fe640 1 -- 10.20.193.104:0/1062823006 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fca40066ad0 con 0x7fca5410a8c0 2026-02-17T20:59:04.744 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.741+0000 7fca5c8bc640 1 -- 10.20.193.104:0/1062823006 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fca54104d20 con 0x7fca5410a8c0 2026-02-17T20:59:04.745 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.741+0000 7fca3f7fe640 1 -- 10.20.193.104:0/1062823006 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) ==== 53+0+148 (secure 0 0 0) 0x7fca4006b980 con 0x7fca5410a8c0 2026-02-17T20:59:04.745 INFO:teuthology.orchestra.run.trial104.stdout:name: foo, metadata pool: cephfs.foo.meta, data pools: [cephfs.foo.data ] 2026-02-17T20:59:04.745 INFO:teuthology.orchestra.run.trial104.stdout:name: bar, metadata pool: cephfs.bar.meta, data pools: [cephfs.bar.data ] 2026-02-17T20:59:04.746 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.743+0000 7fca5c8bc640 1 -- 10.20.193.104:0/1062823006 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fca300775a0 msgr2=0x7fca30079a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:59:04.746 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.743+0000 7fca5c8bc640 1 --2- 10.20.193.104:0/1062823006 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fca300775a0 0x7fca30079a60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009980 tx=0x7fca4c03a040 comp rx=0 tx=0).stop 2026-02-17T20:59:04.746 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.743+0000 7fca5c8bc640 1 -- 10.20.193.104:0/1062823006 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fca5410a8c0 msgr2=0x7fca541a2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T20:59:04.746 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.743+0000 7fca5c8bc640 1 --2- 10.20.193.104:0/1062823006 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fca5410a8c0 0x7fca541a2ac0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fca4000d8d0 tx=0x7fca4000dda0 comp rx=0 tx=0).stop 2026-02-17T20:59:04.747 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.743+0000 7fca5c8bc640 1 -- 10.20.193.104:0/1062823006 shutdown_connections 2026-02-17T20:59:04.747 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.743+0000 7fca5c8bc640 1 --2- 10.20.193.104:0/1062823006 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fca300775a0 0x7fca30079a60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:59:04.747 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.743+0000 7fca5c8bc640 1 --2- 10.20.193.104:0/1062823006 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fca5410a8c0 0x7fca541a2ac0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:59:04.747 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.743+0000 7fca5c8bc640 1 --2- 10.20.193.104:0/1062823006 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fca541048c0 0x7fca541a2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T20:59:04.747 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.743+0000 7fca5c8bc640 1 -- 10.20.193.104:0/1062823006 >> 10.20.193.104:0/1062823006 conn(0x7fca541005c0 msgr2=0x7fca54102770 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T20:59:04.747 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.743+0000 7fca5c8bc640 1 -- 10.20.193.104:0/1062823006 shutdown_connections 2026-02-17T20:59:04.747 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T20:59:04.743+0000 7fca5c8bc640 1 -- 10.20.193.104:0/1062823006 wait complete. 2026-02-17T20:59:04.782 INFO:tasks.cephfs.mount:Mounting Ceph FS bar; just confirmed its presence on cluster 2026-02-17T20:59:04.782 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2026-02-17T20:59:04.783 INFO:tasks.cephfs.mount:self.client_remote.hostname = trial153.front.sepia.ceph.com 2026-02-17T20:59:04.783 INFO:tasks.cephfs.mount:self.client.name = client.1 2026-02-17T20:59:04.783 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2026-02-17T20:59:04.783 INFO:tasks.cephfs.mount:self.cephfs_name = bar 2026-02-17T20:59:04.783 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2026-02-17T20:59:04.783 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2026-02-17T20:59:04.783 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2026-02-17T20:59:04.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:59:04.784 DEBUG:teuthology.orchestra.run.trial153:> ip addr 2026-02-17T20:59:04.800 INFO:teuthology.orchestra.run.trial153.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2026-02-17T20:59:04.801 INFO:teuthology.orchestra.run.trial153.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2026-02-17T20:59:04.801 INFO:teuthology.orchestra.run.trial153.stdout: inet 127.0.0.1/8 scope host lo 2026-02-17T20:59:04.801 INFO:teuthology.orchestra.run.trial153.stdout: valid_lft forever preferred_lft forever 2026-02-17T20:59:04.801 INFO:teuthology.orchestra.run.trial153.stdout: inet6 ::1/128 scope host 2026-02-17T20:59:04.801 INFO:teuthology.orchestra.run.trial153.stdout: valid_lft forever preferred_lft forever 2026-02-17T20:59:04.801 INFO:teuthology.orchestra.run.trial153.stdout:2: enp7s0f4u2u2c2: mtu 1500 qdisc fq_codel state UNKNOWN group default qlen 1000 2026-02-17T20:59:04.802 INFO:teuthology.orchestra.run.trial153.stdout: link/ether c2:df:b5:61:29:16 brd ff:ff:ff:ff:ff:ff 2026-02-17T20:59:04.802 INFO:teuthology.orchestra.run.trial153.stdout: inet 169.254.3.1/24 brd 169.254.3.255 scope link dynamic noprefixroute enp7s0f4u2u2c2 2026-02-17T20:59:04.802 INFO:teuthology.orchestra.run.trial153.stdout: valid_lft 863682sec preferred_lft 863682sec 2026-02-17T20:59:04.802 INFO:teuthology.orchestra.run.trial153.stdout: inet6 fe80::2600:83ff:99cd:e57b/64 scope link noprefixroute 2026-02-17T20:59:04.802 INFO:teuthology.orchestra.run.trial153.stdout: valid_lft forever preferred_lft forever 2026-02-17T20:59:04.802 INFO:teuthology.orchestra.run.trial153.stdout:3: enp1s0f0: mtu 1500 qdisc mq state UP group default qlen 1000 2026-02-17T20:59:04.802 INFO:teuthology.orchestra.run.trial153.stdout: link/ether 90:5a:08:77:5f:82 brd ff:ff:ff:ff:ff:ff 2026-02-17T20:59:04.802 INFO:teuthology.orchestra.run.trial153.stdout: inet 10.20.193.153/20 brd 10.20.207.255 scope global dynamic noprefixroute enp1s0f0 2026-02-17T20:59:04.802 INFO:teuthology.orchestra.run.trial153.stdout: valid_lft 583sec preferred_lft 583sec 2026-02-17T20:59:04.803 INFO:teuthology.orchestra.run.trial153.stdout: inet6 fe80::925a:8ff:fe77:5f82/64 scope link 2026-02-17T20:59:04.803 INFO:teuthology.orchestra.run.trial153.stdout: valid_lft forever preferred_lft forever 2026-02-17T20:59:04.803 INFO:teuthology.orchestra.run.trial153.stdout:4: enp1s0f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2026-02-17T20:59:04.803 INFO:teuthology.orchestra.run.trial153.stdout: link/ether 90:5a:08:77:5f:83 brd ff:ff:ff:ff:ff:ff 2026-02-17T20:59:04.803 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.159.254/20 2026-02-17T20:59:04.803 DEBUG:teuthology.orchestra.run.trial153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-17T20:59:04.803 DEBUG:teuthology.orchestra.run.trial153:> set -e 2026-02-17T20:59:04.804 DEBUG:teuthology.orchestra.run.trial153:> sudo ip link add name ceph-brx type bridge 2026-02-17T20:59:04.804 DEBUG:teuthology.orchestra.run.trial153:> sudo ip addr flush dev ceph-brx 2026-02-17T20:59:04.804 DEBUG:teuthology.orchestra.run.trial153:> sudo ip link set ceph-brx up 2026-02-17T20:59:04.804 DEBUG:teuthology.orchestra.run.trial153:> sudo ip addr add 192.168.159.254/20 brd 192.168.159.255 dev ceph-brx 2026-02-17T20:59:04.804 DEBUG:teuthology.orchestra.run.trial153:> ') 2026-02-17T20:59:04.876 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:59:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-17T20:59:04.951 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:59:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-17T20:59:04.954 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:04 trial153 ceph-mon[25357]: pgmap v105: 129 pgs: 129 active+clean; 583 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 341 B/s wr, 9 op/s 2026-02-17T20:59:04.954 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]': finished 2026-02-17T20:59:04.954 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]': finished 2026-02-17T20:59:04.954 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2026-02-17T20:59:04.955 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]': finished 2026-02-17T20:59:04.955 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:04 trial153 ceph-mon[25357]: osdmap e58: 8 total, 8 up, 8 in 2026-02-17T20:59:04.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:59:04.956 DEBUG:teuthology.orchestra.run.trial153:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2026-02-17T20:59:05.021 INFO:teuthology.orchestra.run.trial153.stdout:1 2026-02-17T20:59:05.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:59:05.023 DEBUG:teuthology.orchestra.run.trial153:> ip r 2026-02-17T20:59:05.080 INFO:teuthology.orchestra.run.trial153.stdout:default via 10.20.192.1 dev enp1s0f0 proto dhcp src 10.20.193.153 metric 102 2026-02-17T20:59:05.080 INFO:teuthology.orchestra.run.trial153.stdout:10.20.192.0/20 dev enp1s0f0 proto kernel scope link src 10.20.193.153 metric 102 2026-02-17T20:59:05.080 INFO:teuthology.orchestra.run.trial153.stdout:169.254.3.0/24 dev enp7s0f4u2u2c2 proto kernel scope link src 169.254.3.1 metric 101 2026-02-17T20:59:05.080 INFO:teuthology.orchestra.run.trial153.stdout:192.168.144.0/20 dev ceph-brx proto kernel scope link src 192.168.159.254 2026-02-17T20:59:05.081 DEBUG:teuthology.orchestra.run.trial153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-17T20:59:05.081 DEBUG:teuthology.orchestra.run.trial153:> set -e 2026-02-17T20:59:05.081 DEBUG:teuthology.orchestra.run.trial153:> sudo iptables -A FORWARD -o enp1s0f0 -i ceph-brx -j ACCEPT 2026-02-17T20:59:05.081 DEBUG:teuthology.orchestra.run.trial153:> sudo iptables -A FORWARD -i enp1s0f0 -o ceph-brx -j ACCEPT 2026-02-17T20:59:05.081 DEBUG:teuthology.orchestra.run.trial153:> sudo iptables -t nat -A POSTROUTING -s 192.168.159.254/20 -o enp1s0f0 -j MASQUERADE 2026-02-17T20:59:05.081 DEBUG:teuthology.orchestra.run.trial153:> ') 2026-02-17T20:59:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:04 trial104 ceph-mon[20612]: pgmap v105: 129 pgs: 129 active+clean; 583 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 341 B/s wr, 9 op/s 2026-02-17T20:59:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]': finished 2026-02-17T20:59:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]': finished 2026-02-17T20:59:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2026-02-17T20:59:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.18", "id": [1, 5]}]': finished 2026-02-17T20:59:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:04 trial104 ceph-mon[20612]: osdmap e58: 8 total, 8 up, 8 in 2026-02-17T20:59:05.155 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:59:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-17T20:59:05.286 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:59:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-17T20:59:05.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:59:05.292 DEBUG:teuthology.orchestra.run.trial153:> ip netns list 2026-02-17T20:59:05.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:59:05.350 DEBUG:teuthology.orchestra.run.trial153:> ip netns list-id 2026-02-17T20:59:05.406 DEBUG:teuthology.orchestra.run.trial153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-17T20:59:05.406 DEBUG:teuthology.orchestra.run.trial153:> set -e 2026-02-17T20:59:05.407 DEBUG:teuthology.orchestra.run.trial153:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2026-02-17T20:59:05.407 DEBUG:teuthology.orchestra.run.trial153:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2026-02-17T20:59:05.407 DEBUG:teuthology.orchestra.run.trial153:> ') 2026-02-17T20:59:05.481 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:59:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-17T20:59:05.502 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:59:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-17T20:59:05.506 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.144.1/20 2026-02-17T20:59:05.507 DEBUG:teuthology.orchestra.run.trial153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-17T20:59:05.507 DEBUG:teuthology.orchestra.run.trial153:> set -e 2026-02-17T20:59:05.507 DEBUG:teuthology.orchestra.run.trial153:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2026-02-17T20:59:05.507 DEBUG:teuthology.orchestra.run.trial153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.144.1/20 brd 192.168.159.255 dev veth0 2026-02-17T20:59:05.507 DEBUG:teuthology.orchestra.run.trial153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2026-02-17T20:59:05.507 DEBUG:teuthology.orchestra.run.trial153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2026-02-17T20:59:05.507 DEBUG:teuthology.orchestra.run.trial153:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.159.254 2026-02-17T20:59:05.507 DEBUG:teuthology.orchestra.run.trial153:> ') 2026-02-17T20:59:05.580 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:59:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-17T20:59:05.635 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:59:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-17T20:59:05.640 DEBUG:teuthology.orchestra.run.trial153:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2026-02-17T20:59:05.640 DEBUG:teuthology.orchestra.run.trial153:> set -e 2026-02-17T20:59:05.640 DEBUG:teuthology.orchestra.run.trial153:> sudo ip link set brx.0 up 2026-02-17T20:59:05.640 DEBUG:teuthology.orchestra.run.trial153:> sudo ip link set dev brx.0 master ceph-brx 2026-02-17T20:59:05.640 DEBUG:teuthology.orchestra.run.trial153:> ') 2026-02-17T20:59:05.715 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:59:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2026-02-17T20:59:05.737 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:59:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-17T20:59:05.742 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {'cephfs_name': 'bar'} 2026-02-17T20:59:05.742 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-17T20:59:05.742 DEBUG:teuthology.orchestra.run.trial153:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2026-02-17T20:59:05.750 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:05 trial153 ceph-mon[25357]: osdmap e59: 8 total, 8 up, 8 in 2026-02-17T20:59:05.750 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:05 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/1062823006' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2026-02-17T20:59:05.765 INFO:teuthology.orchestra.run.trial153.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2026-02-17T20:59:05.766 INFO:teuthology.orchestra.run:Running command with timeout 60 2026-02-17T20:59:05.766 DEBUG:teuthology.orchestra.run.trial153:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2026-02-17T20:59:05.823 DEBUG:teuthology.orchestra.run.trial153:> sudo modprobe fuse 2026-02-17T20:59:05.888 DEBUG:teuthology.orchestra.run.trial153:> cat /proc/self/mounts | awk '{print $2}' 2026-02-17T20:59:05.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:05 trial104 ceph-mon[20612]: osdmap e59: 8 total, 8 up, 8 in 2026-02-17T20:59:05.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:05 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/1062823006' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2026-02-17T20:59:05.945 INFO:teuthology.orchestra.run.trial153.stdout:/proc 2026-02-17T20:59:05.946 INFO:teuthology.orchestra.run.trial153.stdout:/sys 2026-02-17T20:59:05.946 INFO:teuthology.orchestra.run.trial153.stdout:/dev 2026-02-17T20:59:05.946 INFO:teuthology.orchestra.run.trial153.stdout:/sys/kernel/security 2026-02-17T20:59:05.946 INFO:teuthology.orchestra.run.trial153.stdout:/dev/shm 2026-02-17T20:59:05.946 INFO:teuthology.orchestra.run.trial153.stdout:/dev/pts 2026-02-17T20:59:05.946 INFO:teuthology.orchestra.run.trial153.stdout:/run 2026-02-17T20:59:05.946 INFO:teuthology.orchestra.run.trial153.stdout:/sys/fs/cgroup 2026-02-17T20:59:05.946 INFO:teuthology.orchestra.run.trial153.stdout:/sys/fs/pstore 2026-02-17T20:59:05.947 INFO:teuthology.orchestra.run.trial153.stdout:/sys/firmware/efi/efivars 2026-02-17T20:59:05.947 INFO:teuthology.orchestra.run.trial153.stdout:/sys/fs/bpf 2026-02-17T20:59:05.947 INFO:teuthology.orchestra.run.trial153.stdout:/sys/kernel/config 2026-02-17T20:59:05.947 INFO:teuthology.orchestra.run.trial153.stdout:/ 2026-02-17T20:59:05.947 INFO:teuthology.orchestra.run.trial153.stdout:/sys/fs/selinux 2026-02-17T20:59:05.947 INFO:teuthology.orchestra.run.trial153.stdout:/proc/sys/fs/binfmt_misc 2026-02-17T20:59:05.947 INFO:teuthology.orchestra.run.trial153.stdout:/dev/hugepages 2026-02-17T20:59:05.947 INFO:teuthology.orchestra.run.trial153.stdout:/dev/mqueue 2026-02-17T20:59:05.947 INFO:teuthology.orchestra.run.trial153.stdout:/sys/kernel/debug 2026-02-17T20:59:05.947 INFO:teuthology.orchestra.run.trial153.stdout:/sys/kernel/tracing 2026-02-17T20:59:05.947 INFO:teuthology.orchestra.run.trial153.stdout:/sys/fs/fuse/connections 2026-02-17T20:59:05.947 INFO:teuthology.orchestra.run.trial153.stdout:/run/credentials/systemd-sysctl.service 2026-02-17T20:59:05.948 INFO:teuthology.orchestra.run.trial153.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2026-02-17T20:59:05.948 INFO:teuthology.orchestra.run.trial153.stdout:/boot/efi 2026-02-17T20:59:05.948 INFO:teuthology.orchestra.run.trial153.stdout:/run/credentials/systemd-tmpfiles-setup.service 2026-02-17T20:59:05.948 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/nfs/rpc_pipefs 2026-02-17T20:59:05.948 INFO:teuthology.orchestra.run.trial153.stdout:/run/user/1000 2026-02-17T20:59:05.948 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/ceph 2026-02-17T20:59:05.948 INFO:teuthology.orchestra.run.trial153.stdout:/run/user/0 2026-02-17T20:59:05.948 INFO:teuthology.orchestra.run.trial153.stdout:/proc/sys/fs/binfmt_misc 2026-02-17T20:59:05.948 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay 2026-02-17T20:59:05.948 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/7bfded2cb8e43639841f2c26f72e915e00cc0e129603df3f3a39a4d4042a1314/merged 2026-02-17T20:59:05.948 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/7aba2276a98a0963a0a3f6d6e8e808bab6d6c1cf49a1ea0ecfd696196a7f357c/merged 2026-02-17T20:59:05.948 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/443c386cdff4c9276f57a49c8a6cf9315448ee685b574d980aec91f296327336/merged 2026-02-17T20:59:05.949 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/d054a0c8c5e686bf131e9d9fbceb3469d8d32a895c46d6cc4729d71fd08e82d5/merged 2026-02-17T20:59:05.949 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/4fbad3f4d547224d473e8c4874d3120605887f257168c76d09872d501708262c/merged 2026-02-17T20:59:05.949 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/16ed6156275d96e9e2015418c06c5aea37c67dccd3153eb69fe9d254c56baefb/merged 2026-02-17T20:59:05.949 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/49b2f61c1188a5816905434cb0a8b07c6decf3a871eada390568866ac54e3a70/merged 2026-02-17T20:59:05.949 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/6104cb9b252093d04a75a5c067c064d4130f02b5ce7a3182d13bb6d830412b07/merged 2026-02-17T20:59:05.949 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/40dc191d6a07de71a173efd46ec2a3a64f79d9871462c5983ed9a8daeb33b09c/merged 2026-02-17T20:59:05.949 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/f0a0250aaaa6da2024b3318bd5319a2b48a95d0db368bee179c2a050dcc53a6d/merged 2026-02-17T20:59:05.949 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/6fb445608e270e243ba615e241f8cd463f76296754e92a8a5272782e8d7a8548/merged 2026-02-17T20:59:05.949 INFO:teuthology.orchestra.run.trial153.stdout:/run/netns 2026-02-17T20:59:05.949 INFO:teuthology.orchestra.run.trial153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2026-02-17T20:59:05.949 INFO:teuthology.orchestra.run.trial153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2026-02-17T20:59:05.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:59:05.950 DEBUG:teuthology.orchestra.run.trial153:> ls /sys/fs/fuse/connections 2026-02-17T20:59:06.002 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2026-02-17T20:59:06.003 DEBUG:teuthology.orchestra.run.trial153:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1 --client_fs=bar) 2026-02-17T20:59:06.044 DEBUG:teuthology.orchestra.run.trial153:> sudo modprobe fuse 2026-02-17T20:59:06.069 DEBUG:teuthology.orchestra.run.trial153:> cat /proc/self/mounts | awk '{print $2}' 2026-02-17T20:59:06.123 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.trial153.stderr:2026-02-17T20:59:06.121+0000 7fa7f79c6580 -1 init, newargv = 0x5595cb6d5340 newargc=15 2026-02-17T20:59:06.123 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.trial153.stderr:ceph-fuse[53145]: starting ceph client 2026-02-17T20:59:06.127 INFO:teuthology.orchestra.run.trial153.stdout:/proc 2026-02-17T20:59:06.127 INFO:teuthology.orchestra.run.trial153.stdout:/sys 2026-02-17T20:59:06.127 INFO:teuthology.orchestra.run.trial153.stdout:/dev 2026-02-17T20:59:06.128 INFO:teuthology.orchestra.run.trial153.stdout:/sys/kernel/security 2026-02-17T20:59:06.128 INFO:teuthology.orchestra.run.trial153.stdout:/dev/shm 2026-02-17T20:59:06.128 INFO:teuthology.orchestra.run.trial153.stdout:/dev/pts 2026-02-17T20:59:06.128 INFO:teuthology.orchestra.run.trial153.stdout:/run 2026-02-17T20:59:06.128 INFO:teuthology.orchestra.run.trial153.stdout:/sys/fs/cgroup 2026-02-17T20:59:06.128 INFO:teuthology.orchestra.run.trial153.stdout:/sys/fs/pstore 2026-02-17T20:59:06.128 INFO:teuthology.orchestra.run.trial153.stdout:/sys/firmware/efi/efivars 2026-02-17T20:59:06.128 INFO:teuthology.orchestra.run.trial153.stdout:/sys/fs/bpf 2026-02-17T20:59:06.128 INFO:teuthology.orchestra.run.trial153.stdout:/sys/kernel/config 2026-02-17T20:59:06.128 INFO:teuthology.orchestra.run.trial153.stdout:/ 2026-02-17T20:59:06.128 INFO:teuthology.orchestra.run.trial153.stdout:/sys/fs/selinux 2026-02-17T20:59:06.129 INFO:teuthology.orchestra.run.trial153.stdout:/proc/sys/fs/binfmt_misc 2026-02-17T20:59:06.129 INFO:teuthology.orchestra.run.trial153.stdout:/dev/hugepages 2026-02-17T20:59:06.129 INFO:teuthology.orchestra.run.trial153.stdout:/dev/mqueue 2026-02-17T20:59:06.129 INFO:teuthology.orchestra.run.trial153.stdout:/sys/kernel/debug 2026-02-17T20:59:06.129 INFO:teuthology.orchestra.run.trial153.stdout:/sys/kernel/tracing 2026-02-17T20:59:06.129 INFO:teuthology.orchestra.run.trial153.stdout:/sys/fs/fuse/connections 2026-02-17T20:59:06.129 INFO:teuthology.orchestra.run.trial153.stdout:/run/credentials/systemd-sysctl.service 2026-02-17T20:59:06.129 INFO:teuthology.orchestra.run.trial153.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2026-02-17T20:59:06.129 INFO:teuthology.orchestra.run.trial153.stdout:/boot/efi 2026-02-17T20:59:06.129 INFO:teuthology.orchestra.run.trial153.stdout:/run/credentials/systemd-tmpfiles-setup.service 2026-02-17T20:59:06.129 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/nfs/rpc_pipefs 2026-02-17T20:59:06.129 INFO:teuthology.orchestra.run.trial153.stdout:/run/user/1000 2026-02-17T20:59:06.130 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/ceph 2026-02-17T20:59:06.130 INFO:teuthology.orchestra.run.trial153.stdout:/run/user/0 2026-02-17T20:59:06.130 INFO:teuthology.orchestra.run.trial153.stdout:/proc/sys/fs/binfmt_misc 2026-02-17T20:59:06.130 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay 2026-02-17T20:59:06.130 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/7bfded2cb8e43639841f2c26f72e915e00cc0e129603df3f3a39a4d4042a1314/merged 2026-02-17T20:59:06.130 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/7aba2276a98a0963a0a3f6d6e8e808bab6d6c1cf49a1ea0ecfd696196a7f357c/merged 2026-02-17T20:59:06.130 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/443c386cdff4c9276f57a49c8a6cf9315448ee685b574d980aec91f296327336/merged 2026-02-17T20:59:06.130 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/d054a0c8c5e686bf131e9d9fbceb3469d8d32a895c46d6cc4729d71fd08e82d5/merged 2026-02-17T20:59:06.131 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/4fbad3f4d547224d473e8c4874d3120605887f257168c76d09872d501708262c/merged 2026-02-17T20:59:06.131 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/16ed6156275d96e9e2015418c06c5aea37c67dccd3153eb69fe9d254c56baefb/merged 2026-02-17T20:59:06.131 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/49b2f61c1188a5816905434cb0a8b07c6decf3a871eada390568866ac54e3a70/merged 2026-02-17T20:59:06.131 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/6104cb9b252093d04a75a5c067c064d4130f02b5ce7a3182d13bb6d830412b07/merged 2026-02-17T20:59:06.131 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/40dc191d6a07de71a173efd46ec2a3a64f79d9871462c5983ed9a8daeb33b09c/merged 2026-02-17T20:59:06.131 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/f0a0250aaaa6da2024b3318bd5319a2b48a95d0db368bee179c2a050dcc53a6d/merged 2026-02-17T20:59:06.131 INFO:teuthology.orchestra.run.trial153.stdout:/var/lib/containers/storage/overlay/6fb445608e270e243ba615e241f8cd463f76296754e92a8a5272782e8d7a8548/merged 2026-02-17T20:59:06.131 INFO:teuthology.orchestra.run.trial153.stdout:/run/netns 2026-02-17T20:59:06.131 INFO:teuthology.orchestra.run.trial153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2026-02-17T20:59:06.131 INFO:teuthology.orchestra.run.trial153.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2026-02-17T20:59:06.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:59:06.132 DEBUG:teuthology.orchestra.run.trial153:> ls /sys/fs/fuse/connections 2026-02-17T20:59:06.132 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.trial153.stderr:ceph-fuse[53145]: starting fuse 2026-02-17T20:59:06.183 INFO:teuthology.orchestra.run.trial153.stdout:47 2026-02-17T20:59:06.184 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2026-02-17T20:59:06.184 DEBUG:teuthology.orchestra.run.trial153:> sudo stdin-killer -- python3 -c ' 2026-02-17T20:59:06.184 DEBUG:teuthology.orchestra.run.trial153:> import glob 2026-02-17T20:59:06.184 DEBUG:teuthology.orchestra.run.trial153:> import re 2026-02-17T20:59:06.184 DEBUG:teuthology.orchestra.run.trial153:> import os 2026-02-17T20:59:06.184 DEBUG:teuthology.orchestra.run.trial153:> import subprocess 2026-02-17T20:59:06.185 DEBUG:teuthology.orchestra.run.trial153:> 2026-02-17T20:59:06.185 DEBUG:teuthology.orchestra.run.trial153:> def _find_admin_socket(client_name): 2026-02-17T20:59:06.185 DEBUG:teuthology.orchestra.run.trial153:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2026-02-17T20:59:06.185 DEBUG:teuthology.orchestra.run.trial153:> files = glob.glob(asok_path) 2026-02-17T20:59:06.185 DEBUG:teuthology.orchestra.run.trial153:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2026-02-17T20:59:06.185 DEBUG:teuthology.orchestra.run.trial153:> 2026-02-17T20:59:06.185 DEBUG:teuthology.orchestra.run.trial153:> # Given a non-glob path, it better be there 2026-02-17T20:59:06.185 DEBUG:teuthology.orchestra.run.trial153:> if "*" not in asok_path: 2026-02-17T20:59:06.185 DEBUG:teuthology.orchestra.run.trial153:> assert(len(files) == 1) 2026-02-17T20:59:06.185 DEBUG:teuthology.orchestra.run.trial153:> return files[0] 2026-02-17T20:59:06.185 DEBUG:teuthology.orchestra.run.trial153:> 2026-02-17T20:59:06.185 DEBUG:teuthology.orchestra.run.trial153:> for f in files: 2026-02-17T20:59:06.185 DEBUG:teuthology.orchestra.run.trial153:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2026-02-17T20:59:06.186 DEBUG:teuthology.orchestra.run.trial153:> if os.path.exists("/proc/{0}".format(pid)): 2026-02-17T20:59:06.186 DEBUG:teuthology.orchestra.run.trial153:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2026-02-17T20:59:06.186 DEBUG:teuthology.orchestra.run.trial153:> contents = proc_f.read() 2026-02-17T20:59:06.186 DEBUG:teuthology.orchestra.run.trial153:> if mountpoint in contents: 2026-02-17T20:59:06.186 DEBUG:teuthology.orchestra.run.trial153:> return f 2026-02-17T20:59:06.186 DEBUG:teuthology.orchestra.run.trial153:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2026-02-17T20:59:06.186 DEBUG:teuthology.orchestra.run.trial153:> 2026-02-17T20:59:06.186 DEBUG:teuthology.orchestra.run.trial153:> print(_find_admin_socket("client.1")) 2026-02-17T20:59:06.186 DEBUG:teuthology.orchestra.run.trial153:> ' 2026-02-17T20:59:06.277 INFO:teuthology.orchestra.run.trial153.stdout:/var/run/ceph/ceph-client.1.53145.asok 2026-02-17T20:59:06.279 INFO:teuthology.orchestra.run.trial153.stderr:2026-02-17T20:59:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2026-02-17T20:59:06.284 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.53145.asok 2026-02-17T20:59:06.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:59:06.285 DEBUG:teuthology.orchestra.run.trial153:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.53145.asok status 2026-02-17T20:59:06.387 INFO:teuthology.orchestra.run.trial153.stdout:{ 2026-02-17T20:59:06.388 INFO:teuthology.orchestra.run.trial153.stdout: "metadata": { 2026-02-17T20:59:06.388 INFO:teuthology.orchestra.run.trial153.stdout: "ceph_sha1": "76b494d6529326129dc43abf3fffd48fbf35c395", 2026-02-17T20:59:06.388 INFO:teuthology.orchestra.run.trial153.stdout: "ceph_version": "ceph version 19.2.3-683-g76b494d6 (76b494d6529326129dc43abf3fffd48fbf35c395) squid (stable)", 2026-02-17T20:59:06.388 INFO:teuthology.orchestra.run.trial153.stdout: "entity_id": "1", 2026-02-17T20:59:06.388 INFO:teuthology.orchestra.run.trial153.stdout: "hostname": "trial153", 2026-02-17T20:59:06.388 INFO:teuthology.orchestra.run.trial153.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2026-02-17T20:59:06.388 INFO:teuthology.orchestra.run.trial153.stdout: "pid": "53145", 2026-02-17T20:59:06.388 INFO:teuthology.orchestra.run.trial153.stdout: "root": "/" 2026-02-17T20:59:06.389 INFO:teuthology.orchestra.run.trial153.stdout: }, 2026-02-17T20:59:06.389 INFO:teuthology.orchestra.run.trial153.stdout: "dentry_count": 0, 2026-02-17T20:59:06.389 INFO:teuthology.orchestra.run.trial153.stdout: "dentry_pinned_count": 0, 2026-02-17T20:59:06.389 INFO:teuthology.orchestra.run.trial153.stdout: "id": 24389, 2026-02-17T20:59:06.389 INFO:teuthology.orchestra.run.trial153.stdout: "inst": { 2026-02-17T20:59:06.389 INFO:teuthology.orchestra.run.trial153.stdout: "name": { 2026-02-17T20:59:06.389 INFO:teuthology.orchestra.run.trial153.stdout: "type": "client", 2026-02-17T20:59:06.389 INFO:teuthology.orchestra.run.trial153.stdout: "num": 24389 2026-02-17T20:59:06.389 INFO:teuthology.orchestra.run.trial153.stdout: }, 2026-02-17T20:59:06.389 INFO:teuthology.orchestra.run.trial153.stdout: "addr": { 2026-02-17T20:59:06.389 INFO:teuthology.orchestra.run.trial153.stdout: "type": "v1", 2026-02-17T20:59:06.389 INFO:teuthology.orchestra.run.trial153.stdout: "addr": "192.168.144.1:0", 2026-02-17T20:59:06.390 INFO:teuthology.orchestra.run.trial153.stdout: "nonce": 3188615685 2026-02-17T20:59:06.390 INFO:teuthology.orchestra.run.trial153.stdout: } 2026-02-17T20:59:06.390 INFO:teuthology.orchestra.run.trial153.stdout: }, 2026-02-17T20:59:06.390 INFO:teuthology.orchestra.run.trial153.stdout: "addr": { 2026-02-17T20:59:06.390 INFO:teuthology.orchestra.run.trial153.stdout: "type": "v1", 2026-02-17T20:59:06.390 INFO:teuthology.orchestra.run.trial153.stdout: "addr": "192.168.144.1:0", 2026-02-17T20:59:06.390 INFO:teuthology.orchestra.run.trial153.stdout: "nonce": 3188615685 2026-02-17T20:59:06.390 INFO:teuthology.orchestra.run.trial153.stdout: }, 2026-02-17T20:59:06.390 INFO:teuthology.orchestra.run.trial153.stdout: "inst_str": "client.24389 192.168.144.1:0/3188615685", 2026-02-17T20:59:06.390 INFO:teuthology.orchestra.run.trial153.stdout: "addr_str": "192.168.144.1:0/3188615685", 2026-02-17T20:59:06.390 INFO:teuthology.orchestra.run.trial153.stdout: "inode_count": 1, 2026-02-17T20:59:06.390 INFO:teuthology.orchestra.run.trial153.stdout: "mds_epoch": 11, 2026-02-17T20:59:06.391 INFO:teuthology.orchestra.run.trial153.stdout: "osd_epoch": 59, 2026-02-17T20:59:06.391 INFO:teuthology.orchestra.run.trial153.stdout: "osd_epoch_barrier": 0, 2026-02-17T20:59:06.391 INFO:teuthology.orchestra.run.trial153.stdout: "blocklisted": false, 2026-02-17T20:59:06.391 INFO:teuthology.orchestra.run.trial153.stdout: "fs_name": "bar" 2026-02-17T20:59:06.391 INFO:teuthology.orchestra.run.trial153.stdout:} 2026-02-17T20:59:06.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:59:06.394 DEBUG:teuthology.orchestra.run.trial153:> stat --file-system '--printf=%T 2026-02-17T20:59:06.394 DEBUG:teuthology.orchestra.run.trial153:> ' -- /home/ubuntu/cephtest/mnt.1 2026-02-17T20:59:06.411 INFO:teuthology.orchestra.run.trial153.stdout:fuseblk 2026-02-17T20:59:06.412 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2026-02-17T20:59:06.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T20:59:06.412 DEBUG:teuthology.orchestra.run.trial153:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2026-02-17T20:59:06.476 INFO:teuthology.run_tasks:Running task workunit... 2026-02-17T20:59:06.505 INFO:tasks.workunit:Pulling workunits from ref 76b494d6529326129dc43abf3fffd48fbf35c395 2026-02-17T20:59:06.506 INFO:tasks.workunit:Making a separate scratch dir for every client... 2026-02-17T20:59:06.506 INFO:tasks.workunit:timeout=3h 2026-02-17T20:59:06.506 INFO:tasks.workunit:cleanup=True 2026-02-17T20:59:06.506 DEBUG:teuthology.orchestra.run.trial104:> stat -- /home/ubuntu/cephtest/mnt.0 2026-02-17T20:59:06.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T20:59:06.523 INFO:teuthology.orchestra.run.trial104.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2026-02-17T20:59:06.524 DEBUG:teuthology.orchestra.run.trial104:> mkdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T20:59:06.580 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2026-02-17T20:59:06.580 DEBUG:teuthology.orchestra.run.trial104:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2026-02-17T20:59:06.637 DEBUG:teuthology.orchestra.run.trial153:> stat -- /home/ubuntu/cephtest/mnt.1 2026-02-17T20:59:06.653 INFO:teuthology.orchestra.run.trial153.stdout: File: /home/ubuntu/cephtest/mnt.1 2026-02-17T20:59:06.654 INFO:teuthology.orchestra.run.trial153.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2026-02-17T20:59:06.654 INFO:teuthology.orchestra.run.trial153.stdout:Device: 2fh/47d Inode: 1 Links: 2 2026-02-17T20:59:06.654 INFO:teuthology.orchestra.run.trial153.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-17T20:59:06.654 INFO:teuthology.orchestra.run.trial153.stdout:Context: system_u:object_r:fusefs_t:s0 2026-02-17T20:59:06.654 INFO:teuthology.orchestra.run.trial153.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2026-02-17T20:59:06.654 INFO:teuthology.orchestra.run.trial153.stdout:Modify: 2026-02-17 20:58:49.039169906 +0000 2026-02-17T20:59:06.655 INFO:teuthology.orchestra.run.trial153.stdout:Change: 2026-02-17 20:59:06.473405308 +0000 2026-02-17T20:59:06.655 INFO:teuthology.orchestra.run.trial153.stdout: Birth: - 2026-02-17T20:59:06.655 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2026-02-17T20:59:06.655 DEBUG:teuthology.orchestra.run.trial153:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2026-02-17T20:59:06.724 DEBUG:teuthology.orchestra.run.trial104:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 76b494d6529326129dc43abf3fffd48fbf35c395 2026-02-17T20:59:06.725 DEBUG:teuthology.orchestra.run.trial153:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 76b494d6529326129dc43abf3fffd48fbf35c395 2026-02-17T20:59:06.749 INFO:tasks.workunit.client.0.trial104.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2026-02-17T20:59:06.788 INFO:tasks.workunit.client.1.trial153.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2026-02-17T20:59:07.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:06 trial153 ceph-mon[25357]: pgmap v108: 129 pgs: 2 peering, 127 active+clean; 583 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 383 B/s rd, 383 B/s wr, 0 op/s 2026-02-17T20:59:07.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:06 trial104 ceph-mon[20612]: pgmap v108: 129 pgs: 2 peering, 127 active+clean; 583 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 383 B/s rd, 383 B/s wr, 0 op/s 2026-02-17T20:59:09.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:08 trial153 ceph-mon[25357]: pgmap v109: 129 pgs: 2 peering, 127 active+clean; 583 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 255 B/s wr, 0 op/s; 202 B/s, 0 objects/s recovering 2026-02-17T20:59:09.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:08 trial104 ceph-mon[20612]: pgmap v109: 129 pgs: 2 peering, 127 active+clean; 583 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 255 B/s wr, 0 op/s; 202 B/s, 0 objects/s recovering 2026-02-17T20:59:11.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:10 trial153 ceph-mon[25357]: pgmap v110: 129 pgs: 129 active+clean; 583 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 383 B/s wr, 0 op/s; 205 B/s, 0 objects/s recovering 2026-02-17T20:59:11.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:10 trial104 ceph-mon[20612]: pgmap v110: 129 pgs: 129 active+clean; 583 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 383 B/s wr, 0 op/s; 205 B/s, 0 objects/s recovering 2026-02-17T20:59:13.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:12 trial153 ceph-mon[25357]: pgmap v111: 129 pgs: 129 active+clean; 586 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 767 B/s wr, 0 op/s; 205 B/s, 0 objects/s recovering 2026-02-17T20:59:13.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:12 trial104 ceph-mon[20612]: pgmap v111: 129 pgs: 129 active+clean; 586 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 767 B/s wr, 0 op/s; 205 B/s, 0 objects/s recovering 2026-02-17T20:59:14.979 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:14 trial153 ceph-mon[25357]: pgmap v112: 129 pgs: 129 active+clean; 586 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 617 B/s wr, 0 op/s; 165 B/s, 0 objects/s recovering 2026-02-17T20:59:15.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:14 trial104 ceph-mon[20612]: pgmap v112: 129 pgs: 129 active+clean; 586 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 617 B/s wr, 0 op/s; 165 B/s, 0 objects/s recovering 2026-02-17T20:59:17.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:16 trial153 ceph-mon[25357]: pgmap v113: 129 pgs: 129 active+clean; 586 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 654 B/s wr, 0 op/s; 150 B/s, 0 objects/s recovering 2026-02-17T20:59:17.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:16 trial104 ceph-mon[20612]: pgmap v113: 129 pgs: 129 active+clean; 586 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 654 B/s wr, 0 op/s; 150 B/s, 0 objects/s recovering 2026-02-17T20:59:19.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:18 trial153 ceph-mon[25357]: pgmap v114: 129 pgs: 129 active+clean; 588 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 767 B/s wr, 0 op/s; 136 B/s, 0 objects/s recovering 2026-02-17T20:59:19.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:59:19.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:18 trial104 ceph-mon[20612]: pgmap v114: 129 pgs: 129 active+clean; 588 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 767 B/s wr, 0 op/s; 136 B/s, 0 objects/s recovering 2026-02-17T20:59:19.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:59:21.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:20 trial153 ceph-mon[25357]: pgmap v115: 129 pgs: 129 active+clean; 588 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 597 B/s wr, 0 op/s; 1 B/s, 0 objects/s recovering 2026-02-17T20:59:21.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:20 trial104 ceph-mon[20612]: pgmap v115: 129 pgs: 129 active+clean; 588 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 597 B/s wr, 0 op/s; 1 B/s, 0 objects/s recovering 2026-02-17T20:59:22.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:22 trial104 ceph-mon[20612]: pgmap v116: 129 pgs: 129 active+clean; 588 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 511 B/s wr, 0 op/s 2026-02-17T20:59:23.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:22 trial153 ceph-mon[25357]: pgmap v116: 129 pgs: 129 active+clean; 588 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 511 B/s wr, 0 op/s 2026-02-17T20:59:25.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:24 trial153 ceph-mon[25357]: pgmap v117: 129 pgs: 129 active+clean; 588 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 255 B/s wr, 0 op/s 2026-02-17T20:59:25.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:24 trial104 ceph-mon[20612]: pgmap v117: 129 pgs: 129 active+clean; 588 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 255 B/s wr, 0 op/s 2026-02-17T20:59:26.156 INFO:tasks.workunit.client.1.trial153.stderr:Note: switching to '76b494d6529326129dc43abf3fffd48fbf35c395'. 2026-02-17T20:59:26.157 INFO:tasks.workunit.client.1.trial153.stderr: 2026-02-17T20:59:26.157 INFO:tasks.workunit.client.1.trial153.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-17T20:59:26.157 INFO:tasks.workunit.client.1.trial153.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-17T20:59:26.157 INFO:tasks.workunit.client.1.trial153.stderr:state without impacting any branches by switching back to a branch. 2026-02-17T20:59:26.157 INFO:tasks.workunit.client.1.trial153.stderr: 2026-02-17T20:59:26.157 INFO:tasks.workunit.client.1.trial153.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-17T20:59:26.157 INFO:tasks.workunit.client.1.trial153.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-17T20:59:26.157 INFO:tasks.workunit.client.1.trial153.stderr: 2026-02-17T20:59:26.157 INFO:tasks.workunit.client.1.trial153.stderr: git switch -c 2026-02-17T20:59:26.158 INFO:tasks.workunit.client.1.trial153.stderr: 2026-02-17T20:59:26.158 INFO:tasks.workunit.client.1.trial153.stderr:Or undo this operation with: 2026-02-17T20:59:26.158 INFO:tasks.workunit.client.1.trial153.stderr: 2026-02-17T20:59:26.158 INFO:tasks.workunit.client.1.trial153.stderr: git switch - 2026-02-17T20:59:26.158 INFO:tasks.workunit.client.1.trial153.stderr: 2026-02-17T20:59:26.158 INFO:tasks.workunit.client.1.trial153.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-17T20:59:26.158 INFO:tasks.workunit.client.1.trial153.stderr: 2026-02-17T20:59:26.158 INFO:tasks.workunit.client.1.trial153.stderr:HEAD is now at 76b494d6529 Merge PR #63790 into wip-jcollin-testing-20260217.024944-squid 2026-02-17T20:59:26.164 DEBUG:teuthology.orchestra.run.trial153:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2026-02-17T20:59:26.222 INFO:tasks.workunit.client.1.trial153.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-17T20:59:26.224 INFO:tasks.workunit.client.1.trial153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2026-02-17T20:59:26.224 INFO:tasks.workunit.client.1.trial153.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-17T20:59:26.314 INFO:tasks.workunit.client.0.trial104.stderr:Note: switching to '76b494d6529326129dc43abf3fffd48fbf35c395'. 2026-02-17T20:59:26.315 INFO:tasks.workunit.client.0.trial104.stderr: 2026-02-17T20:59:26.315 INFO:tasks.workunit.client.0.trial104.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2026-02-17T20:59:26.315 INFO:tasks.workunit.client.0.trial104.stderr:changes and commit them, and you can discard any commits you make in this 2026-02-17T20:59:26.315 INFO:tasks.workunit.client.0.trial104.stderr:state without impacting any branches by switching back to a branch. 2026-02-17T20:59:26.315 INFO:tasks.workunit.client.0.trial104.stderr: 2026-02-17T20:59:26.315 INFO:tasks.workunit.client.0.trial104.stderr:If you want to create a new branch to retain commits you create, you may 2026-02-17T20:59:26.315 INFO:tasks.workunit.client.0.trial104.stderr:do so (now or later) by using -c with the switch command. Example: 2026-02-17T20:59:26.315 INFO:tasks.workunit.client.0.trial104.stderr: 2026-02-17T20:59:26.315 INFO:tasks.workunit.client.0.trial104.stderr: git switch -c 2026-02-17T20:59:26.315 INFO:tasks.workunit.client.0.trial104.stderr: 2026-02-17T20:59:26.315 INFO:tasks.workunit.client.0.trial104.stderr:Or undo this operation with: 2026-02-17T20:59:26.316 INFO:tasks.workunit.client.0.trial104.stderr: 2026-02-17T20:59:26.316 INFO:tasks.workunit.client.0.trial104.stderr: git switch - 2026-02-17T20:59:26.316 INFO:tasks.workunit.client.0.trial104.stderr: 2026-02-17T20:59:26.316 INFO:tasks.workunit.client.0.trial104.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2026-02-17T20:59:26.316 INFO:tasks.workunit.client.0.trial104.stderr: 2026-02-17T20:59:26.316 INFO:tasks.workunit.client.0.trial104.stderr:HEAD is now at 76b494d6529 Merge PR #63790 into wip-jcollin-testing-20260217.024944-squid 2026-02-17T20:59:26.322 DEBUG:teuthology.orchestra.run.trial104:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2026-02-17T20:59:26.323 INFO:tasks.workunit.client.1.trial153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-17T20:59:26.340 INFO:tasks.workunit.client.0.trial104.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2026-02-17T20:59:26.341 INFO:tasks.workunit.client.0.trial104.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-17T20:59:26.342 INFO:tasks.workunit.client.0.trial104.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2026-02-17T20:59:26.355 INFO:tasks.workunit.client.1.trial153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-17T20:59:26.380 INFO:tasks.workunit.client.1.trial153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2026-02-17T20:59:26.382 INFO:tasks.workunit.client.1.trial153.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2026-02-17T20:59:26.382 INFO:tasks.workunit.client.1.trial153.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-17T20:59:26.406 INFO:tasks.workunit.client.1.trial153.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2026-02-17T20:59:26.409 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T20:59:26.409 DEBUG:teuthology.orchestra.run.trial153:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2026-02-17T20:59:26.437 INFO:tasks.workunit.client.0.trial104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2026-02-17T20:59:26.467 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.1... 2026-02-17T20:59:26.469 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2026-02-17T20:59:26.470 DEBUG:teuthology.orchestra.run.trial153:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=76b494d6529326129dc43abf3fffd48fbf35c395 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/dbench.sh 2026-02-17T20:59:26.470 INFO:tasks.workunit.client.0.trial104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2026-02-17T20:59:26.492 INFO:tasks.workunit.client.0.trial104.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2026-02-17T20:59:26.493 INFO:tasks.workunit.client.0.trial104.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-17T20:59:26.493 INFO:tasks.workunit.client.0.trial104.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2026-02-17T20:59:26.519 INFO:tasks.workunit.client.0.trial104.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2026-02-17T20:59:26.523 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T20:59:26.523 DEBUG:teuthology.orchestra.run.trial104:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2026-02-17T20:59:26.532 INFO:tasks.workunit.client.1.trial153.stderr:+ dbench 1 2026-02-17T20:59:26.533 INFO:tasks.workunit.client.1.trial153.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2026-02-17T20:59:26.533 INFO:tasks.workunit.client.1.trial153.stdout: 2026-02-17T20:59:26.533 INFO:tasks.workunit.client.1.trial153.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2026-02-17T20:59:26.533 INFO:tasks.workunit.client.1.trial153.stdout:0 of 1 processes prepared for launch 0 sec 2026-02-17T20:59:26.580 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2026-02-17T20:59:26.583 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2026-02-17T20:59:26.584 DEBUG:teuthology.orchestra.run.trial104:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=76b494d6529326129dc43abf3fffd48fbf35c395 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2026-02-17T20:59:26.633 INFO:tasks.workunit.client.1.trial153.stdout:1 of 1 processes prepared for launch 0 sec 2026-02-17T20:59:26.634 INFO:tasks.workunit.client.1.trial153.stdout:releasing clients 2026-02-17T20:59:26.642 INFO:tasks.workunit.client.0.trial104.stderr:+ dbench 1 2026-02-17T20:59:26.643 INFO:tasks.workunit.client.0.trial104.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2026-02-17T20:59:26.643 INFO:tasks.workunit.client.0.trial104.stdout: 2026-02-17T20:59:26.643 INFO:tasks.workunit.client.0.trial104.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2026-02-17T20:59:26.644 INFO:tasks.workunit.client.0.trial104.stdout:0 of 1 processes prepared for launch 0 sec 2026-02-17T20:59:26.744 INFO:tasks.workunit.client.0.trial104.stdout:1 of 1 processes prepared for launch 0 sec 2026-02-17T20:59:26.744 INFO:tasks.workunit.client.0.trial104.stdout:releasing clients 2026-02-17T20:59:27.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:26 trial153 ceph-mon[25357]: pgmap v118: 129 pgs: 129 active+clean; 588 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 255 B/s wr, 0 op/s 2026-02-17T20:59:27.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:26 trial104 ceph-mon[20612]: pgmap v118: 129 pgs: 129 active+clean; 588 KiB data, 217 MiB used, 5.5 TiB / 5.5 TiB avail; 255 B/s wr, 0 op/s 2026-02-17T20:59:27.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 1564 26.11 MB/sec warmup 1 sec latency 5.861 ms 2026-02-17T20:59:27.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 161842 887.32 MB/sec warmup 1 sec latency 9.728 ms 2026-02-17T20:59:28.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 3006 16.77 MB/sec warmup 2 sec latency 4.968 ms 2026-02-17T20:59:28.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 327147 890.36 MB/sec warmup 2 sec latency 0.251 ms 2026-02-17T20:59:29.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:28 trial153 ceph-mon[25357]: pgmap v119: 129 pgs: 129 active+clean; 3.5 MiB data, 222 MiB used, 5.5 TiB / 5.5 TiB avail; 258 KiB/s wr, 2 op/s 2026-02-17T20:59:29.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:28 trial104 ceph-mon[20612]: pgmap v119: 129 pgs: 129 active+clean; 3.5 MiB data, 222 MiB used, 5.5 TiB / 5.5 TiB avail; 258 KiB/s wr, 2 op/s 2026-02-17T20:59:29.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 4116 13.36 MB/sec warmup 3 sec latency 4.521 ms 2026-02-17T20:59:29.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 491232 893.96 MB/sec warmup 3 sec latency 0.257 ms 2026-02-17T20:59:30.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 5405 11.37 MB/sec warmup 4 sec latency 6.102 ms 2026-02-17T20:59:30.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 657434 894.95 MB/sec warmup 4 sec latency 0.272 ms 2026-02-17T20:59:31.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:30 trial153 ceph-mon[25357]: pgmap v120: 129 pgs: 129 active+clean; 19 MiB data, 278 MiB used, 5.5 TiB / 5.5 TiB avail; 85 B/s rd, 1.6 MiB/s wr, 13 op/s 2026-02-17T20:59:31.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:30 trial104 ceph-mon[20612]: pgmap v120: 129 pgs: 129 active+clean; 19 MiB data, 278 MiB used, 5.5 TiB / 5.5 TiB avail; 85 B/s rd, 1.6 MiB/s wr, 13 op/s 2026-02-17T20:59:31.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 6865 10.90 MB/sec warmup 5 sec latency 5.155 ms 2026-02-17T20:59:31.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 825531 896.78 MB/sec warmup 5 sec latency 0.241 ms 2026-02-17T20:59:32.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 7857 9.93 MB/sec warmup 6 sec latency 6.670 ms 2026-02-17T20:59:32.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 987100 895.47 MB/sec warmup 6 sec latency 8.375 ms 2026-02-17T20:59:32.904 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:32 trial104 ceph-mon[20612]: pgmap v121: 129 pgs: 129 active+clean; 26 MiB data, 291 MiB used, 5.5 TiB / 5.5 TiB avail; 85 B/s rd, 2.5 MiB/s wr, 48 op/s 2026-02-17T20:59:33.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:32 trial153 ceph-mon[25357]: pgmap v121: 129 pgs: 129 active+clean; 26 MiB data, 291 MiB used, 5.5 TiB / 5.5 TiB avail; 85 B/s rd, 2.5 MiB/s wr, 48 op/s 2026-02-17T20:59:33.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 9201 9.27 MB/sec warmup 7 sec latency 5.922 ms 2026-02-17T20:59:33.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 1154115 896.21 MB/sec warmup 7 sec latency 0.242 ms 2026-02-17T20:59:34.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:59:34.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:59:34.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 10652 9.58 MB/sec warmup 8 sec latency 5.842 ms 2026-02-17T20:59:34.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 1321351 897.07 MB/sec warmup 8 sec latency 0.249 ms 2026-02-17T20:59:35.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:34 trial153 ceph-mon[25357]: pgmap v122: 129 pgs: 129 active+clean; 27 MiB data, 306 MiB used, 5.5 TiB / 5.5 TiB avail; 85 B/s rd, 2.6 MiB/s wr, 53 op/s 2026-02-17T20:59:35.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:34 trial104 ceph-mon[20612]: pgmap v122: 129 pgs: 129 active+clean; 27 MiB data, 306 MiB used, 5.5 TiB / 5.5 TiB avail; 85 B/s rd, 2.6 MiB/s wr, 53 op/s 2026-02-17T20:59:35.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 11685 8.92 MB/sec warmup 9 sec latency 6.969 ms 2026-02-17T20:59:35.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 1486202 897.76 MB/sec warmup 9 sec latency 0.279 ms 2026-02-17T20:59:36.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 12991 8.52 MB/sec warmup 10 sec latency 6.069 ms 2026-02-17T20:59:36.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 1652453 897.68 MB/sec warmup 10 sec latency 0.924 ms 2026-02-17T20:59:37.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:36 trial153 ceph-mon[25357]: pgmap v123: 129 pgs: 129 active+clean; 28 MiB data, 314 MiB used, 5.5 TiB / 5.5 TiB avail; 2.3 KiB/s rd, 3.2 MiB/s wr, 74 op/s 2026-02-17T20:59:37.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:36 trial104 ceph-mon[20612]: pgmap v123: 129 pgs: 129 active+clean; 28 MiB data, 314 MiB used, 5.5 TiB / 5.5 TiB avail; 2.3 KiB/s rd, 3.2 MiB/s wr, 74 op/s 2026-02-17T20:59:37.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 14356 8.74 MB/sec warmup 11 sec latency 6.638 ms 2026-02-17T20:59:37.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 1818089 897.22 MB/sec warmup 11 sec latency 0.242 ms 2026-02-17T20:59:38.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 15331 8.29 MB/sec warmup 12 sec latency 8.058 ms 2026-02-17T20:59:38.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 1982924 898.01 MB/sec warmup 12 sec latency 0.290 ms 2026-02-17T20:59:39.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:38 trial153 ceph-mon[25357]: pgmap v124: 129 pgs: 129 active+clean; 29 MiB data, 318 MiB used, 5.5 TiB / 5.5 TiB avail; 2.3 KiB/s rd, 3.7 MiB/s wr, 105 op/s 2026-02-17T20:59:39.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:38 trial104 ceph-mon[20612]: pgmap v124: 129 pgs: 129 active+clean; 29 MiB data, 318 MiB used, 5.5 TiB / 5.5 TiB avail; 2.3 KiB/s rd, 3.7 MiB/s wr, 105 op/s 2026-02-17T20:59:39.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 16650 8.05 MB/sec warmup 13 sec latency 6.243 ms 2026-02-17T20:59:39.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 2150642 898.46 MB/sec warmup 13 sec latency 0.426 ms 2026-02-17T20:59:40.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 18039 8.30 MB/sec warmup 14 sec latency 5.774 ms 2026-02-17T20:59:40.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 2316378 899.29 MB/sec warmup 14 sec latency 0.275 ms 2026-02-17T20:59:41.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:40 trial153 ceph-mon[25357]: pgmap v125: 129 pgs: 129 active+clean; 31 MiB data, 336 MiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 4.3 MiB/s wr, 152 op/s 2026-02-17T20:59:41.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:40 trial104 ceph-mon[20612]: pgmap v125: 129 pgs: 129 active+clean; 31 MiB data, 336 MiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 4.3 MiB/s wr, 152 op/s 2026-02-17T20:59:41.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 19030 7.92 MB/sec warmup 15 sec latency 8.145 ms 2026-02-17T20:59:41.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 2483825 899.57 MB/sec warmup 15 sec latency 0.243 ms 2026-02-17T20:59:42.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 20285 7.77 MB/sec warmup 16 sec latency 6.884 ms 2026-02-17T20:59:42.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 2650893 899.56 MB/sec warmup 16 sec latency 0.238 ms 2026-02-17T20:59:43.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:42 trial153 ceph-mon[25357]: pgmap v126: 129 pgs: 129 active+clean; 31 MiB data, 342 MiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 3.3 MiB/s wr, 145 op/s 2026-02-17T20:59:43.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:42 trial104 ceph-mon[20612]: pgmap v126: 129 pgs: 129 active+clean; 31 MiB data, 342 MiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 3.3 MiB/s wr, 145 op/s 2026-02-17T20:59:43.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 21617 7.97 MB/sec warmup 17 sec latency 5.661 ms 2026-02-17T20:59:43.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 2816827 900.29 MB/sec warmup 17 sec latency 1.538 ms 2026-02-17T20:59:44.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 22716 7.82 MB/sec warmup 18 sec latency 6.891 ms 2026-02-17T20:59:44.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 2982776 899.87 MB/sec warmup 18 sec latency 7.323 ms 2026-02-17T20:59:45.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:44 trial153 ceph-mon[25357]: pgmap v127: 129 pgs: 129 active+clean; 31 MiB data, 343 MiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.6 MiB/s wr, 117 op/s 2026-02-17T20:59:45.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:44 trial104 ceph-mon[20612]: pgmap v127: 129 pgs: 129 active+clean; 31 MiB data, 343 MiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.6 MiB/s wr, 117 op/s 2026-02-17T20:59:45.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 23943 7.57 MB/sec warmup 19 sec latency 5.938 ms 2026-02-17T20:59:45.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 3148363 899.55 MB/sec warmup 19 sec latency 1.033 ms 2026-02-17T20:59:46.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 25259 7.74 MB/sec warmup 20 sec latency 5.589 ms 2026-02-17T20:59:46.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 3314315 900.20 MB/sec warmup 20 sec latency 0.294 ms 2026-02-17T20:59:47.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:46 trial153 ceph-mon[25357]: pgmap v128: 129 pgs: 129 active+clean; 32 MiB data, 344 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.2 MiB/s wr, 160 op/s 2026-02-17T20:59:47.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:46 trial104 ceph-mon[20612]: pgmap v128: 129 pgs: 129 active+clean; 32 MiB data, 344 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.2 MiB/s wr, 160 op/s 2026-02-17T20:59:47.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 26412 7.62 MB/sec warmup 21 sec latency 7.678 ms 2026-02-17T20:59:47.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 3473326 898.04 MB/sec warmup 21 sec latency 38.974 ms 2026-02-17T20:59:48.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 27867 7.61 MB/sec warmup 22 sec latency 7.246 ms 2026-02-17T20:59:48.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 3638948 897.89 MB/sec warmup 22 sec latency 0.234 ms 2026-02-17T20:59:49.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:48 trial153 ceph-mon[25357]: pgmap v129: 129 pgs: 129 active+clean; 32 MiB data, 345 MiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.1 MiB/s wr, 149 op/s 2026-02-17T20:59:49.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:59:49.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:48 trial104 ceph-mon[20612]: pgmap v129: 129 pgs: 129 active+clean; 32 MiB data, 345 MiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.1 MiB/s wr, 149 op/s 2026-02-17T20:59:49.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T20:59:49.634 INFO:tasks.workunit.client.1.trial153.stdout: 1 28999 7.56 MB/sec warmup 23 sec latency 5.184 ms 2026-02-17T20:59:49.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 3801240 897.64 MB/sec warmup 23 sec latency 1.912 ms 2026-02-17T20:59:50.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 30315 7.48 MB/sec warmup 24 sec latency 5.975 ms 2026-02-17T20:59:50.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 3968853 897.93 MB/sec warmup 24 sec latency 0.239 ms 2026-02-17T20:59:51.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:50 trial153 ceph-mon[25357]: pgmap v130: 129 pgs: 129 active+clean; 35 MiB data, 362 MiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 3.4 MiB/s wr, 169 op/s 2026-02-17T20:59:51.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:50 trial104 ceph-mon[20612]: pgmap v130: 129 pgs: 129 active+clean; 35 MiB data, 362 MiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 3.4 MiB/s wr, 169 op/s 2026-02-17T20:59:51.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 31742 7.54 MB/sec warmup 25 sec latency 6.500 ms 2026-02-17T20:59:51.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 4133598 898.24 MB/sec warmup 25 sec latency 0.284 ms 2026-02-17T20:59:52.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 32774 7.45 MB/sec warmup 26 sec latency 6.869 ms 2026-02-17T20:59:52.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 4298259 897.79 MB/sec warmup 26 sec latency 1.158 ms 2026-02-17T20:59:53.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:52 trial153 ceph-mon[25357]: pgmap v131: 129 pgs: 129 active+clean; 36 MiB data, 361 MiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.0 MiB/s wr, 124 op/s 2026-02-17T20:59:53.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:59:53.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:59:53.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:59:53.025 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:59:53.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:52 trial104 ceph-mon[20612]: pgmap v131: 129 pgs: 129 active+clean; 36 MiB data, 361 MiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.0 MiB/s wr, 124 op/s 2026-02-17T20:59:53.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T20:59:53.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T20:59:53.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T20:59:53.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T20:59:53.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 34048 7.36 MB/sec warmup 27 sec latency 5.881 ms 2026-02-17T20:59:53.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 4465113 897.86 MB/sec warmup 27 sec latency 0.263 ms 2026-02-17T20:59:54.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 35484 7.52 MB/sec warmup 28 sec latency 5.591 ms 2026-02-17T20:59:54.744 INFO:tasks.workunit.client.0.trial104.stdout: 1 4630511 898.22 MB/sec warmup 28 sec latency 0.550 ms 2026-02-17T20:59:55.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:54 trial153 ceph-mon[25357]: pgmap v132: 129 pgs: 129 active+clean; 36 MiB data, 360 MiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.7 MiB/s wr, 128 op/s 2026-02-17T20:59:55.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:54 trial104 ceph-mon[20612]: pgmap v132: 129 pgs: 129 active+clean; 36 MiB data, 360 MiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.7 MiB/s wr, 128 op/s 2026-02-17T20:59:55.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 36477 7.35 MB/sec warmup 29 sec latency 6.680 ms 2026-02-17T20:59:55.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 4798732 898.46 MB/sec warmup 29 sec latency 0.270 ms 2026-02-17T20:59:56.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 37843 7.30 MB/sec warmup 30 sec latency 6.762 ms 2026-02-17T20:59:56.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 4967277 898.88 MB/sec warmup 30 sec latency 0.247 ms 2026-02-17T20:59:57.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:56 trial153 ceph-mon[25357]: pgmap v133: 129 pgs: 129 active+clean; 38 MiB data, 374 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 167 op/s 2026-02-17T20:59:57.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:56 trial104 ceph-mon[20612]: pgmap v133: 129 pgs: 129 active+clean; 38 MiB data, 374 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 167 op/s 2026-02-17T20:59:57.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 39255 7.45 MB/sec warmup 31 sec latency 5.173 ms 2026-02-17T20:59:57.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 5132285 899.10 MB/sec warmup 31 sec latency 0.795 ms 2026-02-17T20:59:58.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 40294 7.30 MB/sec warmup 32 sec latency 7.329 ms 2026-02-17T20:59:58.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 5299109 899.10 MB/sec warmup 32 sec latency 0.271 ms 2026-02-17T20:59:59.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 20:59:58 trial153 ceph-mon[25357]: pgmap v134: 129 pgs: 129 active+clean; 38 MiB data, 375 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 125 op/s 2026-02-17T20:59:59.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 20:59:58 trial104 ceph-mon[20612]: pgmap v134: 129 pgs: 129 active+clean; 38 MiB data, 375 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 125 op/s 2026-02-17T20:59:59.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 41623 7.25 MB/sec warmup 33 sec latency 6.762 ms 2026-02-17T20:59:59.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 5443557 895.47 MB/sec warmup 33 sec latency 39.719 ms 2026-02-17T21:00:00.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 42969 7.37 MB/sec warmup 34 sec latency 6.970 ms 2026-02-17T21:00:00.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 5609730 895.99 MB/sec warmup 34 sec latency 0.280 ms 2026-02-17T21:00:01.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:00 trial153 ceph-mon[25357]: pgmap v135: 129 pgs: 129 active+clean; 39 MiB data, 394 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 173 op/s 2026-02-17T21:00:01.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:00 trial153 ceph-mon[25357]: overall HEALTH_OK 2026-02-17T21:00:01.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:00 trial104 ceph-mon[20612]: pgmap v135: 129 pgs: 129 active+clean; 39 MiB data, 394 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 173 op/s 2026-02-17T21:00:01.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:00 trial104 ceph-mon[20612]: overall HEALTH_OK 2026-02-17T21:00:01.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 44130 7.30 MB/sec warmup 35 sec latency 6.928 ms 2026-02-17T21:00:01.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 5776968 896.20 MB/sec warmup 35 sec latency 0.481 ms 2026-02-17T21:00:02.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 45562 7.31 MB/sec warmup 36 sec latency 5.307 ms 2026-02-17T21:00:02.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 5944739 896.37 MB/sec warmup 36 sec latency 0.239 ms 2026-02-17T21:00:03.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:02 trial153 ceph-mon[25357]: pgmap v136: 129 pgs: 129 active+clean; 39 MiB data, 394 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 126 op/s 2026-02-17T21:00:03.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:02 trial104 ceph-mon[20612]: pgmap v136: 129 pgs: 129 active+clean; 39 MiB data, 394 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 126 op/s 2026-02-17T21:00:03.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 46652 7.29 MB/sec warmup 37 sec latency 6.021 ms 2026-02-17T21:00:03.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 6106684 896.21 MB/sec warmup 37 sec latency 9.901 ms 2026-02-17T21:00:04.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:00:04.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:00:04.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 47862 7.23 MB/sec warmup 38 sec latency 6.600 ms 2026-02-17T21:00:04.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 6274696 896.49 MB/sec warmup 38 sec latency 0.263 ms 2026-02-17T21:00:05.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:04 trial153 ceph-mon[25357]: pgmap v137: 129 pgs: 129 active+clean; 38 MiB data, 393 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.6 MiB/s wr, 129 op/s 2026-02-17T21:00:05.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:04 trial104 ceph-mon[20612]: pgmap v137: 129 pgs: 129 active+clean; 38 MiB data, 393 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.6 MiB/s wr, 129 op/s 2026-02-17T21:00:05.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 49352 7.25 MB/sec warmup 39 sec latency 6.622 ms 2026-02-17T21:00:05.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 6440010 896.74 MB/sec warmup 39 sec latency 0.292 ms 2026-02-17T21:00:06.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 50300 7.22 MB/sec warmup 40 sec latency 6.722 ms 2026-02-17T21:00:06.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 6605554 896.66 MB/sec warmup 40 sec latency 0.585 ms 2026-02-17T21:00:07.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:06 trial153 ceph-mon[25357]: pgmap v138: 129 pgs: 129 active+clean; 40 MiB data, 404 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 176 op/s 2026-02-17T21:00:07.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:06 trial104 ceph-mon[20612]: pgmap v138: 129 pgs: 129 active+clean; 40 MiB data, 404 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 176 op/s 2026-02-17T21:00:07.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 51538 7.17 MB/sec warmup 41 sec latency 7.308 ms 2026-02-17T21:00:07.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 6772317 896.72 MB/sec warmup 41 sec latency 0.252 ms 2026-02-17T21:00:08.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 53000 7.22 MB/sec warmup 42 sec latency 5.369 ms 2026-02-17T21:00:08.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 6931333 896.19 MB/sec warmup 42 sec latency 27.924 ms 2026-02-17T21:00:09.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:08 trial153 ceph-mon[25357]: pgmap v139: 129 pgs: 129 active+clean; 41 MiB data, 414 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 136 op/s 2026-02-17T21:00:09.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:08 trial104 ceph-mon[20612]: pgmap v139: 129 pgs: 129 active+clean; 41 MiB data, 414 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 136 op/s 2026-02-17T21:00:09.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 53959 7.16 MB/sec warmup 43 sec latency 7.776 ms 2026-02-17T21:00:09.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 7098004 896.22 MB/sec warmup 43 sec latency 0.302 ms 2026-02-17T21:00:10.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 55258 7.12 MB/sec warmup 44 sec latency 6.728 ms 2026-02-17T21:00:10.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 7265749 896.46 MB/sec warmup 44 sec latency 0.252 ms 2026-02-17T21:00:11.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:10 trial153 ceph-mon[25357]: pgmap v140: 129 pgs: 129 active+clean; 43 MiB data, 433 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.4 MiB/s wr, 183 op/s 2026-02-17T21:00:11.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:10 trial104 ceph-mon[20612]: pgmap v140: 129 pgs: 129 active+clean; 43 MiB data, 433 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.4 MiB/s wr, 183 op/s 2026-02-17T21:00:11.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 56624 7.16 MB/sec warmup 45 sec latency 5.149 ms 2026-02-17T21:00:11.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 7430233 896.57 MB/sec warmup 45 sec latency 0.284 ms 2026-02-17T21:00:12.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 57722 7.12 MB/sec warmup 46 sec latency 6.133 ms 2026-02-17T21:00:12.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 7596024 896.57 MB/sec warmup 46 sec latency 0.266 ms 2026-02-17T21:00:13.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:12 trial153 ceph-mon[25357]: pgmap v141: 129 pgs: 129 active+clean; 43 MiB data, 434 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.9 MiB/s wr, 130 op/s 2026-02-17T21:00:13.087 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:12 trial104 ceph-mon[20612]: pgmap v141: 129 pgs: 129 active+clean; 43 MiB data, 434 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.9 MiB/s wr, 130 op/s 2026-02-17T21:00:13.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 59102 7.10 MB/sec warmup 47 sec latency 6.220 ms 2026-02-17T21:00:13.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 7763129 896.65 MB/sec warmup 47 sec latency 0.246 ms 2026-02-17T21:00:14.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 60548 7.20 MB/sec warmup 48 sec latency 5.059 ms 2026-02-17T21:00:14.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 7927402 896.74 MB/sec warmup 48 sec latency 0.258 ms 2026-02-17T21:00:15.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:14 trial153 ceph-mon[25357]: pgmap v142: 129 pgs: 129 active+clean; 43 MiB data, 435 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.7 MiB/s wr, 133 op/s 2026-02-17T21:00:15.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:14 trial104 ceph-mon[20612]: pgmap v142: 129 pgs: 129 active+clean; 43 MiB data, 435 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.7 MiB/s wr, 133 op/s 2026-02-17T21:00:15.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 61531 7.10 MB/sec warmup 49 sec latency 6.299 ms 2026-02-17T21:00:15.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 8094183 896.79 MB/sec warmup 49 sec latency 0.295 ms 2026-02-17T21:00:16.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 62835 7.08 MB/sec warmup 50 sec latency 6.781 ms 2026-02-17T21:00:16.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 8258932 896.96 MB/sec warmup 50 sec latency 0.273 ms 2026-02-17T21:00:17.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:16 trial104 ceph-mon[20612]: pgmap v143: 129 pgs: 129 active+clean; 47 MiB data, 446 MiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 3.4 MiB/s wr, 174 op/s 2026-02-17T21:00:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:16 trial153 ceph-mon[25357]: pgmap v143: 129 pgs: 129 active+clean; 47 MiB data, 446 MiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 3.4 MiB/s wr, 174 op/s 2026-02-17T21:00:17.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 64211 7.16 MB/sec warmup 51 sec latency 6.742 ms 2026-02-17T21:00:17.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 8422427 896.63 MB/sec warmup 51 sec latency 0.284 ms 2026-02-17T21:00:18.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 65366 7.12 MB/sec warmup 52 sec latency 6.738 ms 2026-02-17T21:00:18.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 8586195 896.35 MB/sec warmup 52 sec latency 9.189 ms 2026-02-17T21:00:19.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:18 trial104 ceph-mon[20612]: pgmap v144: 129 pgs: 129 active+clean; 47 MiB data, 451 MiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.0 MiB/s wr, 127 op/s 2026-02-17T21:00:19.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:00:19.251 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:18 trial153 ceph-mon[25357]: pgmap v144: 129 pgs: 129 active+clean; 47 MiB data, 451 MiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.0 MiB/s wr, 127 op/s 2026-02-17T21:00:19.251 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:00:19.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 66845 7.13 MB/sec warmup 53 sec latency 5.303 ms 2026-02-17T21:00:19.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 8748779 896.32 MB/sec warmup 53 sec latency 0.321 ms 2026-02-17T21:00:20.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 67955 7.12 MB/sec warmup 54 sec latency 4.960 ms 2026-02-17T21:00:20.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 8915078 896.34 MB/sec warmup 54 sec latency 0.258 ms 2026-02-17T21:00:21.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:20 trial104 ceph-mon[20612]: pgmap v145: 129 pgs: 129 active+clean; 49 MiB data, 416 MiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.4 MiB/s wr, 176 op/s 2026-02-17T21:00:21.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:20 trial153 ceph-mon[25357]: pgmap v145: 129 pgs: 129 active+clean; 49 MiB data, 416 MiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.4 MiB/s wr, 176 op/s 2026-02-17T21:00:21.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 69281 7.09 MB/sec warmup 55 sec latency 6.597 ms 2026-02-17T21:00:21.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 9081957 896.39 MB/sec warmup 55 sec latency 0.262 ms 2026-02-17T21:00:22.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 70732 7.12 MB/sec warmup 56 sec latency 5.197 ms 2026-02-17T21:00:22.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 9247004 896.55 MB/sec warmup 56 sec latency 0.270 ms 2026-02-17T21:00:23.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:22 trial104 ceph-mon[20612]: pgmap v146: 129 pgs: 129 active+clean; 49 MiB data, 420 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.1 MiB/s wr, 133 op/s 2026-02-17T21:00:23.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:22 trial153 ceph-mon[25357]: pgmap v146: 129 pgs: 129 active+clean; 49 MiB data, 420 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.1 MiB/s wr, 133 op/s 2026-02-17T21:00:23.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 71780 7.09 MB/sec warmup 57 sec latency 6.595 ms 2026-02-17T21:00:23.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 9410598 896.29 MB/sec warmup 57 sec latency 7.205 ms 2026-02-17T21:00:24.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 73129 7.06 MB/sec warmup 58 sec latency 5.465 ms 2026-02-17T21:00:24.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 9575772 896.22 MB/sec warmup 58 sec latency 0.272 ms 2026-02-17T21:00:25.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:24 trial104 ceph-mon[20612]: pgmap v147: 129 pgs: 129 active+clean; 49 MiB data, 421 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 136 op/s 2026-02-17T21:00:25.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:24 trial153 ceph-mon[25357]: pgmap v147: 129 pgs: 129 active+clean; 49 MiB data, 421 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 136 op/s 2026-02-17T21:00:25.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 74561 7.13 MB/sec warmup 59 sec latency 5.132 ms 2026-02-17T21:00:25.745 INFO:tasks.workunit.client.0.trial104.stdout: 1 9740405 896.37 MB/sec warmup 59 sec latency 0.286 ms 2026-02-17T21:00:26.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 75602 7.08 MB/sec warmup 60 sec latency 7.396 ms 2026-02-17T21:00:26.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 9906762 896.36 MB/sec warmup 60 sec latency 0.239 ms 2026-02-17T21:00:27.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:26 trial104 ceph-mon[20612]: pgmap v148: 129 pgs: 129 active+clean; 49 MiB data, 426 MiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.2 MiB/s wr, 161 op/s 2026-02-17T21:00:27.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:26 trial153 ceph-mon[25357]: pgmap v148: 129 pgs: 129 active+clean; 49 MiB data, 426 MiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.2 MiB/s wr, 161 op/s 2026-02-17T21:00:27.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 76941 7.04 MB/sec warmup 61 sec latency 5.500 ms 2026-02-17T21:00:27.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 10072897 896.37 MB/sec warmup 61 sec latency 0.277 ms 2026-02-17T21:00:28.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 78361 7.12 MB/sec warmup 62 sec latency 5.851 ms 2026-02-17T21:00:28.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 10234348 896.21 MB/sec warmup 62 sec latency 18.132 ms 2026-02-17T21:00:29.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:28 trial104 ceph-mon[20612]: pgmap v149: 129 pgs: 129 active+clean; 51 MiB data, 431 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.1 MiB/s wr, 148 op/s 2026-02-17T21:00:29.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:28 trial153 ceph-mon[25357]: pgmap v149: 129 pgs: 129 active+clean; 51 MiB data, 431 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.1 MiB/s wr, 148 op/s 2026-02-17T21:00:29.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 79490 7.09 MB/sec warmup 63 sec latency 6.600 ms 2026-02-17T21:00:29.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 10400395 896.20 MB/sec warmup 63 sec latency 0.310 ms 2026-02-17T21:00:30.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 80863 7.07 MB/sec warmup 64 sec latency 6.257 ms 2026-02-17T21:00:30.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 10565130 896.32 MB/sec warmup 64 sec latency 0.272 ms 2026-02-17T21:00:31.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:30 trial104 ceph-mon[20612]: pgmap v150: 129 pgs: 129 active+clean; 51 MiB data, 442 MiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 3.4 MiB/s wr, 168 op/s 2026-02-17T21:00:31.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:30 trial153 ceph-mon[25357]: pgmap v150: 129 pgs: 129 active+clean; 51 MiB data, 442 MiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 3.4 MiB/s wr, 168 op/s 2026-02-17T21:00:31.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 82083 7.09 MB/sec warmup 65 sec latency 5.213 ms 2026-02-17T21:00:31.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 10731318 896.36 MB/sec warmup 65 sec latency 0.267 ms 2026-02-17T21:00:32.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 83255 7.06 MB/sec warmup 66 sec latency 7.285 ms 2026-02-17T21:00:32.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 10897322 896.32 MB/sec warmup 66 sec latency 0.233 ms 2026-02-17T21:00:33.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:32 trial104 ceph-mon[20612]: pgmap v151: 129 pgs: 129 active+clean; 52 MiB data, 445 MiB used, 5.5 TiB / 5.5 TiB avail; 5.4 KiB/s rd, 3.1 MiB/s wr, 143 op/s 2026-02-17T21:00:33.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:32 trial153 ceph-mon[25357]: pgmap v151: 129 pgs: 129 active+clean; 52 MiB data, 445 MiB used, 5.5 TiB / 5.5 TiB avail; 5.4 KiB/s rd, 3.1 MiB/s wr, 143 op/s 2026-02-17T21:00:33.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 84627 7.07 MB/sec warmup 67 sec latency 5.591 ms 2026-02-17T21:00:33.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 11057089 896.07 MB/sec warmup 67 sec latency 15.810 ms 2026-02-17T21:00:34.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:00:34.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:00:34.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 85730 7.06 MB/sec warmup 68 sec latency 6.454 ms 2026-02-17T21:00:34.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 11223523 896.07 MB/sec warmup 68 sec latency 0.279 ms 2026-02-17T21:00:35.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:34 trial104 ceph-mon[20612]: pgmap v152: 129 pgs: 129 active+clean; 53 MiB data, 445 MiB used, 5.5 TiB / 5.5 TiB avail; 5.4 KiB/s rd, 2.8 MiB/s wr, 142 op/s 2026-02-17T21:00:35.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:34 trial153 ceph-mon[25357]: pgmap v152: 129 pgs: 129 active+clean; 53 MiB data, 445 MiB used, 5.5 TiB / 5.5 TiB avail; 5.4 KiB/s rd, 2.8 MiB/s wr, 142 op/s 2026-02-17T21:00:35.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 87020 7.03 MB/sec warmup 69 sec latency 6.851 ms 2026-02-17T21:00:35.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 11389941 896.08 MB/sec warmup 69 sec latency 0.271 ms 2026-02-17T21:00:36.635 INFO:tasks.workunit.client.1.trial153.stdout: 1 88499 7.06 MB/sec warmup 70 sec latency 4.969 ms 2026-02-17T21:00:36.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 11555520 896.27 MB/sec warmup 70 sec latency 0.532 ms 2026-02-17T21:00:37.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:36 trial104 ceph-mon[20612]: pgmap v153: 129 pgs: 129 active+clean; 52 MiB data, 490 MiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 3.2 MiB/s wr, 156 op/s 2026-02-17T21:00:37.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:36 trial153 ceph-mon[25357]: pgmap v153: 129 pgs: 129 active+clean; 52 MiB data, 490 MiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 3.2 MiB/s wr, 156 op/s 2026-02-17T21:00:37.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 89554 7.04 MB/sec warmup 71 sec latency 6.955 ms 2026-02-17T21:00:37.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 11722400 896.31 MB/sec warmup 71 sec latency 0.281 ms 2026-02-17T21:00:38.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 90887 7.01 MB/sec warmup 72 sec latency 6.474 ms 2026-02-17T21:00:38.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 11885003 896.05 MB/sec warmup 72 sec latency 23.389 ms 2026-02-17T21:00:39.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:38 trial104 ceph-mon[20612]: pgmap v154: 129 pgs: 129 active+clean; 56 MiB data, 493 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.3 MiB/s wr, 159 op/s 2026-02-17T21:00:39.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:38 trial153 ceph-mon[25357]: pgmap v154: 129 pgs: 129 active+clean; 56 MiB data, 493 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.3 MiB/s wr, 159 op/s 2026-02-17T21:00:39.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 92266 7.08 MB/sec warmup 73 sec latency 5.465 ms 2026-02-17T21:00:39.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 12050281 896.19 MB/sec warmup 73 sec latency 0.279 ms 2026-02-17T21:00:40.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 93312 7.03 MB/sec warmup 74 sec latency 6.308 ms 2026-02-17T21:00:40.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 12217303 896.24 MB/sec warmup 74 sec latency 0.343 ms 2026-02-17T21:00:41.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:40 trial104 ceph-mon[20612]: pgmap v155: 129 pgs: 129 active+clean; 57 MiB data, 496 MiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.2 MiB/s wr, 149 op/s 2026-02-17T21:00:41.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:40 trial153 ceph-mon[25357]: pgmap v155: 129 pgs: 129 active+clean; 57 MiB data, 496 MiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.2 MiB/s wr, 149 op/s 2026-02-17T21:00:41.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 94639 7.00 MB/sec warmup 75 sec latency 5.771 ms 2026-02-17T21:00:41.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 12380941 896.28 MB/sec warmup 75 sec latency 0.293 ms 2026-02-17T21:00:42.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 96063 7.07 MB/sec warmup 76 sec latency 5.495 ms 2026-02-17T21:00:42.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 12546249 896.25 MB/sec warmup 76 sec latency 0.265 ms 2026-02-17T21:00:43.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:42 trial104 ceph-mon[20612]: pgmap v156: 129 pgs: 129 active+clean; 59 MiB data, 520 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.2 MiB/s wr, 154 op/s 2026-02-17T21:00:43.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:42 trial153 ceph-mon[25357]: pgmap v156: 129 pgs: 129 active+clean; 59 MiB data, 520 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.2 MiB/s wr, 154 op/s 2026-02-17T21:00:43.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 97107 7.01 MB/sec warmup 77 sec latency 8.273 ms 2026-02-17T21:00:43.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 12711483 896.17 MB/sec warmup 77 sec latency 0.245 ms 2026-02-17T21:00:44.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 98433 6.99 MB/sec warmup 78 sec latency 5.849 ms 2026-02-17T21:00:44.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 12870374 895.87 MB/sec warmup 78 sec latency 21.342 ms 2026-02-17T21:00:45.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:44 trial104 ceph-mon[20612]: pgmap v157: 129 pgs: 129 active+clean; 59 MiB data, 505 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 128 op/s 2026-02-17T21:00:45.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:44 trial153 ceph-mon[25357]: pgmap v157: 129 pgs: 129 active+clean; 59 MiB data, 505 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 128 op/s 2026-02-17T21:00:45.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 99780 7.04 MB/sec warmup 79 sec latency 6.363 ms 2026-02-17T21:00:45.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 13037306 895.94 MB/sec warmup 79 sec latency 0.283 ms 2026-02-17T21:00:46.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 100982 7.02 MB/sec warmup 80 sec latency 6.544 ms 2026-02-17T21:00:46.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 13203318 895.92 MB/sec warmup 80 sec latency 0.228 ms 2026-02-17T21:00:47.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:46 trial104 ceph-mon[20612]: pgmap v158: 129 pgs: 129 active+clean; 59 MiB data, 510 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.1 MiB/s wr, 142 op/s 2026-02-17T21:00:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:46 trial153 ceph-mon[25357]: pgmap v158: 129 pgs: 129 active+clean; 59 MiB data, 510 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.1 MiB/s wr, 142 op/s 2026-02-17T21:00:47.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 102541 7.03 MB/sec warmup 81 sec latency 5.228 ms 2026-02-17T21:00:47.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 13368405 896.04 MB/sec warmup 81 sec latency 0.261 ms 2026-02-17T21:00:48.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 103489 7.02 MB/sec warmup 82 sec latency 5.527 ms 2026-02-17T21:00:48.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 13534498 896.04 MB/sec warmup 82 sec latency 0.235 ms 2026-02-17T21:00:49.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:48 trial104 ceph-mon[20612]: pgmap v159: 129 pgs: 129 active+clean; 61 MiB data, 513 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.3 MiB/s wr, 162 op/s 2026-02-17T21:00:49.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:00:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:48 trial153 ceph-mon[25357]: pgmap v159: 129 pgs: 129 active+clean; 61 MiB data, 513 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.3 MiB/s wr, 162 op/s 2026-02-17T21:00:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:00:49.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 104783 7.00 MB/sec warmup 83 sec latency 7.862 ms 2026-02-17T21:00:49.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 13700657 896.05 MB/sec warmup 83 sec latency 4.722 ms 2026-02-17T21:00:50.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 106224 7.02 MB/sec warmup 84 sec latency 6.915 ms 2026-02-17T21:00:50.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 13866961 896.25 MB/sec warmup 84 sec latency 0.289 ms 2026-02-17T21:00:51.075 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:50 trial153 ceph-mon[25357]: pgmap v160: 129 pgs: 129 active+clean; 62 MiB data, 546 MiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.3 MiB/s wr, 168 op/s 2026-02-17T21:00:51.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:50 trial104 ceph-mon[20612]: pgmap v160: 129 pgs: 129 active+clean; 62 MiB data, 546 MiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.3 MiB/s wr, 168 op/s 2026-02-17T21:00:51.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 107235 7.00 MB/sec warmup 85 sec latency 7.088 ms 2026-02-17T21:00:51.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 14033040 896.22 MB/sec warmup 85 sec latency 0.278 ms 2026-02-17T21:00:52.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 108534 6.98 MB/sec warmup 86 sec latency 5.657 ms 2026-02-17T21:00:52.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 14198091 896.17 MB/sec warmup 86 sec latency 0.367 ms 2026-02-17T21:00:53.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:52 trial104 ceph-mon[20612]: pgmap v161: 129 pgs: 129 active+clean; 61 MiB data, 550 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 146 op/s 2026-02-17T21:00:53.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:00:53.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:00:53.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:00:53.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:00:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:52 trial153 ceph-mon[25357]: pgmap v161: 129 pgs: 129 active+clean; 61 MiB data, 550 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 146 op/s 2026-02-17T21:00:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:00:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:00:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:00:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:00:53.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 109988 7.04 MB/sec warmup 87 sec latency 5.057 ms 2026-02-17T21:00:53.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 14363252 896.28 MB/sec warmup 87 sec latency 0.283 ms 2026-02-17T21:00:54.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 110971 6.99 MB/sec warmup 88 sec latency 8.254 ms 2026-02-17T21:00:54.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 14528587 896.25 MB/sec warmup 88 sec latency 17.877 ms 2026-02-17T21:00:55.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:54 trial104 ceph-mon[20612]: pgmap v162: 129 pgs: 129 active+clean; 62 MiB data, 554 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.7 MiB/s wr, 125 op/s 2026-02-17T21:00:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:54 trial153 ceph-mon[25357]: pgmap v162: 129 pgs: 129 active+clean; 62 MiB data, 554 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.7 MiB/s wr, 125 op/s 2026-02-17T21:00:55.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 112341 6.97 MB/sec warmup 89 sec latency 5.858 ms 2026-02-17T21:00:55.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 14694187 896.37 MB/sec warmup 89 sec latency 0.314 ms 2026-02-17T21:00:56.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 113752 7.03 MB/sec warmup 90 sec latency 5.309 ms 2026-02-17T21:00:56.746 INFO:tasks.workunit.client.0.trial104.stdout: 1 14861016 896.40 MB/sec warmup 90 sec latency 0.240 ms 2026-02-17T21:00:57.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:56 trial104 ceph-mon[20612]: pgmap v163: 129 pgs: 129 active+clean; 65 MiB data, 573 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.3 MiB/s wr, 165 op/s 2026-02-17T21:00:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:56 trial153 ceph-mon[25357]: pgmap v163: 129 pgs: 129 active+clean; 65 MiB data, 573 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.3 MiB/s wr, 165 op/s 2026-02-17T21:00:57.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 114720 6.98 MB/sec warmup 91 sec latency 6.841 ms 2026-02-17T21:00:57.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 15027148 896.41 MB/sec warmup 91 sec latency 0.274 ms 2026-02-17T21:00:58.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 115998 6.96 MB/sec warmup 92 sec latency 5.616 ms 2026-02-17T21:00:58.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 15191914 896.51 MB/sec warmup 92 sec latency 0.273 ms 2026-02-17T21:00:58.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:00:58 trial104 ceph-mon[20612]: pgmap v164: 129 pgs: 129 active+clean; 66 MiB data, 576 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.2 MiB/s wr, 150 op/s 2026-02-17T21:00:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:00:58 trial153 ceph-mon[25357]: pgmap v164: 129 pgs: 129 active+clean; 66 MiB data, 576 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.2 MiB/s wr, 150 op/s 2026-02-17T21:00:59.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 117399 7.01 MB/sec warmup 93 sec latency 5.341 ms 2026-02-17T21:00:59.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 15360192 896.63 MB/sec warmup 93 sec latency 0.241 ms 2026-02-17T21:01:00.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 118545 6.99 MB/sec warmup 94 sec latency 6.494 ms 2026-02-17T21:01:00.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 15527989 896.71 MB/sec warmup 94 sec latency 0.231 ms 2026-02-17T21:01:01.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:00 trial104 ceph-mon[20612]: pgmap v165: 129 pgs: 129 active+clean; 66 MiB data, 619 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.3 MiB/s wr, 161 op/s 2026-02-17T21:01:01.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:00 trial153 ceph-mon[25357]: pgmap v165: 129 pgs: 129 active+clean; 66 MiB data, 619 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.3 MiB/s wr, 161 op/s 2026-02-17T21:01:01.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 119968 6.98 MB/sec warmup 95 sec latency 4.885 ms 2026-02-17T21:01:01.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 15692723 896.78 MB/sec warmup 95 sec latency 0.266 ms 2026-02-17T21:01:02.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 121079 6.99 MB/sec warmup 96 sec latency 5.067 ms 2026-02-17T21:01:02.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 15860895 896.92 MB/sec warmup 96 sec latency 0.252 ms 2026-02-17T21:01:03.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:02 trial104 ceph-mon[20612]: pgmap v166: 129 pgs: 129 active+clean; 66 MiB data, 618 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.9 MiB/s wr, 124 op/s 2026-02-17T21:01:03.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:02 trial153 ceph-mon[25357]: pgmap v166: 129 pgs: 129 active+clean; 66 MiB data, 618 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.9 MiB/s wr, 124 op/s 2026-02-17T21:01:03.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 122249 6.97 MB/sec warmup 97 sec latency 6.178 ms 2026-02-17T21:01:03.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 16026457 896.86 MB/sec warmup 97 sec latency 1.080 ms 2026-02-17T21:01:03.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:01:04.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:01:04.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 123635 6.98 MB/sec warmup 98 sec latency 5.055 ms 2026-02-17T21:01:04.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 16188938 896.83 MB/sec warmup 98 sec latency 15.507 ms 2026-02-17T21:01:05.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:04 trial104 ceph-mon[20612]: pgmap v167: 129 pgs: 129 active+clean; 65 MiB data, 616 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.8 MiB/s wr, 128 op/s 2026-02-17T21:01:05.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:04 trial153 ceph-mon[25357]: pgmap v167: 129 pgs: 129 active+clean; 65 MiB data, 616 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.8 MiB/s wr, 128 op/s 2026-02-17T21:01:05.636 INFO:tasks.workunit.client.1.trial153.stdout: 1 124708 6.97 MB/sec warmup 99 sec latency 5.375 ms 2026-02-17T21:01:05.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 16354996 896.81 MB/sec warmup 99 sec latency 0.282 ms 2026-02-17T21:01:06.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 126020 6.96 MB/sec warmup 100 sec latency 7.156 ms 2026-02-17T21:01:06.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 16520021 896.89 MB/sec warmup 100 sec latency 0.284 ms 2026-02-17T21:01:07.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:06 trial104 ceph-mon[20612]: pgmap v168: 129 pgs: 129 active+clean; 69 MiB data, 602 MiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.2 MiB/s wr, 169 op/s 2026-02-17T21:01:07.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:06 trial153 ceph-mon[25357]: pgmap v168: 129 pgs: 129 active+clean; 69 MiB data, 602 MiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.2 MiB/s wr, 169 op/s 2026-02-17T21:01:07.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 127495 6.98 MB/sec warmup 101 sec latency 5.723 ms 2026-02-17T21:01:07.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 16687767 896.98 MB/sec warmup 101 sec latency 0.238 ms 2026-02-17T21:01:08.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 128485 6.96 MB/sec warmup 102 sec latency 6.915 ms 2026-02-17T21:01:08.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 16854021 896.95 MB/sec warmup 102 sec latency 0.245 ms 2026-02-17T21:01:09.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:08 trial104 ceph-mon[20612]: pgmap v169: 129 pgs: 129 active+clean; 71 MiB data, 603 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.1 MiB/s wr, 139 op/s 2026-02-17T21:01:09.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:08 trial153 ceph-mon[25357]: pgmap v169: 129 pgs: 129 active+clean; 71 MiB data, 603 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.1 MiB/s wr, 139 op/s 2026-02-17T21:01:09.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 129799 6.94 MB/sec warmup 103 sec latency 7.033 ms 2026-02-17T21:01:09.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 17017176 896.97 MB/sec warmup 103 sec latency 14.564 ms 2026-02-17T21:01:10.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 131294 6.99 MB/sec warmup 104 sec latency 4.774 ms 2026-02-17T21:01:10.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 17183933 896.99 MB/sec warmup 104 sec latency 0.252 ms 2026-02-17T21:01:11.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:10 trial104 ceph-mon[20612]: pgmap v170: 129 pgs: 129 active+clean; 71 MiB data, 605 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.2 MiB/s wr, 162 op/s 2026-02-17T21:01:11.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:10 trial153 ceph-mon[25357]: pgmap v170: 129 pgs: 129 active+clean; 71 MiB data, 605 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.2 MiB/s wr, 162 op/s 2026-02-17T21:01:11.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 132326 6.96 MB/sec warmup 105 sec latency 6.707 ms 2026-02-17T21:01:11.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 17349453 896.95 MB/sec warmup 105 sec latency 0.246 ms 2026-02-17T21:01:12.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 133638 6.94 MB/sec warmup 106 sec latency 6.157 ms 2026-02-17T21:01:12.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 17515086 897.04 MB/sec warmup 106 sec latency 0.343 ms 2026-02-17T21:01:13.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:12 trial104 ceph-mon[20612]: pgmap v171: 129 pgs: 129 active+clean; 72 MiB data, 607 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 144 op/s 2026-02-17T21:01:13.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:12 trial153 ceph-mon[25357]: pgmap v171: 129 pgs: 129 active+clean; 72 MiB data, 607 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 144 op/s 2026-02-17T21:01:13.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 135059 6.98 MB/sec warmup 107 sec latency 5.842 ms 2026-02-17T21:01:13.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 17680212 897.00 MB/sec warmup 107 sec latency 0.256 ms 2026-02-17T21:01:14.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 136027 6.94 MB/sec warmup 108 sec latency 6.157 ms 2026-02-17T21:01:14.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 17844582 896.89 MB/sec warmup 108 sec latency 11.615 ms 2026-02-17T21:01:15.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:14 trial104 ceph-mon[20612]: pgmap v172: 129 pgs: 129 active+clean; 73 MiB data, 627 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 147 op/s 2026-02-17T21:01:15.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:14 trial153 ceph-mon[25357]: pgmap v172: 129 pgs: 129 active+clean; 73 MiB data, 627 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 147 op/s 2026-02-17T21:01:15.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 137322 6.93 MB/sec warmup 109 sec latency 5.847 ms 2026-02-17T21:01:15.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 18009910 897.00 MB/sec warmup 109 sec latency 0.272 ms 2026-02-17T21:01:16.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 138689 6.97 MB/sec warmup 110 sec latency 6.055 ms 2026-02-17T21:01:16.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 18176277 897.00 MB/sec warmup 110 sec latency 0.237 ms 2026-02-17T21:01:17.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:16 trial104 ceph-mon[20612]: pgmap v173: 129 pgs: 129 active+clean; 73 MiB data, 634 MiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.3 MiB/s wr, 165 op/s 2026-02-17T21:01:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:16 trial153 ceph-mon[25357]: pgmap v173: 129 pgs: 129 active+clean; 73 MiB data, 634 MiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.3 MiB/s wr, 165 op/s 2026-02-17T21:01:17.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 139840 6.95 MB/sec warmup 111 sec latency 7.817 ms 2026-02-17T21:01:17.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 18342455 897.15 MB/sec warmup 111 sec latency 0.278 ms 2026-02-17T21:01:18.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 141297 6.96 MB/sec warmup 112 sec latency 5.338 ms 2026-02-17T21:01:18.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 18509144 897.17 MB/sec warmup 112 sec latency 0.253 ms 2026-02-17T21:01:19.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:18 trial104 ceph-mon[20612]: pgmap v174: 129 pgs: 129 active+clean; 73 MiB data, 622 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.1 MiB/s wr, 135 op/s 2026-02-17T21:01:19.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:01:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:18 trial153 ceph-mon[25357]: pgmap v174: 129 pgs: 129 active+clean; 73 MiB data, 622 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.1 MiB/s wr, 135 op/s 2026-02-17T21:01:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:01:19.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 142401 6.95 MB/sec warmup 113 sec latency 7.401 ms 2026-02-17T21:01:19.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 18674008 897.09 MB/sec warmup 113 sec latency 3.606 ms 2026-02-17T21:01:20.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 143675 6.94 MB/sec warmup 114 sec latency 6.522 ms 2026-02-17T21:01:20.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 18839959 897.21 MB/sec warmup 114 sec latency 0.375 ms 2026-02-17T21:01:21.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:20 trial104 ceph-mon[20612]: pgmap v175: 129 pgs: 129 active+clean; 76 MiB data, 635 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.4 MiB/s wr, 171 op/s 2026-02-17T21:01:21.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:20 trial153 ceph-mon[25357]: pgmap v175: 129 pgs: 129 active+clean; 76 MiB data, 635 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.4 MiB/s wr, 171 op/s 2026-02-17T21:01:21.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 145210 6.96 MB/sec warmup 115 sec latency 5.352 ms 2026-02-17T21:01:21.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 19007356 897.24 MB/sec warmup 115 sec latency 0.267 ms 2026-02-17T21:01:22.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 146198 6.94 MB/sec warmup 116 sec latency 8.274 ms 2026-02-17T21:01:22.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 19173624 897.24 MB/sec warmup 116 sec latency 0.358 ms 2026-02-17T21:01:23.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:22 trial104 ceph-mon[20612]: pgmap v176: 129 pgs: 129 active+clean; 76 MiB data, 635 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.1 MiB/s wr, 142 op/s 2026-02-17T21:01:23.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:22 trial153 ceph-mon[25357]: pgmap v176: 129 pgs: 129 active+clean; 76 MiB data, 635 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.1 MiB/s wr, 142 op/s 2026-02-17T21:01:23.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 147543 6.93 MB/sec warmup 117 sec latency 6.131 ms 2026-02-17T21:01:23.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 19338067 897.29 MB/sec warmup 117 sec latency 0.288 ms 2026-02-17T21:01:24.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 149009 6.97 MB/sec warmup 118 sec latency 5.588 ms 2026-02-17T21:01:24.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 19505236 897.34 MB/sec warmup 118 sec latency 0.369 ms 2026-02-17T21:01:25.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:24 trial104 ceph-mon[20612]: pgmap v177: 129 pgs: 129 active+clean; 76 MiB data, 639 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.7 MiB/s wr, 117 op/s 2026-02-17T21:01:25.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:24 trial153 ceph-mon[25357]: pgmap v177: 129 pgs: 129 active+clean; 76 MiB data, 639 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.7 MiB/s wr, 117 op/s 2026-02-17T21:01:25.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 150056 6.94 MB/sec warmup 119 sec latency 6.345 ms 2026-02-17T21:01:25.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 19672393 897.37 MB/sec warmup 119 sec latency 2.496 ms 2026-02-17T21:01:27.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:26 trial104 ceph-mon[20612]: pgmap v178: 129 pgs: 129 active+clean; 79 MiB data, 654 MiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.3 MiB/s wr, 161 op/s 2026-02-17T21:01:27.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:26 trial153 ceph-mon[25357]: pgmap v178: 129 pgs: 129 active+clean; 79 MiB data, 654 MiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.3 MiB/s wr, 161 op/s 2026-02-17T21:01:27.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 152814 11.74 MB/sec execute 1 sec latency 25.516 ms 2026-02-17T21:01:27.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 20005064 903.41 MB/sec execute 1 sec latency 0.287 ms 2026-02-17T21:01:28.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 153938 8.55 MB/sec execute 2 sec latency 7.168 ms 2026-02-17T21:01:28.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 20171496 909.22 MB/sec execute 2 sec latency 0.266 ms 2026-02-17T21:01:29.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:28 trial104 ceph-mon[20612]: pgmap v179: 129 pgs: 129 active+clean; 80 MiB data, 656 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.2 MiB/s wr, 142 op/s 2026-02-17T21:01:29.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:28 trial153 ceph-mon[25357]: pgmap v179: 129 pgs: 129 active+clean; 80 MiB data, 656 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.2 MiB/s wr, 142 op/s 2026-02-17T21:01:29.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 155182 6.83 MB/sec execute 3 sec latency 6.431 ms 2026-02-17T21:01:29.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 20339252 907.38 MB/sec execute 3 sec latency 0.250 ms 2026-02-17T21:01:30.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 156529 7.79 MB/sec execute 4 sec latency 4.628 ms 2026-02-17T21:01:30.747 INFO:tasks.workunit.client.0.trial104.stdout: 1 20507141 907.03 MB/sec execute 4 sec latency 2.954 ms 2026-02-17T21:01:31.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:30 trial104 ceph-mon[20612]: pgmap v180: 129 pgs: 129 active+clean; 81 MiB data, 667 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 176 op/s 2026-02-17T21:01:31.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:30 trial153 ceph-mon[25357]: pgmap v180: 129 pgs: 129 active+clean; 81 MiB data, 667 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 176 op/s 2026-02-17T21:01:31.637 INFO:tasks.workunit.client.1.trial153.stdout: 1 157716 7.27 MB/sec execute 5 sec latency 6.682 ms 2026-02-17T21:01:31.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 20672301 907.12 MB/sec execute 5 sec latency 0.275 ms 2026-02-17T21:01:32.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 159266 7.39 MB/sec execute 6 sec latency 5.584 ms 2026-02-17T21:01:32.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 20840235 906.60 MB/sec execute 6 sec latency 0.237 ms 2026-02-17T21:01:33.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:32 trial104 ceph-mon[20612]: pgmap v181: 129 pgs: 129 active+clean; 81 MiB data, 668 MiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.9 MiB/s wr, 129 op/s 2026-02-17T21:01:33.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:32 trial153 ceph-mon[25357]: pgmap v181: 129 pgs: 129 active+clean; 81 MiB data, 668 MiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.9 MiB/s wr, 129 op/s 2026-02-17T21:01:33.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 160228 7.19 MB/sec execute 7 sec latency 5.243 ms 2026-02-17T21:01:33.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 21008016 906.49 MB/sec execute 7 sec latency 0.232 ms 2026-02-17T21:01:34.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:01:34.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:01:34.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 161503 6.96 MB/sec execute 8 sec latency 7.415 ms 2026-02-17T21:01:34.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 21173167 906.61 MB/sec execute 8 sec latency 0.270 ms 2026-02-17T21:01:35.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:34 trial104 ceph-mon[20612]: pgmap v182: 129 pgs: 129 active+clean; 80 MiB data, 695 MiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.9 MiB/s wr, 137 op/s 2026-02-17T21:01:35.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:34 trial153 ceph-mon[25357]: pgmap v182: 129 pgs: 129 active+clean; 80 MiB data, 695 MiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.9 MiB/s wr, 137 op/s 2026-02-17T21:01:35.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 162956 7.19 MB/sec execute 9 sec latency 5.916 ms 2026-02-17T21:01:35.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 21338063 904.39 MB/sec execute 9 sec latency 15.545 ms 2026-02-17T21:01:36.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 163998 6.99 MB/sec execute 10 sec latency 5.847 ms 2026-02-17T21:01:36.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 21505832 904.67 MB/sec execute 10 sec latency 0.264 ms 2026-02-17T21:01:37.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:36 trial104 ceph-mon[20612]: pgmap v183: 129 pgs: 129 active+clean; 83 MiB data, 709 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 175 op/s 2026-02-17T21:01:37.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:36 trial153 ceph-mon[25357]: pgmap v183: 129 pgs: 129 active+clean; 83 MiB data, 709 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 175 op/s 2026-02-17T21:01:37.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 165326 6.83 MB/sec execute 11 sec latency 6.290 ms 2026-02-17T21:01:37.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 21671758 905.15 MB/sec execute 11 sec latency 0.272 ms 2026-02-17T21:01:38.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 166711 7.24 MB/sec execute 12 sec latency 5.420 ms 2026-02-17T21:01:38.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 21839512 905.20 MB/sec execute 12 sec latency 0.230 ms 2026-02-17T21:01:39.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:38 trial104 ceph-mon[20612]: pgmap v184: 129 pgs: 129 active+clean; 83 MiB data, 692 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 132 op/s 2026-02-17T21:01:39.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:38 trial153 ceph-mon[25357]: pgmap v184: 129 pgs: 129 active+clean; 83 MiB data, 692 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 132 op/s 2026-02-17T21:01:39.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 167708 6.88 MB/sec execute 13 sec latency 6.743 ms 2026-02-17T21:01:39.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 22004626 905.38 MB/sec execute 13 sec latency 0.350 ms 2026-02-17T21:01:40.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 169069 6.81 MB/sec execute 14 sec latency 6.977 ms 2026-02-17T21:01:40.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 22170818 904.79 MB/sec execute 14 sec latency 10.182 ms 2026-02-17T21:01:41.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:40 trial104 ceph-mon[20612]: pgmap v185: 129 pgs: 129 active+clean; 84 MiB data, 693 MiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 3.4 MiB/s wr, 179 op/s 2026-02-17T21:01:41.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:40 trial153 ceph-mon[25357]: pgmap v185: 129 pgs: 129 active+clean; 84 MiB data, 693 MiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 3.4 MiB/s wr, 179 op/s 2026-02-17T21:01:41.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 170490 7.16 MB/sec execute 15 sec latency 6.298 ms 2026-02-17T21:01:41.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 22338233 904.51 MB/sec execute 15 sec latency 0.253 ms 2026-02-17T21:01:42.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 171490 6.86 MB/sec execute 16 sec latency 6.143 ms 2026-02-17T21:01:42.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 22503897 904.71 MB/sec execute 16 sec latency 0.270 ms 2026-02-17T21:01:43.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:42 trial104 ceph-mon[20612]: pgmap v186: 129 pgs: 129 active+clean; 84 MiB data, 693 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.0 MiB/s wr, 128 op/s 2026-02-17T21:01:43.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:42 trial153 ceph-mon[25357]: pgmap v186: 129 pgs: 129 active+clean; 84 MiB data, 693 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.0 MiB/s wr, 128 op/s 2026-02-17T21:01:43.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 172850 6.80 MB/sec execute 17 sec latency 5.782 ms 2026-02-17T21:01:43.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 22670715 904.41 MB/sec execute 17 sec latency 0.271 ms 2026-02-17T21:01:44.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 174211 7.04 MB/sec execute 18 sec latency 4.734 ms 2026-02-17T21:01:44.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 22835708 903.68 MB/sec execute 18 sec latency 2.016 ms 2026-02-17T21:01:45.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:44 trial104 ceph-mon[20612]: pgmap v187: 129 pgs: 129 active+clean; 84 MiB data, 681 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.0 MiB/s wr, 136 op/s 2026-02-17T21:01:45.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:44 trial153 ceph-mon[25357]: pgmap v187: 129 pgs: 129 active+clean; 84 MiB data, 681 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.0 MiB/s wr, 136 op/s 2026-02-17T21:01:45.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 175434 6.95 MB/sec execute 19 sec latency 5.674 ms 2026-02-17T21:01:45.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 23001863 904.17 MB/sec execute 19 sec latency 0.272 ms 2026-02-17T21:01:46.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 176990 7.00 MB/sec execute 20 sec latency 5.190 ms 2026-02-17T21:01:46.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 23168813 903.99 MB/sec execute 20 sec latency 0.244 ms 2026-02-17T21:01:47.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:46 trial104 ceph-mon[20612]: pgmap v188: 129 pgs: 129 active+clean; 86 MiB data, 681 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.2 MiB/s wr, 170 op/s 2026-02-17T21:01:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:46 trial153 ceph-mon[25357]: pgmap v188: 129 pgs: 129 active+clean; 86 MiB data, 681 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.2 MiB/s wr, 170 op/s 2026-02-17T21:01:47.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 177941 6.95 MB/sec execute 21 sec latency 5.355 ms 2026-02-17T21:01:47.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 23335820 903.88 MB/sec execute 21 sec latency 0.234 ms 2026-02-17T21:01:48.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 179151 6.87 MB/sec execute 22 sec latency 8.519 ms 2026-02-17T21:01:48.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 23500459 903.84 MB/sec execute 22 sec latency 0.280 ms 2026-02-17T21:01:49.133 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:48 trial104 ceph-mon[20612]: pgmap v189: 129 pgs: 129 active+clean; 86 MiB data, 688 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 132 op/s 2026-02-17T21:01:49.133 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:01:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:48 trial153 ceph-mon[25357]: pgmap v189: 129 pgs: 129 active+clean; 86 MiB data, 688 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 132 op/s 2026-02-17T21:01:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:01:49.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 180642 6.97 MB/sec execute 23 sec latency 7.335 ms 2026-02-17T21:01:49.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 23667096 903.61 MB/sec execute 23 sec latency 0.256 ms 2026-02-17T21:01:50.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 181525 6.88 MB/sec execute 24 sec latency 5.881 ms 2026-02-17T21:01:50.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 23834059 903.70 MB/sec execute 24 sec latency 0.352 ms 2026-02-17T21:01:51.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:50 trial104 ceph-mon[20612]: pgmap v190: 129 pgs: 129 active+clean; 89 MiB data, 692 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.5 MiB/s wr, 175 op/s 2026-02-17T21:01:51.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:50 trial153 ceph-mon[25357]: pgmap v190: 129 pgs: 129 active+clean; 89 MiB data, 692 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.5 MiB/s wr, 175 op/s 2026-02-17T21:01:51.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 182820 6.82 MB/sec execute 25 sec latency 7.921 ms 2026-02-17T21:01:51.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 23999653 903.61 MB/sec execute 25 sec latency 0.305 ms 2026-02-17T21:01:52.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 184237 6.90 MB/sec execute 26 sec latency 7.097 ms 2026-02-17T21:01:52.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 24166241 903.41 MB/sec execute 26 sec latency 0.240 ms 2026-02-17T21:01:53.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:52 trial104 ceph-mon[20612]: pgmap v191: 129 pgs: 129 active+clean; 89 MiB data, 692 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 123 op/s 2026-02-17T21:01:53.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:52 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:01:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:52 trial153 ceph-mon[25357]: pgmap v191: 129 pgs: 129 active+clean; 89 MiB data, 692 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 123 op/s 2026-02-17T21:01:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:52 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:01:53.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 185253 6.84 MB/sec execute 27 sec latency 8.643 ms 2026-02-17T21:01:53.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 24329796 903.24 MB/sec execute 27 sec latency 0.268 ms 2026-02-17T21:01:54.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:53 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:01:54.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:53 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:01:54.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:53 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:01:54.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:53 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:01:54.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:53 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:01:54.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:53 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:01:54.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 186538 6.78 MB/sec execute 28 sec latency 6.668 ms 2026-02-17T21:01:54.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 24495152 902.89 MB/sec execute 28 sec latency 0.454 ms 2026-02-17T21:01:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:54 trial153 ceph-mon[25357]: pgmap v192: 129 pgs: 129 active+clean; 90 MiB data, 698 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 133 op/s 2026-02-17T21:01:55.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:54 trial104 ceph-mon[20612]: pgmap v192: 129 pgs: 129 active+clean; 90 MiB data, 698 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 133 op/s 2026-02-17T21:01:55.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 188009 6.95 MB/sec execute 29 sec latency 6.807 ms 2026-02-17T21:01:55.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 24656691 901.75 MB/sec execute 29 sec latency 32.098 ms 2026-02-17T21:01:56.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 189064 6.84 MB/sec execute 30 sec latency 8.356 ms 2026-02-17T21:01:56.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 24821164 901.84 MB/sec execute 30 sec latency 3.964 ms 2026-02-17T21:01:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:56 trial153 ceph-mon[25357]: pgmap v193: 129 pgs: 129 active+clean; 91 MiB data, 726 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.1 MiB/s wr, 168 op/s 2026-02-17T21:01:57.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:56 trial104 ceph-mon[20612]: pgmap v193: 129 pgs: 129 active+clean; 91 MiB data, 726 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.1 MiB/s wr, 168 op/s 2026-02-17T21:01:57.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 190399 6.78 MB/sec execute 31 sec latency 5.889 ms 2026-02-17T21:01:57.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 24988550 901.92 MB/sec execute 31 sec latency 0.297 ms 2026-02-17T21:01:58.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 191770 6.94 MB/sec execute 32 sec latency 6.676 ms 2026-02-17T21:01:58.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 25155908 901.86 MB/sec execute 32 sec latency 0.244 ms 2026-02-17T21:01:59.243 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:01:58 trial104 ceph-mon[20612]: pgmap v194: 129 pgs: 129 active+clean; 91 MiB data, 726 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 129 op/s 2026-02-17T21:01:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:01:58 trial153 ceph-mon[25357]: pgmap v194: 129 pgs: 129 active+clean; 91 MiB data, 726 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 129 op/s 2026-02-17T21:01:59.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 192701 6.80 MB/sec execute 33 sec latency 8.334 ms 2026-02-17T21:01:59.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 25322125 902.21 MB/sec execute 33 sec latency 0.378 ms 2026-02-17T21:02:00.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 194016 6.77 MB/sec execute 34 sec latency 5.902 ms 2026-02-17T21:02:00.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 25489695 902.27 MB/sec execute 34 sec latency 0.742 ms 2026-02-17T21:02:01.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:00 trial153 ceph-mon[25357]: pgmap v195: 129 pgs: 129 active+clean; 93 MiB data, 731 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 177 op/s 2026-02-17T21:02:01.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:00 trial104 ceph-mon[20612]: pgmap v195: 129 pgs: 129 active+clean; 93 MiB data, 731 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 177 op/s 2026-02-17T21:02:01.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 195413 6.89 MB/sec execute 35 sec latency 4.931 ms 2026-02-17T21:02:01.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 25657261 902.32 MB/sec execute 35 sec latency 0.231 ms 2026-02-17T21:02:02.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 196562 6.85 MB/sec execute 36 sec latency 8.789 ms 2026-02-17T21:02:02.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 25823785 902.67 MB/sec execute 36 sec latency 0.268 ms 2026-02-17T21:02:03.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:02 trial153 ceph-mon[25357]: pgmap v196: 129 pgs: 129 active+clean; 93 MiB data, 731 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 131 op/s 2026-02-17T21:02:03.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:02 trial104 ceph-mon[20612]: pgmap v196: 129 pgs: 129 active+clean; 93 MiB data, 731 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 131 op/s 2026-02-17T21:02:03.638 INFO:tasks.workunit.client.1.trial153.stdout: 1 197988 6.85 MB/sec execute 37 sec latency 5.557 ms 2026-02-17T21:02:03.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 25990985 902.58 MB/sec execute 37 sec latency 0.235 ms 2026-02-17T21:02:04.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:02:04.300 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:02:04.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 199076 6.86 MB/sec execute 38 sec latency 8.511 ms 2026-02-17T21:02:04.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 26156484 902.70 MB/sec execute 38 sec latency 0.259 ms 2026-02-17T21:02:05.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:04 trial153 ceph-mon[25357]: pgmap v197: 129 pgs: 129 active+clean; 95 MiB data, 736 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.1 MiB/s wr, 140 op/s 2026-02-17T21:02:05.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:04 trial104 ceph-mon[20612]: pgmap v197: 129 pgs: 129 active+clean; 95 MiB data, 736 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.1 MiB/s wr, 140 op/s 2026-02-17T21:02:05.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 200274 6.82 MB/sec execute 39 sec latency 7.589 ms 2026-02-17T21:02:05.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 26323464 902.70 MB/sec execute 39 sec latency 0.630 ms 2026-02-17T21:02:06.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 201803 6.84 MB/sec execute 40 sec latency 5.539 ms 2026-02-17T21:02:06.748 INFO:tasks.workunit.client.0.trial104.stdout: 1 26491748 902.82 MB/sec execute 40 sec latency 0.248 ms 2026-02-17T21:02:07.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:06 trial153 ceph-mon[25357]: pgmap v198: 129 pgs: 129 active+clean; 96 MiB data, 757 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.1 MiB/s wr, 170 op/s 2026-02-17T21:02:07.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:06 trial104 ceph-mon[20612]: pgmap v198: 129 pgs: 129 active+clean; 96 MiB data, 757 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.1 MiB/s wr, 170 op/s 2026-02-17T21:02:07.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 202766 6.82 MB/sec execute 41 sec latency 5.154 ms 2026-02-17T21:02:07.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 26657326 902.93 MB/sec execute 41 sec latency 1.006 ms 2026-02-17T21:02:08.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 204053 6.79 MB/sec execute 42 sec latency 6.922 ms 2026-02-17T21:02:08.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 26821731 902.63 MB/sec execute 42 sec latency 0.256 ms 2026-02-17T21:02:09.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:08 trial153 ceph-mon[25357]: pgmap v199: 129 pgs: 129 active+clean; 96 MiB data, 757 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.0 MiB/s wr, 134 op/s 2026-02-17T21:02:09.357 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:08 trial104 ceph-mon[20612]: pgmap v199: 129 pgs: 129 active+clean; 96 MiB data, 757 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.0 MiB/s wr, 134 op/s 2026-02-17T21:02:09.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 205500 6.84 MB/sec execute 43 sec latency 5.484 ms 2026-02-17T21:02:09.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 26987810 902.42 MB/sec execute 43 sec latency 0.257 ms 2026-02-17T21:02:10.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 206479 6.80 MB/sec execute 44 sec latency 6.860 ms 2026-02-17T21:02:10.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 27152461 902.50 MB/sec execute 44 sec latency 0.285 ms 2026-02-17T21:02:11.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:10 trial153 ceph-mon[25357]: pgmap v200: 129 pgs: 129 active+clean; 99 MiB data, 787 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 177 op/s 2026-02-17T21:02:11.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:10 trial104 ceph-mon[20612]: pgmap v200: 129 pgs: 129 active+clean; 99 MiB data, 787 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 177 op/s 2026-02-17T21:02:11.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 207828 6.77 MB/sec execute 45 sec latency 5.633 ms 2026-02-17T21:02:11.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 27317370 902.15 MB/sec execute 45 sec latency 5.074 ms 2026-02-17T21:02:12.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 209307 6.88 MB/sec execute 46 sec latency 5.627 ms 2026-02-17T21:02:12.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 27483991 902.07 MB/sec execute 46 sec latency 0.930 ms 2026-02-17T21:02:13.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:12 trial153 ceph-mon[25357]: pgmap v201: 129 pgs: 129 active+clean; 99 MiB data, 789 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 126 op/s 2026-02-17T21:02:13.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:12 trial104 ceph-mon[20612]: pgmap v201: 129 pgs: 129 active+clean; 99 MiB data, 789 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 126 op/s 2026-02-17T21:02:13.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 210360 6.81 MB/sec execute 47 sec latency 5.168 ms 2026-02-17T21:02:13.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 27649337 902.22 MB/sec execute 47 sec latency 0.274 ms 2026-02-17T21:02:14.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 211651 6.77 MB/sec execute 48 sec latency 5.539 ms 2026-02-17T21:02:14.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 27816341 902.23 MB/sec execute 48 sec latency 0.237 ms 2026-02-17T21:02:15.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:14 trial153 ceph-mon[25357]: pgmap v202: 129 pgs: 129 active+clean; 98 MiB data, 774 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 132 op/s 2026-02-17T21:02:15.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:14 trial104 ceph-mon[20612]: pgmap v202: 129 pgs: 129 active+clean; 98 MiB data, 774 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 132 op/s 2026-02-17T21:02:15.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 213078 6.87 MB/sec execute 49 sec latency 5.570 ms 2026-02-17T21:02:15.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 27981242 902.25 MB/sec execute 49 sec latency 0.283 ms 2026-02-17T21:02:16.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 214078 6.78 MB/sec execute 50 sec latency 6.470 ms 2026-02-17T21:02:16.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 28143290 901.69 MB/sec execute 50 sec latency 24.119 ms 2026-02-17T21:02:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:16 trial153 ceph-mon[25357]: pgmap v203: 129 pgs: 129 active+clean; 101 MiB data, 823 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.0 MiB/s wr, 167 op/s 2026-02-17T21:02:17.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:16 trial104 ceph-mon[20612]: pgmap v203: 129 pgs: 129 active+clean; 101 MiB data, 823 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.0 MiB/s wr, 167 op/s 2026-02-17T21:02:17.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 215428 6.77 MB/sec execute 51 sec latency 6.570 ms 2026-02-17T21:02:17.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 28308314 901.45 MB/sec execute 51 sec latency 0.231 ms 2026-02-17T21:02:18.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 216759 6.85 MB/sec execute 52 sec latency 6.692 ms 2026-02-17T21:02:18.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 28471448 901.35 MB/sec execute 52 sec latency 0.259 ms 2026-02-17T21:02:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:18 trial153 ceph-mon[25357]: pgmap v204: 129 pgs: 129 active+clean; 103 MiB data, 824 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.1 MiB/s wr, 137 op/s 2026-02-17T21:02:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:02:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:18 trial104 ceph-mon[20612]: pgmap v204: 129 pgs: 129 active+clean; 103 MiB data, 824 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.1 MiB/s wr, 137 op/s 2026-02-17T21:02:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:02:19.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 217820 6.82 MB/sec execute 53 sec latency 6.056 ms 2026-02-17T21:02:19.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 28637089 901.20 MB/sec execute 53 sec latency 0.265 ms 2026-02-17T21:02:20.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 218999 6.75 MB/sec execute 54 sec latency 6.072 ms 2026-02-17T21:02:20.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 28803684 901.13 MB/sec execute 54 sec latency 0.269 ms 2026-02-17T21:02:21.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:20 trial153 ceph-mon[25357]: pgmap v205: 129 pgs: 129 active+clean; 101 MiB data, 839 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.2 MiB/s wr, 161 op/s 2026-02-17T21:02:21.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:20 trial104 ceph-mon[20612]: pgmap v205: 129 pgs: 129 active+clean; 101 MiB data, 839 MiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.2 MiB/s wr, 161 op/s 2026-02-17T21:02:21.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 220328 6.83 MB/sec execute 55 sec latency 6.811 ms 2026-02-17T21:02:21.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 28967317 901.11 MB/sec execute 55 sec latency 0.282 ms 2026-02-17T21:02:22.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 221474 6.79 MB/sec execute 56 sec latency 6.995 ms 2026-02-17T21:02:22.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 29131438 900.85 MB/sec execute 56 sec latency 0.306 ms 2026-02-17T21:02:23.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:22 trial153 ceph-mon[25357]: pgmap v206: 129 pgs: 129 active+clean; 101 MiB data, 845 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.8 MiB/s wr, 115 op/s 2026-02-17T21:02:23.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:22 trial104 ceph-mon[20612]: pgmap v206: 129 pgs: 129 active+clean; 101 MiB data, 845 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.8 MiB/s wr, 115 op/s 2026-02-17T21:02:23.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 222903 6.81 MB/sec execute 57 sec latency 5.755 ms 2026-02-17T21:02:23.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 29298482 900.81 MB/sec execute 57 sec latency 0.249 ms 2026-02-17T21:02:24.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 224022 6.80 MB/sec execute 58 sec latency 5.997 ms 2026-02-17T21:02:24.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 29462670 900.82 MB/sec execute 58 sec latency 0.289 ms 2026-02-17T21:02:25.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:24 trial153 ceph-mon[25357]: pgmap v207: 129 pgs: 129 active+clean; 103 MiB data, 852 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.0 MiB/s wr, 150 op/s 2026-02-17T21:02:25.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:24 trial104 ceph-mon[20612]: pgmap v207: 129 pgs: 129 active+clean; 103 MiB data, 852 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.0 MiB/s wr, 150 op/s 2026-02-17T21:02:25.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 225316 6.78 MB/sec execute 59 sec latency 7.707 ms 2026-02-17T21:02:25.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 29628996 900.77 MB/sec execute 59 sec latency 0.255 ms 2026-02-17T21:02:26.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 226796 6.81 MB/sec execute 60 sec latency 6.097 ms 2026-02-17T21:02:26.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 29794534 900.87 MB/sec execute 60 sec latency 0.251 ms 2026-02-17T21:02:27.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:26 trial153 ceph-mon[25357]: pgmap v208: 129 pgs: 129 active+clean; 104 MiB data, 861 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.2 MiB/s wr, 157 op/s 2026-02-17T21:02:27.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:26 trial104 ceph-mon[20612]: pgmap v208: 129 pgs: 129 active+clean; 104 MiB data, 861 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.2 MiB/s wr, 157 op/s 2026-02-17T21:02:27.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 227717 6.78 MB/sec execute 61 sec latency 6.362 ms 2026-02-17T21:02:27.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 29959769 900.75 MB/sec execute 61 sec latency 6.035 ms 2026-02-17T21:02:28.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 228984 6.76 MB/sec execute 62 sec latency 5.881 ms 2026-02-17T21:02:28.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 30126333 900.71 MB/sec execute 62 sec latency 0.344 ms 2026-02-17T21:02:29.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:28 trial153 ceph-mon[25357]: pgmap v209: 129 pgs: 129 active+clean; 107 MiB data, 864 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.1 MiB/s wr, 143 op/s 2026-02-17T21:02:29.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:28 trial104 ceph-mon[20612]: pgmap v209: 129 pgs: 129 active+clean; 107 MiB data, 864 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.1 MiB/s wr, 143 op/s 2026-02-17T21:02:29.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 230388 6.79 MB/sec execute 63 sec latency 5.090 ms 2026-02-17T21:02:29.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 30290436 900.72 MB/sec execute 63 sec latency 0.261 ms 2026-02-17T21:02:30.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 231477 6.77 MB/sec execute 64 sec latency 7.235 ms 2026-02-17T21:02:30.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 30456245 900.61 MB/sec execute 64 sec latency 0.328 ms 2026-02-17T21:02:31.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:30 trial153 ceph-mon[25357]: pgmap v210: 129 pgs: 129 active+clean; 106 MiB data, 869 MiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 3.1 MiB/s wr, 153 op/s 2026-02-17T21:02:31.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:30 trial104 ceph-mon[20612]: pgmap v210: 129 pgs: 129 active+clean; 106 MiB data, 869 MiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 3.1 MiB/s wr, 153 op/s 2026-02-17T21:02:31.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 232782 6.75 MB/sec execute 65 sec latency 6.693 ms 2026-02-17T21:02:31.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 30616510 900.06 MB/sec execute 65 sec latency 31.199 ms 2026-02-17T21:02:32.639 INFO:tasks.workunit.client.1.trial153.stdout: 1 234222 6.82 MB/sec execute 66 sec latency 6.416 ms 2026-02-17T21:02:32.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 30781484 900.15 MB/sec execute 66 sec latency 0.273 ms 2026-02-17T21:02:33.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:32 trial153 ceph-mon[25357]: pgmap v211: 129 pgs: 129 active+clean; 108 MiB data, 875 MiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.0 MiB/s wr, 149 op/s 2026-02-17T21:02:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:32 trial104 ceph-mon[20612]: pgmap v211: 129 pgs: 129 active+clean; 108 MiB data, 875 MiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.0 MiB/s wr, 149 op/s 2026-02-17T21:02:33.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 235220 6.77 MB/sec execute 67 sec latency 6.622 ms 2026-02-17T21:02:33.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 30947466 900.06 MB/sec execute 67 sec latency 0.983 ms 2026-02-17T21:02:34.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:02:34.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:02:34.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 236517 6.75 MB/sec execute 68 sec latency 6.699 ms 2026-02-17T21:02:34.749 INFO:tasks.workunit.client.0.trial104.stdout: 1 31113740 900.03 MB/sec execute 68 sec latency 0.281 ms 2026-02-17T21:02:35.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:34 trial153 ceph-mon[25357]: pgmap v212: 129 pgs: 129 active+clean; 109 MiB data, 878 MiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.2 MiB/s wr, 157 op/s 2026-02-17T21:02:35.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:34 trial104 ceph-mon[20612]: pgmap v212: 129 pgs: 129 active+clean; 109 MiB data, 878 MiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.2 MiB/s wr, 157 op/s 2026-02-17T21:02:35.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 237938 6.82 MB/sec execute 69 sec latency 5.828 ms 2026-02-17T21:02:35.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 31279015 900.12 MB/sec execute 69 sec latency 0.273 ms 2026-02-17T21:02:36.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 238893 6.76 MB/sec execute 70 sec latency 6.977 ms 2026-02-17T21:02:36.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 31443462 899.94 MB/sec execute 70 sec latency 12.007 ms 2026-02-17T21:02:37.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:36 trial153 ceph-mon[25357]: pgmap v213: 129 pgs: 129 active+clean; 108 MiB data, 891 MiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 2.8 MiB/s wr, 137 op/s 2026-02-17T21:02:37.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:36 trial104 ceph-mon[20612]: pgmap v213: 129 pgs: 129 active+clean; 108 MiB data, 891 MiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 2.8 MiB/s wr, 137 op/s 2026-02-17T21:02:37.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 240196 6.74 MB/sec execute 71 sec latency 6.129 ms 2026-02-17T21:02:37.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 31610188 899.92 MB/sec execute 71 sec latency 0.446 ms 2026-02-17T21:02:38.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 241559 6.80 MB/sec execute 72 sec latency 5.984 ms 2026-02-17T21:02:38.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 31774508 899.96 MB/sec execute 72 sec latency 0.278 ms 2026-02-17T21:02:39.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:38 trial153 ceph-mon[25357]: pgmap v214: 129 pgs: 129 active+clean; 109 MiB data, 894 MiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.0 MiB/s wr, 142 op/s 2026-02-17T21:02:39.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:38 trial104 ceph-mon[20612]: pgmap v214: 129 pgs: 129 active+clean; 109 MiB data, 894 MiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.0 MiB/s wr, 142 op/s 2026-02-17T21:02:39.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 242731 6.78 MB/sec execute 73 sec latency 6.980 ms 2026-02-17T21:02:39.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 31940776 899.90 MB/sec execute 73 sec latency 0.321 ms 2026-02-17T21:02:40.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 244137 6.78 MB/sec execute 74 sec latency 5.941 ms 2026-02-17T21:02:40.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 32105156 899.95 MB/sec execute 74 sec latency 0.293 ms 2026-02-17T21:02:41.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:40 trial153 ceph-mon[25357]: pgmap v215: 129 pgs: 129 active+clean; 113 MiB data, 909 MiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 3.3 MiB/s wr, 164 op/s 2026-02-17T21:02:41.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:40 trial104 ceph-mon[20612]: pgmap v215: 129 pgs: 129 active+clean; 113 MiB data, 909 MiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 3.3 MiB/s wr, 164 op/s 2026-02-17T21:02:41.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 245259 6.79 MB/sec execute 75 sec latency 4.946 ms 2026-02-17T21:02:41.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 32270904 899.84 MB/sec execute 75 sec latency 0.242 ms 2026-02-17T21:02:42.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 246531 6.77 MB/sec execute 76 sec latency 7.263 ms 2026-02-17T21:02:42.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 32436227 899.74 MB/sec execute 76 sec latency 4.633 ms 2026-02-17T21:02:43.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:42 trial153 ceph-mon[25357]: pgmap v216: 129 pgs: 129 active+clean; 112 MiB data, 932 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.1 MiB/s wr, 145 op/s 2026-02-17T21:02:43.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:42 trial104 ceph-mon[20612]: pgmap v216: 129 pgs: 129 active+clean; 112 MiB data, 932 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 3.1 MiB/s wr, 145 op/s 2026-02-17T21:02:43.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 248091 6.80 MB/sec execute 77 sec latency 5.828 ms 2026-02-17T21:02:43.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 32600692 899.81 MB/sec execute 77 sec latency 0.297 ms 2026-02-17T21:02:44.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 249036 6.78 MB/sec execute 78 sec latency 7.202 ms 2026-02-17T21:02:44.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 32767902 899.80 MB/sec execute 78 sec latency 0.269 ms 2026-02-17T21:02:45.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:44 trial104 ceph-mon[20612]: pgmap v217: 129 pgs: 129 active+clean; 112 MiB data, 937 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.9 MiB/s wr, 129 op/s 2026-02-17T21:02:45.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:44 trial153 ceph-mon[25357]: pgmap v217: 129 pgs: 129 active+clean; 112 MiB data, 937 MiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.9 MiB/s wr, 129 op/s 2026-02-17T21:02:45.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 250324 6.76 MB/sec execute 79 sec latency 6.295 ms 2026-02-17T21:02:45.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 32934236 899.79 MB/sec execute 79 sec latency 0.268 ms 2026-02-17T21:02:46.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 251691 6.79 MB/sec execute 80 sec latency 4.960 ms 2026-02-17T21:02:46.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 33100721 899.97 MB/sec execute 80 sec latency 0.266 ms 2026-02-17T21:02:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:46 trial153 ceph-mon[25357]: pgmap v218: 129 pgs: 129 active+clean; 114 MiB data, 916 MiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 2.9 MiB/s wr, 151 op/s 2026-02-17T21:02:47.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:46 trial104 ceph-mon[20612]: pgmap v218: 129 pgs: 129 active+clean; 114 MiB data, 916 MiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 2.9 MiB/s wr, 151 op/s 2026-02-17T21:02:47.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 252817 6.77 MB/sec execute 81 sec latency 6.590 ms 2026-02-17T21:02:47.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 33268086 899.98 MB/sec execute 81 sec latency 0.256 ms 2026-02-17T21:02:48.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 254187 6.76 MB/sec execute 82 sec latency 5.392 ms 2026-02-17T21:02:48.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 33435067 900.01 MB/sec execute 82 sec latency 0.249 ms 2026-02-17T21:02:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:48 trial153 ceph-mon[25357]: pgmap v219: 129 pgs: 129 active+clean; 115 MiB data, 903 MiB used, 5.5 TiB / 5.5 TiB avail; 5.3 KiB/s rd, 3.1 MiB/s wr, 140 op/s 2026-02-17T21:02:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:02:49.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:48 trial104 ceph-mon[20612]: pgmap v219: 129 pgs: 129 active+clean; 115 MiB data, 903 MiB used, 5.5 TiB / 5.5 TiB avail; 5.3 KiB/s rd, 3.1 MiB/s wr, 140 op/s 2026-02-17T21:02:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:02:49.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 255594 6.81 MB/sec execute 83 sec latency 6.680 ms 2026-02-17T21:02:49.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 33598810 900.00 MB/sec execute 83 sec latency 0.274 ms 2026-02-17T21:02:50.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 256595 6.77 MB/sec execute 84 sec latency 7.080 ms 2026-02-17T21:02:50.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 33765203 899.96 MB/sec execute 84 sec latency 0.371 ms 2026-02-17T21:02:51.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:50 trial153 ceph-mon[25357]: pgmap v220: 129 pgs: 129 active+clean; 117 MiB data, 917 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.4 MiB/s wr, 171 op/s 2026-02-17T21:02:51.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:50 trial104 ceph-mon[20612]: pgmap v220: 129 pgs: 129 active+clean; 117 MiB data, 917 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.4 MiB/s wr, 171 op/s 2026-02-17T21:02:51.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 257913 6.76 MB/sec execute 85 sec latency 6.502 ms 2026-02-17T21:02:51.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 33931302 900.11 MB/sec execute 85 sec latency 0.257 ms 2026-02-17T21:02:52.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 259289 6.81 MB/sec execute 86 sec latency 5.910 ms 2026-02-17T21:02:52.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 34095271 899.94 MB/sec execute 86 sec latency 10.081 ms 2026-02-17T21:02:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:52 trial153 ceph-mon[25357]: pgmap v221: 129 pgs: 129 active+clean; 117 MiB data, 917 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.9 MiB/s wr, 121 op/s 2026-02-17T21:02:53.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:52 trial104 ceph-mon[20612]: pgmap v221: 129 pgs: 129 active+clean; 117 MiB data, 917 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.9 MiB/s wr, 121 op/s 2026-02-17T21:02:53.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 260422 6.79 MB/sec execute 87 sec latency 7.385 ms 2026-02-17T21:02:53.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 34259614 899.76 MB/sec execute 87 sec latency 0.263 ms 2026-02-17T21:02:54.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:53 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:02:54.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:53 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:02:54.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:53 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:02:54.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:53 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:02:54.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:53 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:02:54.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:53 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:02:54.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:53 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:02:54.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:53 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:02:54.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 261847 6.78 MB/sec execute 88 sec latency 6.176 ms 2026-02-17T21:02:54.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 34423446 899.77 MB/sec execute 88 sec latency 1.109 ms 2026-02-17T21:02:55.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:54 trial104 ceph-mon[20612]: pgmap v222: 129 pgs: 129 active+clean; 119 MiB data, 921 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.1 MiB/s wr, 148 op/s 2026-02-17T21:02:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:54 trial153 ceph-mon[25357]: pgmap v222: 129 pgs: 129 active+clean; 119 MiB data, 921 MiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.1 MiB/s wr, 148 op/s 2026-02-17T21:02:55.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 262977 6.80 MB/sec execute 89 sec latency 6.385 ms 2026-02-17T21:02:55.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 34589406 899.71 MB/sec execute 89 sec latency 0.260 ms 2026-02-17T21:02:56.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 264207 6.78 MB/sec execute 90 sec latency 6.572 ms 2026-02-17T21:02:56.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 34755914 899.69 MB/sec execute 90 sec latency 0.268 ms 2026-02-17T21:02:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:56 trial153 ceph-mon[25357]: pgmap v223: 129 pgs: 129 active+clean; 118 MiB data, 927 MiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.1 MiB/s wr, 167 op/s 2026-02-17T21:02:57.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:56 trial104 ceph-mon[20612]: pgmap v223: 129 pgs: 129 active+clean; 118 MiB data, 927 MiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.1 MiB/s wr, 167 op/s 2026-02-17T21:02:57.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 265795 6.80 MB/sec execute 91 sec latency 6.517 ms 2026-02-17T21:02:57.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 34913759 899.34 MB/sec execute 91 sec latency 26.701 ms 2026-02-17T21:02:58.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 266727 6.78 MB/sec execute 92 sec latency 6.646 ms 2026-02-17T21:02:58.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 35079182 899.28 MB/sec execute 92 sec latency 4.680 ms 2026-02-17T21:02:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:02:58 trial153 ceph-mon[25357]: pgmap v224: 129 pgs: 129 active+clean; 119 MiB data, 928 MiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 3.0 MiB/s wr, 139 op/s 2026-02-17T21:02:59.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:02:58 trial104 ceph-mon[20612]: pgmap v224: 129 pgs: 129 active+clean; 119 MiB data, 928 MiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 3.0 MiB/s wr, 139 op/s 2026-02-17T21:02:59.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 268095 6.77 MB/sec execute 93 sec latency 6.532 ms 2026-02-17T21:02:59.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 35246324 899.28 MB/sec execute 93 sec latency 0.231 ms 2026-02-17T21:03:00.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 269448 6.79 MB/sec execute 94 sec latency 5.249 ms 2026-02-17T21:03:00.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 35411633 899.35 MB/sec execute 94 sec latency 0.262 ms 2026-02-17T21:03:01.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:00 trial153 ceph-mon[25357]: pgmap v225: 129 pgs: 129 active+clean; 120 MiB data, 935 MiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 3.4 MiB/s wr, 186 op/s 2026-02-17T21:03:01.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:00 trial104 ceph-mon[20612]: pgmap v225: 129 pgs: 129 active+clean; 120 MiB data, 935 MiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 3.4 MiB/s wr, 186 op/s 2026-02-17T21:03:01.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 270486 6.78 MB/sec execute 95 sec latency 7.048 ms 2026-02-17T21:03:01.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 35578190 899.34 MB/sec execute 95 sec latency 0.298 ms 2026-02-17T21:03:02.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 271694 6.76 MB/sec execute 96 sec latency 6.251 ms 2026-02-17T21:03:02.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 35746726 899.48 MB/sec execute 96 sec latency 0.258 ms 2026-02-17T21:03:03.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:02 trial153 ceph-mon[25357]: pgmap v226: 129 pgs: 129 active+clean; 120 MiB data, 941 MiB used, 5.5 TiB / 5.5 TiB avail; 5.4 KiB/s rd, 2.9 MiB/s wr, 136 op/s 2026-02-17T21:03:03.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:02 trial104 ceph-mon[20612]: pgmap v226: 129 pgs: 129 active+clean; 120 MiB data, 941 MiB used, 5.5 TiB / 5.5 TiB avail; 5.4 KiB/s rd, 2.9 MiB/s wr, 136 op/s 2026-02-17T21:03:03.640 INFO:tasks.workunit.client.1.trial153.stdout: 1 273118 6.81 MB/sec execute 97 sec latency 6.029 ms 2026-02-17T21:03:03.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 35910055 899.43 MB/sec execute 97 sec latency 0.670 ms 2026-02-17T21:03:04.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:03:04.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:03:04.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 274116 6.77 MB/sec execute 98 sec latency 8.649 ms 2026-02-17T21:03:04.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 36076535 899.41 MB/sec execute 98 sec latency 0.246 ms 2026-02-17T21:03:05.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:04 trial153 ceph-mon[25357]: pgmap v227: 129 pgs: 129 active+clean; 122 MiB data, 947 MiB used, 5.5 TiB / 5.5 TiB avail; 5.4 KiB/s rd, 3.1 MiB/s wr, 144 op/s 2026-02-17T21:03:05.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:04 trial104 ceph-mon[20612]: pgmap v227: 129 pgs: 129 active+clean; 122 MiB data, 947 MiB used, 5.5 TiB / 5.5 TiB avail; 5.4 KiB/s rd, 3.1 MiB/s wr, 144 op/s 2026-02-17T21:03:05.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 275336 6.75 MB/sec execute 99 sec latency 6.603 ms 2026-02-17T21:03:05.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 36240917 899.45 MB/sec execute 99 sec latency 0.274 ms 2026-02-17T21:03:06.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 276716 6.80 MB/sec execute 100 sec latency 6.369 ms 2026-02-17T21:03:06.750 INFO:tasks.workunit.client.0.trial104.stdout: 1 36406772 899.38 MB/sec execute 100 sec latency 0.257 ms 2026-02-17T21:03:07.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:06 trial153 ceph-mon[25357]: pgmap v228: 129 pgs: 129 active+clean; 123 MiB data, 965 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.0 MiB/s wr, 154 op/s 2026-02-17T21:03:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:06 trial104 ceph-mon[20612]: pgmap v228: 129 pgs: 129 active+clean; 123 MiB data, 965 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.0 MiB/s wr, 154 op/s 2026-02-17T21:03:07.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 277786 6.77 MB/sec execute 101 sec latency 5.725 ms 2026-02-17T21:03:07.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 36571957 899.30 MB/sec execute 101 sec latency 0.260 ms 2026-02-17T21:03:08.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 279123 6.75 MB/sec execute 102 sec latency 5.490 ms 2026-02-17T21:03:08.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 36735375 899.31 MB/sec execute 102 sec latency 6.012 ms 2026-02-17T21:03:09.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:08 trial153 ceph-mon[25357]: pgmap v229: 129 pgs: 129 active+clean; 122 MiB data, 964 MiB used, 5.5 TiB / 5.5 TiB avail; 5.3 KiB/s rd, 3.0 MiB/s wr, 128 op/s 2026-02-17T21:03:09.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:08 trial104 ceph-mon[20612]: pgmap v229: 129 pgs: 129 active+clean; 122 MiB data, 964 MiB used, 5.5 TiB / 5.5 TiB avail; 5.3 KiB/s rd, 3.0 MiB/s wr, 128 op/s 2026-02-17T21:03:09.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 280517 6.80 MB/sec execute 103 sec latency 6.029 ms 2026-02-17T21:03:09.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 36900874 899.23 MB/sec execute 103 sec latency 0.243 ms 2026-02-17T21:03:10.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 281667 6.78 MB/sec execute 104 sec latency 6.563 ms 2026-02-17T21:03:10.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 37067127 899.18 MB/sec execute 104 sec latency 0.279 ms 2026-02-17T21:03:11.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:10 trial153 ceph-mon[25357]: pgmap v230: 129 pgs: 129 active+clean; 123 MiB data, 973 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.4 MiB/s wr, 176 op/s 2026-02-17T21:03:11.304 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:10 trial104 ceph-mon[20612]: pgmap v230: 129 pgs: 129 active+clean; 123 MiB data, 973 MiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 3.4 MiB/s wr, 176 op/s 2026-02-17T21:03:11.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 283019 6.78 MB/sec execute 105 sec latency 5.267 ms 2026-02-17T21:03:11.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 37230942 899.19 MB/sec execute 105 sec latency 0.279 ms 2026-02-17T21:03:12.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 284244 6.79 MB/sec execute 106 sec latency 5.129 ms 2026-02-17T21:03:12.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 37393702 899.00 MB/sec execute 106 sec latency 15.793 ms 2026-02-17T21:03:13.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:12 trial153 ceph-mon[25357]: pgmap v231: 129 pgs: 129 active+clean; 124 MiB data, 974 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 133 op/s 2026-02-17T21:03:13.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:12 trial104 ceph-mon[20612]: pgmap v231: 129 pgs: 129 active+clean; 124 MiB data, 974 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 133 op/s 2026-02-17T21:03:13.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 285452 6.77 MB/sec execute 107 sec latency 6.734 ms 2026-02-17T21:03:13.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 37559287 898.95 MB/sec execute 107 sec latency 7.066 ms 2026-02-17T21:03:14.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 286991 6.79 MB/sec execute 108 sec latency 6.160 ms 2026-02-17T21:03:14.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 37723262 898.97 MB/sec execute 108 sec latency 0.255 ms 2026-02-17T21:03:15.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:14 trial153 ceph-mon[25357]: pgmap v232: 129 pgs: 129 active+clean; 125 MiB data, 993 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 141 op/s 2026-02-17T21:03:15.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:14 trial104 ceph-mon[20612]: pgmap v232: 129 pgs: 129 active+clean; 125 MiB data, 993 MiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 141 op/s 2026-02-17T21:03:15.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 287949 6.78 MB/sec execute 109 sec latency 4.751 ms 2026-02-17T21:03:15.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 37889092 898.92 MB/sec execute 109 sec latency 0.706 ms 2026-02-17T21:03:16.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 289258 6.77 MB/sec execute 110 sec latency 6.762 ms 2026-02-17T21:03:16.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 38053836 898.98 MB/sec execute 110 sec latency 0.284 ms 2026-02-17T21:03:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:16 trial153 ceph-mon[25357]: pgmap v233: 129 pgs: 129 active+clean; 125 MiB data, 1002 MiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 2.9 MiB/s wr, 150 op/s 2026-02-17T21:03:17.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:16 trial104 ceph-mon[20612]: pgmap v233: 129 pgs: 129 active+clean; 125 MiB data, 1002 MiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 2.9 MiB/s wr, 150 op/s 2026-02-17T21:03:17.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 290656 6.78 MB/sec execute 111 sec latency 27.089 ms 2026-02-17T21:03:17.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 38218718 898.87 MB/sec execute 111 sec latency 13.657 ms 2026-02-17T21:03:18.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 291734 6.77 MB/sec execute 112 sec latency 7.029 ms 2026-02-17T21:03:18.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 38386792 898.96 MB/sec execute 112 sec latency 0.250 ms 2026-02-17T21:03:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:18 trial153 ceph-mon[25357]: pgmap v234: 129 pgs: 129 active+clean; 129 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.1 MiB/s wr, 148 op/s 2026-02-17T21:03:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:03:19.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:18 trial104 ceph-mon[20612]: pgmap v234: 129 pgs: 129 active+clean; 129 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.1 MiB/s wr, 148 op/s 2026-02-17T21:03:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:03:19.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 293075 6.76 MB/sec execute 113 sec latency 6.480 ms 2026-02-17T21:03:19.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 38551523 899.00 MB/sec execute 113 sec latency 0.285 ms 2026-02-17T21:03:20.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 294565 6.80 MB/sec execute 114 sec latency 5.103 ms 2026-02-17T21:03:20.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 38717824 898.99 MB/sec execute 114 sec latency 0.375 ms 2026-02-17T21:03:21.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:20 trial153 ceph-mon[25357]: pgmap v235: 129 pgs: 129 active+clean; 128 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.3 MiB/s wr, 164 op/s 2026-02-17T21:03:21.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:20 trial104 ceph-mon[20612]: pgmap v235: 129 pgs: 129 active+clean; 128 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.3 MiB/s wr, 164 op/s 2026-02-17T21:03:21.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 295631 6.77 MB/sec execute 115 sec latency 6.637 ms 2026-02-17T21:03:21.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 38884507 898.99 MB/sec execute 115 sec latency 0.273 ms 2026-02-17T21:03:22.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 296904 6.76 MB/sec execute 116 sec latency 6.795 ms 2026-02-17T21:03:22.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 39048521 899.00 MB/sec execute 116 sec latency 0.296 ms 2026-02-17T21:03:23.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:22 trial153 ceph-mon[25357]: pgmap v236: 129 pgs: 129 active+clean; 130 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 141 op/s 2026-02-17T21:03:23.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:22 trial104 ceph-mon[20612]: pgmap v236: 129 pgs: 129 active+clean; 130 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 141 op/s 2026-02-17T21:03:23.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 298287 6.80 MB/sec execute 117 sec latency 6.704 ms 2026-02-17T21:03:23.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 39215559 899.01 MB/sec execute 117 sec latency 0.283 ms 2026-02-17T21:03:24.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 299361 6.79 MB/sec execute 118 sec latency 7.252 ms 2026-02-17T21:03:24.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 39381946 899.00 MB/sec execute 118 sec latency 0.273 ms 2026-02-17T21:03:25.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:24 trial153 ceph-mon[25357]: pgmap v237: 129 pgs: 129 active+clean; 131 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.1 MiB/s wr, 142 op/s 2026-02-17T21:03:25.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:24 trial104 ceph-mon[20612]: pgmap v237: 129 pgs: 129 active+clean; 131 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.1 MiB/s wr, 142 op/s 2026-02-17T21:03:25.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 300575 6.76 MB/sec execute 119 sec latency 6.321 ms 2026-02-17T21:03:25.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 39546404 899.03 MB/sec execute 119 sec latency 0.285 ms 2026-02-17T21:03:26.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 301901 6.79 MB/sec execute 120 sec latency 5.277 ms 2026-02-17T21:03:26.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 39712571 899.01 MB/sec execute 120 sec latency 0.255 ms 2026-02-17T21:03:27.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:27 trial153 ceph-mon[25357]: pgmap v238: 129 pgs: 129 active+clean; 131 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.1 MiB/s wr, 150 op/s 2026-02-17T21:03:27.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:27 trial104 ceph-mon[20612]: pgmap v238: 129 pgs: 129 active+clean; 131 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.1 MiB/s wr, 150 op/s 2026-02-17T21:03:27.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 303094 6.78 MB/sec execute 121 sec latency 6.272 ms 2026-02-17T21:03:27.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 39875709 898.85 MB/sec execute 121 sec latency 13.219 ms 2026-02-17T21:03:28.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 304508 6.78 MB/sec execute 122 sec latency 6.665 ms 2026-02-17T21:03:28.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 40037986 898.77 MB/sec execute 122 sec latency 5.968 ms 2026-02-17T21:03:29.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:29 trial153 ceph-mon[25357]: pgmap v239: 129 pgs: 129 active+clean; 134 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.3 MiB/s wr, 161 op/s 2026-02-17T21:03:29.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:29 trial104 ceph-mon[20612]: pgmap v239: 129 pgs: 129 active+clean; 134 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.3 MiB/s wr, 161 op/s 2026-02-17T21:03:29.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 305620 6.78 MB/sec execute 123 sec latency 5.815 ms 2026-02-17T21:03:29.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 40205560 898.83 MB/sec execute 123 sec latency 0.236 ms 2026-02-17T21:03:30.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 306911 6.77 MB/sec execute 124 sec latency 6.728 ms 2026-02-17T21:03:30.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 40368854 898.79 MB/sec execute 124 sec latency 0.283 ms 2026-02-17T21:03:31.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:31 trial153 ceph-mon[25357]: pgmap v240: 129 pgs: 129 active+clean; 134 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 156 op/s 2026-02-17T21:03:31.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:31 trial104 ceph-mon[20612]: pgmap v240: 129 pgs: 129 active+clean; 134 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 156 op/s 2026-02-17T21:03:31.641 INFO:tasks.workunit.client.1.trial153.stdout: 1 308375 6.79 MB/sec execute 125 sec latency 5.355 ms 2026-02-17T21:03:31.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 40535908 898.83 MB/sec execute 125 sec latency 0.258 ms 2026-02-17T21:03:32.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 309393 6.78 MB/sec execute 126 sec latency 8.142 ms 2026-02-17T21:03:32.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 40703702 898.88 MB/sec execute 126 sec latency 0.248 ms 2026-02-17T21:03:33.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:33 trial153 ceph-mon[25357]: pgmap v241: 129 pgs: 129 active+clean; 134 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.1 MiB/s wr, 141 op/s 2026-02-17T21:03:33.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:33 trial104 ceph-mon[20612]: pgmap v241: 129 pgs: 129 active+clean; 134 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.1 MiB/s wr, 141 op/s 2026-02-17T21:03:33.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 310754 6.76 MB/sec execute 127 sec latency 6.198 ms 2026-02-17T21:03:33.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 40864255 898.75 MB/sec execute 127 sec latency 16.204 ms 2026-02-17T21:03:34.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:34 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:03:34.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:34 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:03:34.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 312189 6.80 MB/sec execute 128 sec latency 5.403 ms 2026-02-17T21:03:34.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 41029181 898.65 MB/sec execute 128 sec latency 7.154 ms 2026-02-17T21:03:35.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:35 trial153 ceph-mon[25357]: pgmap v242: 129 pgs: 129 active+clean; 134 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 121 op/s 2026-02-17T21:03:35.293 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:35 trial104 ceph-mon[20612]: pgmap v242: 129 pgs: 129 active+clean; 134 MiB data, 1.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 121 op/s 2026-02-17T21:03:35.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 313228 6.78 MB/sec execute 129 sec latency 6.004 ms 2026-02-17T21:03:35.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 41195182 898.64 MB/sec execute 129 sec latency 0.274 ms 2026-02-17T21:03:36.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 314591 6.77 MB/sec execute 130 sec latency 5.774 ms 2026-02-17T21:03:36.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 41360392 898.71 MB/sec execute 130 sec latency 0.292 ms 2026-02-17T21:03:37.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:37 trial153 ceph-mon[25357]: pgmap v243: 129 pgs: 129 active+clean; 135 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 2.8 MiB/s wr, 150 op/s 2026-02-17T21:03:37.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:37 trial104 ceph-mon[20612]: pgmap v243: 129 pgs: 129 active+clean; 135 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 2.8 MiB/s wr, 150 op/s 2026-02-17T21:03:37.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 316014 6.80 MB/sec execute 131 sec latency 5.270 ms 2026-02-17T21:03:37.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 41527898 898.76 MB/sec execute 131 sec latency 0.259 ms 2026-02-17T21:03:38.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 317196 6.79 MB/sec execute 132 sec latency 5.961 ms 2026-02-17T21:03:38.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 41694152 898.73 MB/sec execute 132 sec latency 8.134 ms 2026-02-17T21:03:39.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:39 trial153 ceph-mon[25357]: pgmap v244: 129 pgs: 129 active+clean; 135 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.0 MiB/s wr, 143 op/s 2026-02-17T21:03:39.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:39 trial104 ceph-mon[20612]: pgmap v244: 129 pgs: 129 active+clean; 135 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.0 MiB/s wr, 143 op/s 2026-02-17T21:03:39.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 318639 6.80 MB/sec execute 133 sec latency 6.043 ms 2026-02-17T21:03:39.751 INFO:tasks.workunit.client.0.trial104.stdout: 1 41859954 898.82 MB/sec execute 133 sec latency 0.276 ms 2026-02-17T21:03:40.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 319737 6.80 MB/sec execute 134 sec latency 5.146 ms 2026-02-17T21:03:40.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 42027384 898.83 MB/sec execute 134 sec latency 0.257 ms 2026-02-17T21:03:41.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:41 trial153 ceph-mon[25357]: pgmap v245: 129 pgs: 129 active+clean; 137 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.2 MiB/s wr, 162 op/s 2026-02-17T21:03:41.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:41 trial104 ceph-mon[20612]: pgmap v245: 129 pgs: 129 active+clean; 137 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.2 MiB/s wr, 162 op/s 2026-02-17T21:03:41.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 320988 6.79 MB/sec execute 135 sec latency 7.470 ms 2026-02-17T21:03:41.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 42193534 898.94 MB/sec execute 135 sec latency 0.283 ms 2026-02-17T21:03:42.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 322529 6.80 MB/sec execute 136 sec latency 5.710 ms 2026-02-17T21:03:42.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 42361674 898.99 MB/sec execute 136 sec latency 0.261 ms 2026-02-17T21:03:43.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:43 trial153 ceph-mon[25357]: pgmap v246: 129 pgs: 129 active+clean; 138 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.9 MiB/s wr, 131 op/s 2026-02-17T21:03:43.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:43 trial104 ceph-mon[20612]: pgmap v246: 129 pgs: 129 active+clean; 138 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.9 MiB/s wr, 131 op/s 2026-02-17T21:03:43.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 323421 6.79 MB/sec execute 137 sec latency 8.536 ms 2026-02-17T21:03:43.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 42530189 899.07 MB/sec execute 137 sec latency 0.248 ms 2026-02-17T21:03:44.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 324772 6.78 MB/sec execute 138 sec latency 6.470 ms 2026-02-17T21:03:44.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 42696317 899.17 MB/sec execute 138 sec latency 0.290 ms 2026-02-17T21:03:45.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:45 trial153 ceph-mon[25357]: pgmap v247: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.1 MiB/s wr, 162 op/s 2026-02-17T21:03:45.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:45 trial104 ceph-mon[20612]: pgmap v247: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.1 MiB/s wr, 162 op/s 2026-02-17T21:03:45.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 326120 6.79 MB/sec execute 139 sec latency 5.543 ms 2026-02-17T21:03:45.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 42863589 899.20 MB/sec execute 139 sec latency 0.246 ms 2026-02-17T21:03:46.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 327127 6.78 MB/sec execute 140 sec latency 7.390 ms 2026-02-17T21:03:46.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 43031127 899.22 MB/sec execute 140 sec latency 0.240 ms 2026-02-17T21:03:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:47 trial153 ceph-mon[25357]: pgmap v248: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.1 MiB/s wr, 168 op/s 2026-02-17T21:03:47.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:47 trial104 ceph-mon[20612]: pgmap v248: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.1 MiB/s wr, 168 op/s 2026-02-17T21:03:47.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 328398 6.77 MB/sec execute 141 sec latency 6.702 ms 2026-02-17T21:03:47.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 43196432 899.27 MB/sec execute 141 sec latency 0.282 ms 2026-02-17T21:03:48.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 329858 6.81 MB/sec execute 142 sec latency 5.574 ms 2026-02-17T21:03:48.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 43360791 899.19 MB/sec execute 142 sec latency 2.813 ms 2026-02-17T21:03:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:49 trial153 ceph-mon[25357]: pgmap v249: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 3.1 MiB/s wr, 131 op/s 2026-02-17T21:03:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:49 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:03:49.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:49 trial104 ceph-mon[20612]: pgmap v249: 129 pgs: 129 active+clean; 140 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 3.1 MiB/s wr, 131 op/s 2026-02-17T21:03:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:49 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:03:49.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 330904 6.78 MB/sec execute 143 sec latency 8.014 ms 2026-02-17T21:03:49.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 43526757 899.14 MB/sec execute 143 sec latency 0.285 ms 2026-02-17T21:03:50.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 332245 6.77 MB/sec execute 144 sec latency 6.257 ms 2026-02-17T21:03:50.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 43691497 899.20 MB/sec execute 144 sec latency 0.524 ms 2026-02-17T21:03:51.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:51 trial104 ceph-mon[20612]: pgmap v250: 129 pgs: 129 active+clean; 144 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.5 MiB/s wr, 180 op/s 2026-02-17T21:03:51.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:51 trial153 ceph-mon[25357]: pgmap v250: 129 pgs: 129 active+clean; 144 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.5 MiB/s wr, 180 op/s 2026-02-17T21:03:51.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 333594 6.80 MB/sec execute 145 sec latency 5.551 ms 2026-02-17T21:03:51.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 43859067 899.23 MB/sec execute 145 sec latency 0.250 ms 2026-02-17T21:03:52.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 334598 6.78 MB/sec execute 146 sec latency 7.035 ms 2026-02-17T21:03:52.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 44024192 899.28 MB/sec execute 146 sec latency 0.342 ms 2026-02-17T21:03:53.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:53 trial104 ceph-mon[20612]: pgmap v251: 129 pgs: 129 active+clean; 145 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 3.1 MiB/s wr, 131 op/s 2026-02-17T21:03:53.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:53 trial153 ceph-mon[25357]: pgmap v251: 129 pgs: 129 active+clean; 145 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 3.1 MiB/s wr, 131 op/s 2026-02-17T21:03:53.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 335877 6.76 MB/sec execute 147 sec latency 6.506 ms 2026-02-17T21:03:53.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 44186720 899.12 MB/sec execute 147 sec latency 8.806 ms 2026-02-17T21:03:54.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:03:54.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:03:54.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:03:54.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:03:54.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:03:54.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:03:54.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:03:54.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:03:54.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 337276 6.80 MB/sec execute 148 sec latency 5.212 ms 2026-02-17T21:03:54.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 44350106 899.01 MB/sec execute 148 sec latency 11.092 ms 2026-02-17T21:03:55.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:55 trial104 ceph-mon[20612]: pgmap v252: 129 pgs: 129 active+clean; 144 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 3.0 MiB/s wr, 140 op/s 2026-02-17T21:03:55.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:55 trial153 ceph-mon[25357]: pgmap v252: 129 pgs: 129 active+clean; 144 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 3.0 MiB/s wr, 140 op/s 2026-02-17T21:03:55.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 338377 6.79 MB/sec execute 149 sec latency 7.759 ms 2026-02-17T21:03:55.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 44515342 899.06 MB/sec execute 149 sec latency 0.257 ms 2026-02-17T21:03:56.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 339598 6.76 MB/sec execute 150 sec latency 6.136 ms 2026-02-17T21:03:56.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 44681693 899.03 MB/sec execute 150 sec latency 0.238 ms 2026-02-17T21:03:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:57 trial153 ceph-mon[25357]: pgmap v253: 129 pgs: 129 active+clean; 146 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.0 MiB/s wr, 143 op/s 2026-02-17T21:03:57.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:57 trial104 ceph-mon[20612]: pgmap v253: 129 pgs: 129 active+clean; 146 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.0 MiB/s wr, 143 op/s 2026-02-17T21:03:57.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 340949 6.79 MB/sec execute 151 sec latency 4.616 ms 2026-02-17T21:03:57.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 44848458 899.03 MB/sec execute 151 sec latency 0.717 ms 2026-02-17T21:03:58.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 342168 6.78 MB/sec execute 152 sec latency 7.138 ms 2026-02-17T21:03:58.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 45013456 899.11 MB/sec execute 152 sec latency 0.282 ms 2026-02-17T21:03:59.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:03:59 trial104 ceph-mon[20612]: pgmap v254: 129 pgs: 129 active+clean; 146 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.2 MiB/s wr, 145 op/s 2026-02-17T21:03:59.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:03:59 trial153 ceph-mon[25357]: pgmap v254: 129 pgs: 129 active+clean; 146 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.2 MiB/s wr, 145 op/s 2026-02-17T21:03:59.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 343687 6.79 MB/sec execute 153 sec latency 6.657 ms 2026-02-17T21:03:59.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 45178635 899.03 MB/sec execute 153 sec latency 6.017 ms 2026-02-17T21:04:00.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 344663 6.78 MB/sec execute 154 sec latency 5.036 ms 2026-02-17T21:04:00.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 45344277 899.00 MB/sec execute 154 sec latency 0.233 ms 2026-02-17T21:04:01.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:01 trial104 ceph-mon[20612]: pgmap v255: 129 pgs: 129 active+clean; 146 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.3 MiB/s wr, 164 op/s 2026-02-17T21:04:01.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:01 trial153 ceph-mon[25357]: pgmap v255: 129 pgs: 129 active+clean; 146 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.3 MiB/s wr, 164 op/s 2026-02-17T21:04:01.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 345971 6.77 MB/sec execute 155 sec latency 6.968 ms 2026-02-17T21:04:01.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 45509751 899.05 MB/sec execute 155 sec latency 0.295 ms 2026-02-17T21:04:02.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 347398 6.79 MB/sec execute 156 sec latency 6.139 ms 2026-02-17T21:04:02.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 45677384 899.09 MB/sec execute 156 sec latency 0.283 ms 2026-02-17T21:04:03.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:03 trial104 ceph-mon[20612]: pgmap v256: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 137 op/s 2026-02-17T21:04:03.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:03 trial153 ceph-mon[25357]: pgmap v256: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 137 op/s 2026-02-17T21:04:03.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 348513 6.78 MB/sec execute 157 sec latency 7.886 ms 2026-02-17T21:04:03.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 45841235 899.10 MB/sec execute 157 sec latency 3.204 ms 2026-02-17T21:04:04.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:04:04.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:04:04.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 349870 6.77 MB/sec execute 158 sec latency 7.100 ms 2026-02-17T21:04:04.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 46008899 899.13 MB/sec execute 158 sec latency 0.265 ms 2026-02-17T21:04:05.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:05 trial104 ceph-mon[20612]: pgmap v257: 129 pgs: 129 active+clean; 149 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 148 op/s 2026-02-17T21:04:05.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:05 trial153 ceph-mon[25357]: pgmap v257: 129 pgs: 129 active+clean; 149 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 148 op/s 2026-02-17T21:04:05.642 INFO:tasks.workunit.client.1.trial153.stdout: 1 351271 6.80 MB/sec execute 159 sec latency 6.980 ms 2026-02-17T21:04:05.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 46176244 899.15 MB/sec execute 159 sec latency 0.251 ms 2026-02-17T21:04:06.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:06 trial104 ceph-mon[20612]: pgmap v258: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 3.0 MiB/s wr, 152 op/s 2026-02-17T21:04:06.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:06 trial153 ceph-mon[25357]: pgmap v258: 129 pgs: 129 active+clean; 148 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 3.0 MiB/s wr, 152 op/s 2026-02-17T21:04:06.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 352299 6.78 MB/sec execute 160 sec latency 7.811 ms 2026-02-17T21:04:06.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 46341634 899.21 MB/sec execute 160 sec latency 0.297 ms 2026-02-17T21:04:07.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 353612 6.77 MB/sec execute 161 sec latency 6.375 ms 2026-02-17T21:04:07.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 46508020 899.18 MB/sec execute 161 sec latency 0.291 ms 2026-02-17T21:04:08.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 355000 6.80 MB/sec execute 162 sec latency 5.433 ms 2026-02-17T21:04:08.752 INFO:tasks.workunit.client.0.trial104.stdout: 1 46672064 899.11 MB/sec execute 162 sec latency 9.348 ms 2026-02-17T21:04:09.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:08 trial153 ceph-mon[25357]: pgmap v259: 129 pgs: 129 active+clean; 150 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.1 MiB/s wr, 147 op/s 2026-02-17T21:04:09.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:08 trial104 ceph-mon[20612]: pgmap v259: 129 pgs: 129 active+clean; 150 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.1 MiB/s wr, 147 op/s 2026-02-17T21:04:09.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 356148 6.79 MB/sec execute 163 sec latency 7.032 ms 2026-02-17T21:04:09.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 46837827 899.18 MB/sec execute 163 sec latency 1.204 ms 2026-02-17T21:04:10.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 357588 6.79 MB/sec execute 164 sec latency 6.366 ms 2026-02-17T21:04:10.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 47003463 899.14 MB/sec execute 164 sec latency 0.266 ms 2026-02-17T21:04:11.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:10 trial153 ceph-mon[25357]: pgmap v260: 129 pgs: 129 active+clean; 150 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.2 MiB/s wr, 152 op/s 2026-02-17T21:04:11.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:10 trial104 ceph-mon[20612]: pgmap v260: 129 pgs: 129 active+clean; 150 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.2 MiB/s wr, 152 op/s 2026-02-17T21:04:11.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 358725 6.79 MB/sec execute 165 sec latency 5.065 ms 2026-02-17T21:04:11.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 47170256 899.14 MB/sec execute 165 sec latency 0.236 ms 2026-02-17T21:04:12.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 359962 6.79 MB/sec execute 166 sec latency 6.364 ms 2026-02-17T21:04:12.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 47335490 899.18 MB/sec execute 166 sec latency 0.311 ms 2026-02-17T21:04:13.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:12 trial153 ceph-mon[25357]: pgmap v261: 129 pgs: 129 active+clean; 152 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.1 MiB/s wr, 157 op/s 2026-02-17T21:04:13.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:12 trial104 ceph-mon[20612]: pgmap v261: 129 pgs: 129 active+clean; 152 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.1 MiB/s wr, 157 op/s 2026-02-17T21:04:13.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 361532 6.80 MB/sec execute 167 sec latency 5.027 ms 2026-02-17T21:04:13.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 47500316 899.14 MB/sec execute 167 sec latency 6.834 ms 2026-02-17T21:04:14.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 362453 6.79 MB/sec execute 168 sec latency 7.690 ms 2026-02-17T21:04:14.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 47667431 899.15 MB/sec execute 168 sec latency 0.257 ms 2026-02-17T21:04:15.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:14 trial153 ceph-mon[25357]: pgmap v262: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 136 op/s 2026-02-17T21:04:15.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:14 trial104 ceph-mon[20612]: pgmap v262: 129 pgs: 129 active+clean; 151 MiB data, 1.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 136 op/s 2026-02-17T21:04:15.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 363769 6.78 MB/sec execute 169 sec latency 6.409 ms 2026-02-17T21:04:15.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 47833305 899.20 MB/sec execute 169 sec latency 0.287 ms 2026-02-17T21:04:16.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 365132 6.79 MB/sec execute 170 sec latency 6.217 ms 2026-02-17T21:04:16.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 47998545 899.16 MB/sec execute 170 sec latency 0.243 ms 2026-02-17T21:04:17.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:16 trial153 ceph-mon[25357]: pgmap v263: 129 pgs: 129 active+clean; 154 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.1 MiB/s wr, 155 op/s 2026-02-17T21:04:17.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:16 trial104 ceph-mon[20612]: pgmap v263: 129 pgs: 129 active+clean; 154 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.1 MiB/s wr, 155 op/s 2026-02-17T21:04:17.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 366223 6.78 MB/sec execute 171 sec latency 6.483 ms 2026-02-17T21:04:17.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 48163580 899.20 MB/sec execute 171 sec latency 0.277 ms 2026-02-17T21:04:18.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 367542 6.77 MB/sec execute 172 sec latency 6.053 ms 2026-02-17T21:04:18.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 48329382 899.17 MB/sec execute 172 sec latency 0.372 ms 2026-02-17T21:04:19.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:18 trial153 ceph-mon[25357]: pgmap v264: 129 pgs: 129 active+clean; 154 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.1 MiB/s wr, 148 op/s 2026-02-17T21:04:19.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:04:19.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:18 trial104 ceph-mon[20612]: pgmap v264: 129 pgs: 129 active+clean; 154 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.1 MiB/s wr, 148 op/s 2026-02-17T21:04:19.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:04:19.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 368976 6.80 MB/sec execute 173 sec latency 5.576 ms 2026-02-17T21:04:19.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 48494970 899.15 MB/sec execute 173 sec latency 6.014 ms 2026-02-17T21:04:20.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 370005 6.78 MB/sec execute 174 sec latency 6.415 ms 2026-02-17T21:04:20.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 48660666 899.20 MB/sec execute 174 sec latency 0.256 ms 2026-02-17T21:04:21.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:20 trial153 ceph-mon[25357]: pgmap v265: 129 pgs: 129 active+clean; 157 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 162 op/s 2026-02-17T21:04:21.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:20 trial104 ceph-mon[20612]: pgmap v265: 129 pgs: 129 active+clean; 157 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 162 op/s 2026-02-17T21:04:21.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 371321 6.77 MB/sec execute 175 sec latency 5.346 ms 2026-02-17T21:04:21.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 48826648 899.17 MB/sec execute 175 sec latency 0.255 ms 2026-02-17T21:04:22.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 372708 6.80 MB/sec execute 176 sec latency 5.290 ms 2026-02-17T21:04:22.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 48993402 899.17 MB/sec execute 176 sec latency 0.248 ms 2026-02-17T21:04:23.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:22 trial153 ceph-mon[25357]: pgmap v266: 129 pgs: 129 active+clean; 158 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.1 MiB/s wr, 147 op/s 2026-02-17T21:04:23.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:22 trial104 ceph-mon[20612]: pgmap v266: 129 pgs: 129 active+clean; 158 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.1 MiB/s wr, 147 op/s 2026-02-17T21:04:23.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 373833 6.79 MB/sec execute 177 sec latency 6.977 ms 2026-02-17T21:04:23.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 49158963 899.22 MB/sec execute 177 sec latency 0.295 ms 2026-02-17T21:04:24.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 375049 6.77 MB/sec execute 178 sec latency 6.367 ms 2026-02-17T21:04:24.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 49326115 899.24 MB/sec execute 178 sec latency 0.241 ms 2026-02-17T21:04:25.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:24 trial153 ceph-mon[25357]: pgmap v267: 129 pgs: 129 active+clean; 158 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.0 MiB/s wr, 128 op/s 2026-02-17T21:04:25.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:24 trial104 ceph-mon[20612]: pgmap v267: 129 pgs: 129 active+clean; 158 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.0 MiB/s wr, 128 op/s 2026-02-17T21:04:25.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 376386 6.80 MB/sec execute 179 sec latency 5.025 ms 2026-02-17T21:04:25.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 49492521 899.23 MB/sec execute 179 sec latency 0.325 ms 2026-02-17T21:04:26.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 377558 6.79 MB/sec execute 180 sec latency 9.037 ms 2026-02-17T21:04:26.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 49655906 899.21 MB/sec execute 180 sec latency 0.434 ms 2026-02-17T21:04:27.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:26 trial153 ceph-mon[25357]: pgmap v268: 129 pgs: 129 active+clean; 157 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.0 MiB/s wr, 142 op/s 2026-02-17T21:04:27.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:26 trial104 ceph-mon[20612]: pgmap v268: 129 pgs: 129 active+clean; 157 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.0 MiB/s wr, 142 op/s 2026-02-17T21:04:27.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 379006 6.79 MB/sec execute 181 sec latency 5.114 ms 2026-02-17T21:04:27.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 49821636 899.19 MB/sec execute 181 sec latency 0.246 ms 2026-02-17T21:04:28.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 380067 6.79 MB/sec execute 182 sec latency 6.389 ms 2026-02-17T21:04:28.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 49987001 899.23 MB/sec execute 182 sec latency 0.276 ms 2026-02-17T21:04:29.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:28 trial153 ceph-mon[25357]: pgmap v269: 129 pgs: 129 active+clean; 159 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.0 MiB/s wr, 147 op/s 2026-02-17T21:04:29.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:28 trial104 ceph-mon[20612]: pgmap v269: 129 pgs: 129 active+clean; 159 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.0 MiB/s wr, 147 op/s 2026-02-17T21:04:29.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 381306 6.78 MB/sec execute 183 sec latency 6.973 ms 2026-02-17T21:04:29.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 50153967 899.25 MB/sec execute 183 sec latency 0.230 ms 2026-02-17T21:04:30.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 382842 6.79 MB/sec execute 184 sec latency 4.972 ms 2026-02-17T21:04:30.653 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:30 trial104 ceph-mon[20612]: pgmap v270: 129 pgs: 129 active+clean; 159 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 162 op/s 2026-02-17T21:04:30.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 50320831 899.25 MB/sec execute 184 sec latency 1.867 ms 2026-02-17T21:04:30.774 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:30 trial153 ceph-mon[25357]: pgmap v270: 129 pgs: 129 active+clean; 159 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 162 op/s 2026-02-17T21:04:31.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 383726 6.78 MB/sec execute 185 sec latency 5.687 ms 2026-02-17T21:04:31.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 50486670 899.32 MB/sec execute 185 sec latency 0.291 ms 2026-02-17T21:04:32.643 INFO:tasks.workunit.client.1.trial153.stdout: 1 385083 6.78 MB/sec execute 186 sec latency 7.780 ms 2026-02-17T21:04:32.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 50652911 899.29 MB/sec execute 186 sec latency 0.242 ms 2026-02-17T21:04:33.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:32 trial153 ceph-mon[25357]: pgmap v271: 129 pgs: 129 active+clean; 161 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 129 op/s 2026-02-17T21:04:33.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:32 trial104 ceph-mon[20612]: pgmap v271: 129 pgs: 129 active+clean; 161 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 129 op/s 2026-02-17T21:04:33.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 386619 6.80 MB/sec execute 187 sec latency 5.368 ms 2026-02-17T21:04:33.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 50819735 899.30 MB/sec execute 187 sec latency 0.347 ms 2026-02-17T21:04:34.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:04:34.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:04:34.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 387650 6.78 MB/sec execute 188 sec latency 5.862 ms 2026-02-17T21:04:34.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 50978825 899.17 MB/sec execute 188 sec latency 28.774 ms 2026-02-17T21:04:35.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:34 trial153 ceph-mon[25357]: pgmap v272: 129 pgs: 129 active+clean; 161 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 131 op/s 2026-02-17T21:04:35.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:34 trial104 ceph-mon[20612]: pgmap v272: 129 pgs: 129 active+clean; 161 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 131 op/s 2026-02-17T21:04:35.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 389035 6.78 MB/sec execute 189 sec latency 6.038 ms 2026-02-17T21:04:35.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 51144842 899.13 MB/sec execute 189 sec latency 0.248 ms 2026-02-17T21:04:36.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 390446 6.80 MB/sec execute 190 sec latency 5.084 ms 2026-02-17T21:04:36.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 51310309 899.11 MB/sec execute 190 sec latency 0.316 ms 2026-02-17T21:04:37.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:36 trial153 ceph-mon[25357]: pgmap v273: 129 pgs: 129 active+clean; 164 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 3.0 MiB/s wr, 164 op/s 2026-02-17T21:04:37.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:36 trial104 ceph-mon[20612]: pgmap v273: 129 pgs: 129 active+clean; 164 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 3.0 MiB/s wr, 164 op/s 2026-02-17T21:04:37.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 391475 6.78 MB/sec execute 191 sec latency 6.299 ms 2026-02-17T21:04:37.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 51475273 899.13 MB/sec execute 191 sec latency 0.750 ms 2026-02-17T21:04:38.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 392805 6.78 MB/sec execute 192 sec latency 6.627 ms 2026-02-17T21:04:38.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 51642835 899.17 MB/sec execute 192 sec latency 0.241 ms 2026-02-17T21:04:39.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:38 trial153 ceph-mon[25357]: pgmap v274: 129 pgs: 129 active+clean; 163 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 3.2 MiB/s wr, 149 op/s 2026-02-17T21:04:39.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:38 trial104 ceph-mon[20612]: pgmap v274: 129 pgs: 129 active+clean; 163 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 3.2 MiB/s wr, 149 op/s 2026-02-17T21:04:39.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 394148 6.80 MB/sec execute 193 sec latency 5.111 ms 2026-02-17T21:04:39.753 INFO:tasks.workunit.client.0.trial104.stdout: 1 51806850 899.18 MB/sec execute 193 sec latency 2.047 ms 2026-02-17T21:04:40.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 395268 6.79 MB/sec execute 194 sec latency 7.714 ms 2026-02-17T21:04:40.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 51973249 899.17 MB/sec execute 194 sec latency 4.850 ms 2026-02-17T21:04:41.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:40 trial153 ceph-mon[25357]: pgmap v275: 129 pgs: 129 active+clean; 165 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 3.4 MiB/s wr, 161 op/s 2026-02-17T21:04:41.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:40 trial104 ceph-mon[20612]: pgmap v275: 129 pgs: 129 active+clean; 165 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 3.4 MiB/s wr, 161 op/s 2026-02-17T21:04:41.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 396528 6.79 MB/sec execute 195 sec latency 7.416 ms 2026-02-17T21:04:41.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 52139417 899.14 MB/sec execute 195 sec latency 0.266 ms 2026-02-17T21:04:42.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 397744 6.79 MB/sec execute 196 sec latency 5.386 ms 2026-02-17T21:04:42.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 52303518 899.15 MB/sec execute 196 sec latency 0.303 ms 2026-02-17T21:04:43.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:42 trial153 ceph-mon[25357]: pgmap v276: 129 pgs: 129 active+clean; 165 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 3.1 MiB/s wr, 142 op/s 2026-02-17T21:04:43.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:42 trial104 ceph-mon[20612]: pgmap v276: 129 pgs: 129 active+clean; 165 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 3.1 MiB/s wr, 142 op/s 2026-02-17T21:04:43.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 398956 6.79 MB/sec execute 197 sec latency 8.182 ms 2026-02-17T21:04:43.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 52470832 899.18 MB/sec execute 197 sec latency 0.269 ms 2026-02-17T21:04:44.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 400483 6.79 MB/sec execute 198 sec latency 5.899 ms 2026-02-17T21:04:44.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 52637724 899.18 MB/sec execute 198 sec latency 0.237 ms 2026-02-17T21:04:45.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:44 trial153 ceph-mon[25357]: pgmap v277: 129 pgs: 129 active+clean; 164 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.9 MiB/s wr, 132 op/s 2026-02-17T21:04:45.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:44 trial104 ceph-mon[20612]: pgmap v277: 129 pgs: 129 active+clean; 164 MiB data, 1.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.9 MiB/s wr, 132 op/s 2026-02-17T21:04:45.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 401419 6.79 MB/sec execute 199 sec latency 5.231 ms 2026-02-17T21:04:45.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 52801992 899.20 MB/sec execute 199 sec latency 5.719 ms 2026-02-17T21:04:46.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 402670 6.78 MB/sec execute 200 sec latency 7.897 ms 2026-02-17T21:04:46.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 52967979 899.18 MB/sec execute 200 sec latency 0.248 ms 2026-02-17T21:04:47.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:46 trial153 ceph-mon[25357]: pgmap v278: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.2 MiB/s wr, 166 op/s 2026-02-17T21:04:47.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:46 trial104 ceph-mon[20612]: pgmap v278: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.2 MiB/s wr, 166 op/s 2026-02-17T21:04:47.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 404153 6.79 MB/sec execute 201 sec latency 7.398 ms 2026-02-17T21:04:47.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 53135807 899.21 MB/sec execute 201 sec latency 0.233 ms 2026-02-17T21:04:48.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 405061 6.78 MB/sec execute 202 sec latency 6.579 ms 2026-02-17T21:04:48.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 53298944 899.19 MB/sec execute 202 sec latency 0.410 ms 2026-02-17T21:04:49.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:48 trial153 ceph-mon[25357]: pgmap v279: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.0 MiB/s wr, 128 op/s 2026-02-17T21:04:49.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:04:49.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:48 trial104 ceph-mon[20612]: pgmap v279: 129 pgs: 129 active+clean; 168 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.0 MiB/s wr, 128 op/s 2026-02-17T21:04:49.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:04:49.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 406379 6.77 MB/sec execute 203 sec latency 7.611 ms 2026-02-17T21:04:49.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 53463252 899.12 MB/sec execute 203 sec latency 6.431 ms 2026-02-17T21:04:50.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 407776 6.79 MB/sec execute 204 sec latency 7.264 ms 2026-02-17T21:04:50.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 53627883 899.15 MB/sec execute 204 sec latency 0.290 ms 2026-02-17T21:04:51.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:50 trial153 ceph-mon[25357]: pgmap v280: 129 pgs: 129 active+clean; 169 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.2 MiB/s wr, 164 op/s 2026-02-17T21:04:51.106 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:50 trial104 ceph-mon[20612]: pgmap v280: 129 pgs: 129 active+clean; 169 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.2 MiB/s wr, 164 op/s 2026-02-17T21:04:51.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 408822 6.78 MB/sec execute 205 sec latency 7.555 ms 2026-02-17T21:04:51.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 53793973 899.13 MB/sec execute 205 sec latency 0.500 ms 2026-02-17T21:04:52.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 410098 6.77 MB/sec execute 206 sec latency 6.128 ms 2026-02-17T21:04:52.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 53960675 899.13 MB/sec execute 206 sec latency 0.240 ms 2026-02-17T21:04:53.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:52 trial104 ceph-mon[20612]: pgmap v281: 129 pgs: 129 active+clean; 170 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.9 MiB/s wr, 140 op/s 2026-02-17T21:04:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:52 trial153 ceph-mon[25357]: pgmap v281: 129 pgs: 129 active+clean; 170 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.9 MiB/s wr, 140 op/s 2026-02-17T21:04:53.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 411504 6.79 MB/sec execute 207 sec latency 6.208 ms 2026-02-17T21:04:53.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 54124587 899.13 MB/sec execute 207 sec latency 0.276 ms 2026-02-17T21:04:54.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:53 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:04:54.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:53 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:04:54.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 412530 6.78 MB/sec execute 208 sec latency 7.745 ms 2026-02-17T21:04:54.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 54287685 899.04 MB/sec execute 208 sec latency 5.920 ms 2026-02-17T21:04:55.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:54 trial104 ceph-mon[20612]: pgmap v282: 129 pgs: 129 active+clean; 170 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.9 MiB/s wr, 146 op/s 2026-02-17T21:04:55.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:04:55.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:04:55.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:04:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:54 trial153 ceph-mon[25357]: pgmap v282: 129 pgs: 129 active+clean; 170 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.9 MiB/s wr, 146 op/s 2026-02-17T21:04:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:04:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:04:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:04:55.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 413866 6.77 MB/sec execute 209 sec latency 6.882 ms 2026-02-17T21:04:55.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 54453288 899.01 MB/sec execute 209 sec latency 0.262 ms 2026-02-17T21:04:56.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 415284 6.79 MB/sec execute 210 sec latency 5.287 ms 2026-02-17T21:04:56.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 54617727 899.04 MB/sec execute 210 sec latency 0.449 ms 2026-02-17T21:04:57.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:56 trial104 ceph-mon[20612]: pgmap v283: 129 pgs: 129 active+clean; 169 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 2.9 MiB/s wr, 154 op/s 2026-02-17T21:04:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:56 trial153 ceph-mon[25357]: pgmap v283: 129 pgs: 129 active+clean; 169 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 2.9 MiB/s wr, 154 op/s 2026-02-17T21:04:57.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 416236 6.77 MB/sec execute 211 sec latency 6.717 ms 2026-02-17T21:04:57.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 54784515 899.04 MB/sec execute 211 sec latency 0.273 ms 2026-02-17T21:04:58.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 417495 6.77 MB/sec execute 212 sec latency 7.081 ms 2026-02-17T21:04:58.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 54951396 899.04 MB/sec execute 212 sec latency 0.248 ms 2026-02-17T21:04:59.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:04:58 trial104 ceph-mon[20612]: pgmap v284: 129 pgs: 129 active+clean; 172 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 144 op/s 2026-02-17T21:04:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:04:58 trial153 ceph-mon[25357]: pgmap v284: 129 pgs: 129 active+clean; 172 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 144 op/s 2026-02-17T21:04:59.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 418878 6.79 MB/sec execute 213 sec latency 5.470 ms 2026-02-17T21:04:59.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 55116436 899.07 MB/sec execute 213 sec latency 0.269 ms 2026-02-17T21:05:00.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 419967 6.78 MB/sec execute 214 sec latency 6.506 ms 2026-02-17T21:05:00.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 55281464 899.04 MB/sec execute 214 sec latency 12.914 ms 2026-02-17T21:05:01.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:00 trial104 ceph-mon[20612]: pgmap v285: 129 pgs: 129 active+clean; 174 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 3.4 MiB/s wr, 170 op/s 2026-02-17T21:05:01.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:00 trial153 ceph-mon[25357]: pgmap v285: 129 pgs: 129 active+clean; 174 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 3.4 MiB/s wr, 170 op/s 2026-02-17T21:05:01.644 INFO:tasks.workunit.client.1.trial153.stdout: 1 421298 6.78 MB/sec execute 215 sec latency 6.215 ms 2026-02-17T21:05:01.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 55446129 898.98 MB/sec execute 215 sec latency 9.711 ms 2026-02-17T21:05:02.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 422566 6.78 MB/sec execute 216 sec latency 4.831 ms 2026-02-17T21:05:02.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 55611623 899.03 MB/sec execute 216 sec latency 0.291 ms 2026-02-17T21:05:03.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:02 trial104 ceph-mon[20612]: pgmap v286: 129 pgs: 129 active+clean; 173 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 129 op/s 2026-02-17T21:05:03.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:02 trial153 ceph-mon[25357]: pgmap v286: 129 pgs: 129 active+clean; 173 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 129 op/s 2026-02-17T21:05:03.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 423800 6.78 MB/sec execute 217 sec latency 7.706 ms 2026-02-17T21:05:03.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 55778332 899.02 MB/sec execute 217 sec latency 0.230 ms 2026-02-17T21:05:04.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:05:04.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:05:04.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 425326 6.78 MB/sec execute 218 sec latency 6.279 ms 2026-02-17T21:05:04.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 55943344 899.06 MB/sec execute 218 sec latency 0.272 ms 2026-02-17T21:05:05.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:04 trial104 ceph-mon[20612]: pgmap v287: 129 pgs: 129 active+clean; 175 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 143 op/s 2026-02-17T21:05:05.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:04 trial153 ceph-mon[25357]: pgmap v287: 129 pgs: 129 active+clean; 175 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 143 op/s 2026-02-17T21:05:05.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 426268 6.78 MB/sec execute 219 sec latency 4.841 ms 2026-02-17T21:05:05.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 56108073 899.00 MB/sec execute 219 sec latency 6.390 ms 2026-02-17T21:05:06.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 427548 6.77 MB/sec execute 220 sec latency 7.050 ms 2026-02-17T21:05:06.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 56273377 898.97 MB/sec execute 220 sec latency 0.270 ms 2026-02-17T21:05:07.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:06 trial104 ceph-mon[20612]: pgmap v288: 129 pgs: 129 active+clean; 176 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.0 MiB/s wr, 149 op/s 2026-02-17T21:05:07.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:06 trial153 ceph-mon[25357]: pgmap v288: 129 pgs: 129 active+clean; 176 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.0 MiB/s wr, 149 op/s 2026-02-17T21:05:07.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 429002 6.78 MB/sec execute 221 sec latency 5.371 ms 2026-02-17T21:05:07.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 56437899 898.99 MB/sec execute 221 sec latency 0.314 ms 2026-02-17T21:05:08.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 430094 6.78 MB/sec execute 222 sec latency 6.310 ms 2026-02-17T21:05:08.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 56605785 899.01 MB/sec execute 222 sec latency 0.236 ms 2026-02-17T21:05:09.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:08 trial104 ceph-mon[20612]: pgmap v289: 129 pgs: 129 active+clean; 177 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.1 MiB/s wr, 139 op/s 2026-02-17T21:05:09.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:08 trial153 ceph-mon[25357]: pgmap v289: 129 pgs: 129 active+clean; 177 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.1 MiB/s wr, 139 op/s 2026-02-17T21:05:09.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 431404 6.77 MB/sec execute 223 sec latency 6.100 ms 2026-02-17T21:05:09.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 56773059 899.03 MB/sec execute 223 sec latency 0.230 ms 2026-02-17T21:05:10.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 432844 6.79 MB/sec execute 224 sec latency 6.276 ms 2026-02-17T21:05:10.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 56938568 899.08 MB/sec execute 224 sec latency 0.280 ms 2026-02-17T21:05:11.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:10 trial104 ceph-mon[20612]: pgmap v290: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.2 MiB/s wr, 163 op/s 2026-02-17T21:05:11.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:10 trial153 ceph-mon[25357]: pgmap v290: 129 pgs: 129 active+clean; 179 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.2 MiB/s wr, 163 op/s 2026-02-17T21:05:11.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 433890 6.78 MB/sec execute 225 sec latency 6.349 ms 2026-02-17T21:05:11.754 INFO:tasks.workunit.client.0.trial104.stdout: 1 57105458 899.08 MB/sec execute 225 sec latency 0.240 ms 2026-02-17T21:05:12.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 435199 6.77 MB/sec execute 226 sec latency 6.325 ms 2026-02-17T21:05:12.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 57271417 899.07 MB/sec execute 226 sec latency 0.263 ms 2026-02-17T21:05:13.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:12 trial104 ceph-mon[20612]: pgmap v291: 129 pgs: 129 active+clean; 178 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.9 MiB/s wr, 133 op/s 2026-02-17T21:05:13.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:12 trial153 ceph-mon[25357]: pgmap v291: 129 pgs: 129 active+clean; 178 MiB data, 1.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.9 MiB/s wr, 133 op/s 2026-02-17T21:05:13.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 436585 6.79 MB/sec execute 227 sec latency 5.427 ms 2026-02-17T21:05:13.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 57436798 899.10 MB/sec execute 227 sec latency 0.801 ms 2026-02-17T21:05:14.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 437705 6.78 MB/sec execute 228 sec latency 7.291 ms 2026-02-17T21:05:14.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 57603478 899.10 MB/sec execute 228 sec latency 0.232 ms 2026-02-17T21:05:15.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:14 trial104 ceph-mon[20612]: pgmap v292: 129 pgs: 129 active+clean; 178 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 3.0 MiB/s wr, 140 op/s 2026-02-17T21:05:15.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:14 trial153 ceph-mon[25357]: pgmap v292: 129 pgs: 129 active+clean; 178 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 3.0 MiB/s wr, 140 op/s 2026-02-17T21:05:15.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 438931 6.77 MB/sec execute 229 sec latency 6.802 ms 2026-02-17T21:05:15.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 57766340 899.09 MB/sec execute 229 sec latency 12.053 ms 2026-02-17T21:05:16.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 440282 6.79 MB/sec execute 230 sec latency 6.526 ms 2026-02-17T21:05:16.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 57929889 899.01 MB/sec execute 230 sec latency 10.087 ms 2026-02-17T21:05:17.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:16 trial104 ceph-mon[20612]: pgmap v293: 129 pgs: 129 active+clean; 181 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.1 MiB/s wr, 148 op/s 2026-02-17T21:05:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:16 trial153 ceph-mon[25357]: pgmap v293: 129 pgs: 129 active+clean; 181 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.1 MiB/s wr, 148 op/s 2026-02-17T21:05:17.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 441502 6.78 MB/sec execute 231 sec latency 6.622 ms 2026-02-17T21:05:17.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 58094421 898.95 MB/sec execute 231 sec latency 0.230 ms 2026-02-17T21:05:18.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 443062 6.79 MB/sec execute 232 sec latency 5.931 ms 2026-02-17T21:05:18.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 58258950 898.98 MB/sec execute 232 sec latency 0.328 ms 2026-02-17T21:05:19.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:18 trial104 ceph-mon[20612]: pgmap v294: 129 pgs: 129 active+clean; 181 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.2 MiB/s wr, 137 op/s 2026-02-17T21:05:19.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:05:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:18 trial153 ceph-mon[25357]: pgmap v294: 129 pgs: 129 active+clean; 181 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.2 MiB/s wr, 137 op/s 2026-02-17T21:05:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:05:19.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 444008 6.78 MB/sec execute 233 sec latency 5.523 ms 2026-02-17T21:05:19.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 58423842 898.94 MB/sec execute 233 sec latency 0.367 ms 2026-02-17T21:05:20.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 445280 6.78 MB/sec execute 234 sec latency 6.760 ms 2026-02-17T21:05:20.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 58590782 898.94 MB/sec execute 234 sec latency 0.367 ms 2026-02-17T21:05:21.075 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:20 trial153 ceph-mon[25357]: pgmap v295: 129 pgs: 129 active+clean; 183 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.5 MiB/s wr, 182 op/s 2026-02-17T21:05:21.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:20 trial104 ceph-mon[20612]: pgmap v295: 129 pgs: 129 active+clean; 183 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.5 MiB/s wr, 182 op/s 2026-02-17T21:05:21.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 446726 6.78 MB/sec execute 235 sec latency 5.569 ms 2026-02-17T21:05:21.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 58752560 898.90 MB/sec execute 235 sec latency 6.944 ms 2026-02-17T21:05:22.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 447744 6.78 MB/sec execute 236 sec latency 6.500 ms 2026-02-17T21:05:22.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 58917572 898.86 MB/sec execute 236 sec latency 0.255 ms 2026-02-17T21:05:23.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:22 trial104 ceph-mon[20612]: pgmap v296: 129 pgs: 129 active+clean; 183 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.0 MiB/s wr, 127 op/s 2026-02-17T21:05:23.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:22 trial153 ceph-mon[25357]: pgmap v296: 129 pgs: 129 active+clean; 183 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.0 MiB/s wr, 127 op/s 2026-02-17T21:05:23.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 449030 6.77 MB/sec execute 237 sec latency 6.141 ms 2026-02-17T21:05:23.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 59083873 898.85 MB/sec execute 237 sec latency 0.255 ms 2026-02-17T21:05:24.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 450449 6.79 MB/sec execute 238 sec latency 6.502 ms 2026-02-17T21:05:24.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 59249918 898.91 MB/sec execute 238 sec latency 0.315 ms 2026-02-17T21:05:25.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:24 trial104 ceph-mon[20612]: pgmap v297: 129 pgs: 129 active+clean; 183 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.9 MiB/s wr, 135 op/s 2026-02-17T21:05:25.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:24 trial153 ceph-mon[25357]: pgmap v297: 129 pgs: 129 active+clean; 183 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.9 MiB/s wr, 135 op/s 2026-02-17T21:05:25.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 451429 6.77 MB/sec execute 239 sec latency 8.565 ms 2026-02-17T21:05:25.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 59417007 898.92 MB/sec execute 239 sec latency 5.877 ms 2026-02-17T21:05:26.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 452726 6.77 MB/sec execute 240 sec latency 6.275 ms 2026-02-17T21:05:26.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 59582868 898.88 MB/sec execute 240 sec latency 6.348 ms 2026-02-17T21:05:27.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:26 trial104 ceph-mon[20612]: pgmap v298: 129 pgs: 129 active+clean; 185 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.0 MiB/s wr, 164 op/s 2026-02-17T21:05:27.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:26 trial153 ceph-mon[25357]: pgmap v298: 129 pgs: 129 active+clean; 185 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.0 MiB/s wr, 164 op/s 2026-02-17T21:05:27.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 454109 6.79 MB/sec execute 241 sec latency 5.777 ms 2026-02-17T21:05:27.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 59748704 898.94 MB/sec execute 241 sec latency 0.274 ms 2026-02-17T21:05:28.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 455096 6.77 MB/sec execute 242 sec latency 6.982 ms 2026-02-17T21:05:28.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 59916040 898.96 MB/sec execute 242 sec latency 0.234 ms 2026-02-17T21:05:29.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:28 trial104 ceph-mon[20612]: pgmap v299: 129 pgs: 129 active+clean; 185 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.9 MiB/s wr, 125 op/s 2026-02-17T21:05:29.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:28 trial153 ceph-mon[25357]: pgmap v299: 129 pgs: 129 active+clean; 185 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.9 MiB/s wr, 125 op/s 2026-02-17T21:05:29.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 456428 6.77 MB/sec execute 243 sec latency 6.120 ms 2026-02-17T21:05:29.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 60081490 899.00 MB/sec execute 243 sec latency 0.283 ms 2026-02-17T21:05:30.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 457837 6.79 MB/sec execute 244 sec latency 5.448 ms 2026-02-17T21:05:30.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 60247296 898.97 MB/sec execute 244 sec latency 12.423 ms 2026-02-17T21:05:31.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:30 trial104 ceph-mon[20612]: pgmap v300: 129 pgs: 129 active+clean; 187 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 3.3 MiB/s wr, 171 op/s 2026-02-17T21:05:31.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:30 trial153 ceph-mon[25357]: pgmap v300: 129 pgs: 129 active+clean; 187 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 3.3 MiB/s wr, 171 op/s 2026-02-17T21:05:31.645 INFO:tasks.workunit.client.1.trial153.stdout: 1 458947 6.85 MB/sec execute 245 sec latency 30.680 ms 2026-02-17T21:05:31.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 60413283 898.96 MB/sec execute 245 sec latency 0.245 ms 2026-02-17T21:05:32.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 460232 6.84 MB/sec execute 246 sec latency 8.654 ms 2026-02-17T21:05:32.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 60578939 899.01 MB/sec execute 246 sec latency 0.288 ms 2026-02-17T21:05:33.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:32 trial104 ceph-mon[20612]: pgmap v301: 129 pgs: 129 active+clean; 190 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.0 MiB/s wr, 123 op/s 2026-02-17T21:05:33.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:32 trial153 ceph-mon[25357]: pgmap v301: 129 pgs: 129 active+clean; 190 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.0 MiB/s wr, 123 op/s 2026-02-17T21:05:33.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 461651 6.85 MB/sec execute 247 sec latency 6.100 ms 2026-02-17T21:05:33.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 60745841 899.01 MB/sec execute 247 sec latency 0.295 ms 2026-02-17T21:05:34.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:05:34.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:05:34.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 462570 6.84 MB/sec execute 248 sec latency 7.531 ms 2026-02-17T21:05:34.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 60913802 899.03 MB/sec execute 248 sec latency 0.232 ms 2026-02-17T21:05:35.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:34 trial104 ceph-mon[20612]: pgmap v302: 129 pgs: 129 active+clean; 186 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.5 MiB/s wr, 153 op/s 2026-02-17T21:05:35.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:34 trial153 ceph-mon[25357]: pgmap v302: 129 pgs: 129 active+clean; 186 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 3.5 MiB/s wr, 153 op/s 2026-02-17T21:05:35.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 463929 6.84 MB/sec execute 249 sec latency 5.951 ms 2026-02-17T21:05:35.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 61079651 899.08 MB/sec execute 249 sec latency 2.411 ms 2026-02-17T21:05:36.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 465277 6.85 MB/sec execute 250 sec latency 7.088 ms 2026-02-17T21:05:36.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 61246442 899.08 MB/sec execute 250 sec latency 0.240 ms 2026-02-17T21:05:36.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:36 trial104 ceph-mon[20612]: pgmap v303: 129 pgs: 129 active+clean; 195 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 5.0 MiB/s wr, 181 op/s 2026-02-17T21:05:37.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:36 trial153 ceph-mon[25357]: pgmap v303: 129 pgs: 129 active+clean; 195 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 5.0 MiB/s wr, 181 op/s 2026-02-17T21:05:37.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 466336 6.84 MB/sec execute 251 sec latency 7.241 ms 2026-02-17T21:05:37.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 61414531 899.11 MB/sec execute 251 sec latency 0.241 ms 2026-02-17T21:05:38.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 467640 6.83 MB/sec execute 252 sec latency 6.649 ms 2026-02-17T21:05:38.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 61581481 899.19 MB/sec execute 252 sec latency 0.260 ms 2026-02-17T21:05:39.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:38 trial104 ceph-mon[20612]: pgmap v304: 129 pgs: 129 active+clean; 191 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 4.7 MiB/s wr, 151 op/s 2026-02-17T21:05:39.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:38 trial153 ceph-mon[25357]: pgmap v304: 129 pgs: 129 active+clean; 191 MiB data, 1.4 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 4.7 MiB/s wr, 151 op/s 2026-02-17T21:05:39.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 469099 6.85 MB/sec execute 253 sec latency 5.210 ms 2026-02-17T21:05:39.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 61748667 899.19 MB/sec execute 253 sec latency 0.308 ms 2026-02-17T21:05:40.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 470064 6.84 MB/sec execute 254 sec latency 8.430 ms 2026-02-17T21:05:40.755 INFO:tasks.workunit.client.0.trial104.stdout: 1 61915160 899.25 MB/sec execute 254 sec latency 0.267 ms 2026-02-17T21:05:41.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:40 trial104 ceph-mon[20612]: pgmap v305: 129 pgs: 129 active+clean; 193 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 5.2 MiB/s wr, 194 op/s 2026-02-17T21:05:41.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:40 trial153 ceph-mon[25357]: pgmap v305: 129 pgs: 129 active+clean; 193 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 5.2 MiB/s wr, 194 op/s 2026-02-17T21:05:41.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 471384 6.83 MB/sec execute 255 sec latency 6.131 ms 2026-02-17T21:05:41.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 62081532 899.24 MB/sec execute 255 sec latency 0.237 ms 2026-02-17T21:05:42.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 472799 6.85 MB/sec execute 256 sec latency 5.475 ms 2026-02-17T21:05:42.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 62247497 899.22 MB/sec execute 256 sec latency 5.499 ms 2026-02-17T21:05:43.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:42 trial104 ceph-mon[20612]: pgmap v306: 129 pgs: 129 active+clean; 193 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 4.4 MiB/s wr, 144 op/s 2026-02-17T21:05:43.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:42 trial153 ceph-mon[25357]: pgmap v306: 129 pgs: 129 active+clean; 193 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 4.4 MiB/s wr, 144 op/s 2026-02-17T21:05:43.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 473799 6.83 MB/sec execute 257 sec latency 7.768 ms 2026-02-17T21:05:43.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 62413285 899.28 MB/sec execute 257 sec latency 0.271 ms 2026-02-17T21:05:44.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 475139 6.83 MB/sec execute 258 sec latency 7.240 ms 2026-02-17T21:05:44.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 62579411 899.26 MB/sec execute 258 sec latency 0.316 ms 2026-02-17T21:05:45.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:44 trial104 ceph-mon[20612]: pgmap v307: 129 pgs: 129 active+clean; 192 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 4.1 MiB/s wr, 152 op/s 2026-02-17T21:05:45.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:44 trial153 ceph-mon[25357]: pgmap v307: 129 pgs: 129 active+clean; 192 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 4.1 MiB/s wr, 152 op/s 2026-02-17T21:05:45.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 476490 6.85 MB/sec execute 259 sec latency 5.049 ms 2026-02-17T21:05:45.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 62746888 899.27 MB/sec execute 259 sec latency 0.275 ms 2026-02-17T21:05:46.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 477697 6.84 MB/sec execute 260 sec latency 9.059 ms 2026-02-17T21:05:46.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 62910820 899.28 MB/sec execute 260 sec latency 7.273 ms 2026-02-17T21:05:47.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:46 trial104 ceph-mon[20612]: pgmap v308: 129 pgs: 129 active+clean; 195 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 4.2 MiB/s wr, 164 op/s 2026-02-17T21:05:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:46 trial153 ceph-mon[25357]: pgmap v308: 129 pgs: 129 active+clean; 195 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 4.2 MiB/s wr, 164 op/s 2026-02-17T21:05:47.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 479155 6.84 MB/sec execute 261 sec latency 5.259 ms 2026-02-17T21:05:47.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 63074619 899.21 MB/sec execute 261 sec latency 4.455 ms 2026-02-17T21:05:48.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 480239 6.84 MB/sec execute 262 sec latency 4.989 ms 2026-02-17T21:05:48.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 63242110 899.22 MB/sec execute 262 sec latency 0.285 ms 2026-02-17T21:05:49.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:48 trial104 ceph-mon[20612]: pgmap v309: 129 pgs: 129 active+clean; 195 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.5 MiB/s wr, 134 op/s 2026-02-17T21:05:49.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:05:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:48 trial153 ceph-mon[25357]: pgmap v309: 129 pgs: 129 active+clean; 195 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.5 MiB/s wr, 134 op/s 2026-02-17T21:05:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:05:49.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 481536 6.84 MB/sec execute 263 sec latency 7.584 ms 2026-02-17T21:05:49.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 63405896 899.23 MB/sec execute 263 sec latency 0.274 ms 2026-02-17T21:05:50.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 482989 6.84 MB/sec execute 264 sec latency 5.837 ms 2026-02-17T21:05:50.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 63572102 899.22 MB/sec execute 264 sec latency 0.251 ms 2026-02-17T21:05:51.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:50 trial104 ceph-mon[20612]: pgmap v310: 129 pgs: 129 active+clean; 197 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.6 MiB/s wr, 176 op/s 2026-02-17T21:05:51.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:50 trial153 ceph-mon[25357]: pgmap v310: 129 pgs: 129 active+clean; 197 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.6 MiB/s wr, 176 op/s 2026-02-17T21:05:51.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 484019 6.84 MB/sec execute 265 sec latency 7.260 ms 2026-02-17T21:05:51.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 63735007 899.21 MB/sec execute 265 sec latency 3.301 ms 2026-02-17T21:05:52.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 485280 6.83 MB/sec execute 266 sec latency 6.907 ms 2026-02-17T21:05:52.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 63900308 899.17 MB/sec execute 266 sec latency 0.274 ms 2026-02-17T21:05:53.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:52 trial104 ceph-mon[20612]: pgmap v311: 129 pgs: 129 active+clean; 197 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.7 MiB/s wr, 130 op/s 2026-02-17T21:05:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:52 trial153 ceph-mon[25357]: pgmap v311: 129 pgs: 129 active+clean; 197 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.7 MiB/s wr, 130 op/s 2026-02-17T21:05:53.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 486751 6.85 MB/sec execute 267 sec latency 5.627 ms 2026-02-17T21:05:53.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 64066992 899.17 MB/sec execute 267 sec latency 0.263 ms 2026-02-17T21:05:54.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 487734 6.83 MB/sec execute 268 sec latency 6.398 ms 2026-02-17T21:05:54.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 64229372 899.15 MB/sec execute 268 sec latency 0.293 ms 2026-02-17T21:05:55.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:54 trial104 ceph-mon[20612]: pgmap v312: 129 pgs: 129 active+clean; 198 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.9 MiB/s wr, 138 op/s 2026-02-17T21:05:55.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:05:55.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:05:55.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:05:55.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:05:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:54 trial153 ceph-mon[25357]: pgmap v312: 129 pgs: 129 active+clean; 198 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.9 MiB/s wr, 138 op/s 2026-02-17T21:05:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:05:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:05:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:05:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:05:55.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 489064 6.83 MB/sec execute 269 sec latency 7.079 ms 2026-02-17T21:05:55.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 64395549 899.14 MB/sec execute 269 sec latency 0.237 ms 2026-02-17T21:05:56.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 490392 6.85 MB/sec execute 270 sec latency 5.897 ms 2026-02-17T21:05:56.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 64561285 899.11 MB/sec execute 270 sec latency 0.263 ms 2026-02-17T21:05:57.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:56 trial104 ceph-mon[20612]: pgmap v313: 129 pgs: 129 active+clean; 201 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.6 MiB/s wr, 169 op/s 2026-02-17T21:05:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:56 trial153 ceph-mon[25357]: pgmap v313: 129 pgs: 129 active+clean; 201 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.6 MiB/s wr, 169 op/s 2026-02-17T21:05:57.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 491403 6.83 MB/sec execute 271 sec latency 5.887 ms 2026-02-17T21:05:57.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 64724723 899.10 MB/sec execute 271 sec latency 6.311 ms 2026-02-17T21:05:58.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 492717 6.83 MB/sec execute 272 sec latency 7.401 ms 2026-02-17T21:05:58.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 64889986 899.08 MB/sec execute 272 sec latency 0.285 ms 2026-02-17T21:05:59.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:05:58 trial104 ceph-mon[20612]: pgmap v314: 129 pgs: 129 active+clean; 200 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-17T21:05:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:05:58 trial153 ceph-mon[25357]: pgmap v314: 129 pgs: 129 active+clean; 200 MiB data, 1.5 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-17T21:05:59.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 494134 6.84 MB/sec execute 273 sec latency 5.185 ms 2026-02-17T21:05:59.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 65057333 899.09 MB/sec execute 273 sec latency 0.512 ms 2026-02-17T21:06:00.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 495237 6.84 MB/sec execute 274 sec latency 6.840 ms 2026-02-17T21:06:00.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 65222385 899.12 MB/sec execute 274 sec latency 0.273 ms 2026-02-17T21:06:01.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:00 trial104 ceph-mon[20612]: pgmap v315: 129 pgs: 129 active+clean; 201 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.8 MiB/s wr, 173 op/s 2026-02-17T21:06:01.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:00 trial153 ceph-mon[25357]: pgmap v315: 129 pgs: 129 active+clean; 201 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.8 MiB/s wr, 173 op/s 2026-02-17T21:06:01.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 496484 6.83 MB/sec execute 275 sec latency 7.008 ms 2026-02-17T21:06:01.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 65388376 899.10 MB/sec execute 275 sec latency 3.452 ms 2026-02-17T21:06:02.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 497806 6.84 MB/sec execute 276 sec latency 5.158 ms 2026-02-17T21:06:02.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 65551796 899.10 MB/sec execute 276 sec latency 3.289 ms 2026-02-17T21:06:03.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:02 trial104 ceph-mon[20612]: pgmap v316: 129 pgs: 129 active+clean; 200 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.6 MiB/s wr, 124 op/s 2026-02-17T21:06:03.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:02 trial153 ceph-mon[25357]: pgmap v316: 129 pgs: 129 active+clean; 200 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.6 MiB/s wr, 124 op/s 2026-02-17T21:06:03.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 498961 6.83 MB/sec execute 277 sec latency 7.449 ms 2026-02-17T21:06:03.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 65719493 899.11 MB/sec execute 277 sec latency 1.034 ms 2026-02-17T21:06:04.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:06:04.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:06:04.646 INFO:tasks.workunit.client.1.trial153.stdout: 1 500371 6.84 MB/sec execute 278 sec latency 5.763 ms 2026-02-17T21:06:04.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 65887623 899.15 MB/sec execute 278 sec latency 0.234 ms 2026-02-17T21:06:05.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:04 trial104 ceph-mon[20612]: pgmap v317: 129 pgs: 129 active+clean; 204 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.1 MiB/s wr, 158 op/s 2026-02-17T21:06:05.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:04 trial153 ceph-mon[25357]: pgmap v317: 129 pgs: 129 active+clean; 204 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.1 MiB/s wr, 158 op/s 2026-02-17T21:06:05.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 501433 6.84 MB/sec execute 279 sec latency 5.115 ms 2026-02-17T21:06:05.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 66053637 899.18 MB/sec execute 279 sec latency 0.268 ms 2026-02-17T21:06:06.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 502706 6.83 MB/sec execute 280 sec latency 8.051 ms 2026-02-17T21:06:06.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 66218072 899.15 MB/sec execute 280 sec latency 6.896 ms 2026-02-17T21:06:07.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:06 trial104 ceph-mon[20612]: pgmap v318: 129 pgs: 129 active+clean; 203 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.4 MiB/s wr, 165 op/s 2026-02-17T21:06:07.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:06 trial153 ceph-mon[25357]: pgmap v318: 129 pgs: 129 active+clean; 203 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.4 MiB/s wr, 165 op/s 2026-02-17T21:06:07.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 504221 6.84 MB/sec execute 281 sec latency 6.179 ms 2026-02-17T21:06:07.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 66382482 899.10 MB/sec execute 281 sec latency 6.574 ms 2026-02-17T21:06:08.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 505148 6.83 MB/sec execute 282 sec latency 23.995 ms 2026-02-17T21:06:08.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 66547434 899.12 MB/sec execute 282 sec latency 0.413 ms 2026-02-17T21:06:09.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:08 trial104 ceph-mon[20612]: pgmap v319: 129 pgs: 129 active+clean; 204 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.6 MiB/s wr, 129 op/s 2026-02-17T21:06:09.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:08 trial153 ceph-mon[25357]: pgmap v319: 129 pgs: 129 active+clean; 204 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.6 MiB/s wr, 129 op/s 2026-02-17T21:06:09.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 506485 6.83 MB/sec execute 283 sec latency 24.327 ms 2026-02-17T21:06:09.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 66713211 899.11 MB/sec execute 283 sec latency 0.255 ms 2026-02-17T21:06:10.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 507822 6.83 MB/sec execute 284 sec latency 5.376 ms 2026-02-17T21:06:10.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 66878257 899.07 MB/sec execute 284 sec latency 0.244 ms 2026-02-17T21:06:11.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:10 trial104 ceph-mon[20612]: pgmap v320: 129 pgs: 129 active+clean; 207 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 3.7 MiB/s wr, 178 op/s 2026-02-17T21:06:11.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:10 trial153 ceph-mon[25357]: pgmap v320: 129 pgs: 129 active+clean; 207 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 3.7 MiB/s wr, 178 op/s 2026-02-17T21:06:11.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 508891 6.83 MB/sec execute 285 sec latency 7.046 ms 2026-02-17T21:06:11.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 67042262 899.08 MB/sec execute 285 sec latency 0.295 ms 2026-02-17T21:06:12.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 510215 6.82 MB/sec execute 286 sec latency 5.627 ms 2026-02-17T21:06:12.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 67208323 899.07 MB/sec execute 286 sec latency 0.248 ms 2026-02-17T21:06:13.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:12 trial104 ceph-mon[20612]: pgmap v321: 129 pgs: 129 active+clean; 206 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.6 MiB/s wr, 130 op/s 2026-02-17T21:06:13.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:12 trial153 ceph-mon[25357]: pgmap v321: 129 pgs: 129 active+clean; 206 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.6 MiB/s wr, 130 op/s 2026-02-17T21:06:13.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 511667 6.84 MB/sec execute 287 sec latency 6.196 ms 2026-02-17T21:06:13.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 67374640 899.05 MB/sec execute 287 sec latency 0.266 ms 2026-02-17T21:06:14.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 512711 6.83 MB/sec execute 288 sec latency 6.318 ms 2026-02-17T21:06:14.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 67538968 899.07 MB/sec execute 288 sec latency 0.286 ms 2026-02-17T21:06:15.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:14 trial104 ceph-mon[20612]: pgmap v322: 129 pgs: 129 active+clean; 208 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.9 MiB/s wr, 137 op/s 2026-02-17T21:06:15.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:14 trial153 ceph-mon[25357]: pgmap v322: 129 pgs: 129 active+clean; 208 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.9 MiB/s wr, 137 op/s 2026-02-17T21:06:15.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 514022 6.82 MB/sec execute 289 sec latency 7.866 ms 2026-02-17T21:06:15.756 INFO:tasks.workunit.client.0.trial104.stdout: 1 67704436 899.05 MB/sec execute 289 sec latency 0.447 ms 2026-02-17T21:06:16.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 515420 6.84 MB/sec execute 290 sec latency 5.128 ms 2026-02-17T21:06:16.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 67867937 899.05 MB/sec execute 290 sec latency 7.142 ms 2026-02-17T21:06:17.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:16 trial104 ceph-mon[20612]: pgmap v323: 129 pgs: 129 active+clean; 210 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 140 op/s 2026-02-17T21:06:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:16 trial153 ceph-mon[25357]: pgmap v323: 129 pgs: 129 active+clean; 210 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 140 op/s 2026-02-17T21:06:17.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 516534 6.83 MB/sec execute 291 sec latency 6.935 ms 2026-02-17T21:06:17.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 68032189 898.99 MB/sec execute 291 sec latency 12.876 ms 2026-02-17T21:06:18.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 517729 6.82 MB/sec execute 292 sec latency 7.058 ms 2026-02-17T21:06:18.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 68197684 898.97 MB/sec execute 292 sec latency 0.274 ms 2026-02-17T21:06:19.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:18 trial104 ceph-mon[20612]: pgmap v324: 129 pgs: 129 active+clean; 210 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.9 MiB/s wr, 133 op/s 2026-02-17T21:06:19.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:06:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:18 trial153 ceph-mon[25357]: pgmap v324: 129 pgs: 129 active+clean; 210 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.9 MiB/s wr, 133 op/s 2026-02-17T21:06:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:06:19.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 519065 6.84 MB/sec execute 293 sec latency 4.893 ms 2026-02-17T21:06:19.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 68362984 899.00 MB/sec execute 293 sec latency 0.273 ms 2026-02-17T21:06:20.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 520179 6.83 MB/sec execute 294 sec latency 8.693 ms 2026-02-17T21:06:20.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 68529821 899.00 MB/sec execute 294 sec latency 0.250 ms 2026-02-17T21:06:21.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:20 trial104 ceph-mon[20612]: pgmap v325: 129 pgs: 129 active+clean; 212 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 3.8 MiB/s wr, 181 op/s 2026-02-17T21:06:21.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:20 trial153 ceph-mon[25357]: pgmap v325: 129 pgs: 129 active+clean; 212 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 3.8 MiB/s wr, 181 op/s 2026-02-17T21:06:21.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 521566 6.83 MB/sec execute 295 sec latency 6.202 ms 2026-02-17T21:06:21.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 68694727 898.98 MB/sec execute 295 sec latency 4.664 ms 2026-02-17T21:06:22.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 522663 6.83 MB/sec execute 296 sec latency 5.666 ms 2026-02-17T21:06:22.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 68859538 899.00 MB/sec execute 296 sec latency 1.701 ms 2026-02-17T21:06:23.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:22 trial104 ceph-mon[20612]: pgmap v326: 129 pgs: 129 active+clean; 207 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 128 op/s 2026-02-17T21:06:23.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:22 trial153 ceph-mon[25357]: pgmap v326: 129 pgs: 129 active+clean; 207 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 128 op/s 2026-02-17T21:06:23.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 523820 6.83 MB/sec execute 297 sec latency 6.917 ms 2026-02-17T21:06:23.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 69022159 898.92 MB/sec execute 297 sec latency 14.248 ms 2026-02-17T21:06:24.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 525383 6.83 MB/sec execute 298 sec latency 5.064 ms 2026-02-17T21:06:24.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 69186835 898.88 MB/sec execute 298 sec latency 0.251 ms 2026-02-17T21:06:25.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:24 trial104 ceph-mon[20612]: pgmap v327: 129 pgs: 129 active+clean; 203 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-17T21:06:25.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:24 trial153 ceph-mon[25357]: pgmap v327: 129 pgs: 129 active+clean; 203 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-17T21:06:25.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 526315 6.83 MB/sec execute 299 sec latency 5.077 ms 2026-02-17T21:06:25.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 69351614 898.91 MB/sec execute 299 sec latency 0.272 ms 2026-02-17T21:06:26.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 527575 6.82 MB/sec execute 300 sec latency 6.437 ms 2026-02-17T21:06:26.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 69517758 898.90 MB/sec execute 300 sec latency 0.243 ms 2026-02-17T21:06:27.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:26 trial104 ceph-mon[20612]: pgmap v328: 129 pgs: 129 active+clean; 189 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 3.4 MiB/s wr, 170 op/s 2026-02-17T21:06:27.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:26 trial153 ceph-mon[25357]: pgmap v328: 129 pgs: 129 active+clean; 189 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 3.4 MiB/s wr, 170 op/s 2026-02-17T21:06:27.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 529073 6.83 MB/sec execute 301 sec latency 5.614 ms 2026-02-17T21:06:27.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 69680160 898.87 MB/sec execute 301 sec latency 0.258 ms 2026-02-17T21:06:28.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 530030 6.82 MB/sec execute 302 sec latency 6.274 ms 2026-02-17T21:06:28.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 69847548 898.88 MB/sec execute 302 sec latency 0.240 ms 2026-02-17T21:06:29.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:28 trial104 ceph-mon[20612]: pgmap v329: 129 pgs: 129 active+clean; 190 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.7 MiB/s wr, 133 op/s 2026-02-17T21:06:29.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:28 trial153 ceph-mon[25357]: pgmap v329: 129 pgs: 129 active+clean; 190 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.7 MiB/s wr, 133 op/s 2026-02-17T21:06:29.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 531352 6.82 MB/sec execute 303 sec latency 5.852 ms 2026-02-17T21:06:29.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 70014132 898.88 MB/sec execute 303 sec latency 0.224 ms 2026-02-17T21:06:30.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 532843 6.83 MB/sec execute 304 sec latency 5.151 ms 2026-02-17T21:06:30.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 70177816 898.89 MB/sec execute 304 sec latency 0.535 ms 2026-02-17T21:06:31.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:30 trial104 ceph-mon[20612]: pgmap v330: 129 pgs: 129 active+clean; 192 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.6 MiB/s wr, 174 op/s 2026-02-17T21:06:31.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:30 trial153 ceph-mon[25357]: pgmap v330: 129 pgs: 129 active+clean; 192 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.6 MiB/s wr, 174 op/s 2026-02-17T21:06:31.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 533856 6.82 MB/sec execute 305 sec latency 6.179 ms 2026-02-17T21:06:31.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 70344469 898.89 MB/sec execute 305 sec latency 0.269 ms 2026-02-17T21:06:32.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 535222 6.82 MB/sec execute 306 sec latency 6.249 ms 2026-02-17T21:06:32.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 70508585 898.83 MB/sec execute 306 sec latency 8.963 ms 2026-02-17T21:06:33.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:32 trial104 ceph-mon[20612]: pgmap v331: 129 pgs: 129 active+clean; 192 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.5 MiB/s wr, 123 op/s 2026-02-17T21:06:33.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:32 trial153 ceph-mon[25357]: pgmap v331: 129 pgs: 129 active+clean; 192 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.5 MiB/s wr, 123 op/s 2026-02-17T21:06:33.647 INFO:tasks.workunit.client.1.trial153.stdout: 1 536582 6.83 MB/sec execute 307 sec latency 5.145 ms 2026-02-17T21:06:33.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 70672594 898.84 MB/sec execute 307 sec latency 0.256 ms 2026-02-17T21:06:34.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:06:34.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:06:34.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 537610 6.82 MB/sec execute 308 sec latency 6.142 ms 2026-02-17T21:06:34.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 70839294 898.84 MB/sec execute 308 sec latency 0.268 ms 2026-02-17T21:06:35.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:34 trial104 ceph-mon[20612]: pgmap v332: 129 pgs: 129 active+clean; 191 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 132 op/s 2026-02-17T21:06:35.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:34 trial153 ceph-mon[25357]: pgmap v332: 129 pgs: 129 active+clean; 191 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 132 op/s 2026-02-17T21:06:35.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 538921 6.82 MB/sec execute 309 sec latency 9.907 ms 2026-02-17T21:06:35.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 71005430 898.83 MB/sec execute 309 sec latency 0.234 ms 2026-02-17T21:06:36.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 540294 6.83 MB/sec execute 310 sec latency 5.136 ms 2026-02-17T21:06:36.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 71169348 898.84 MB/sec execute 310 sec latency 0.401 ms 2026-02-17T21:06:37.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:36 trial104 ceph-mon[20612]: pgmap v333: 129 pgs: 129 active+clean; 194 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.5 MiB/s wr, 166 op/s 2026-02-17T21:06:37.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:36 trial153 ceph-mon[25357]: pgmap v333: 129 pgs: 129 active+clean; 194 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.5 MiB/s wr, 166 op/s 2026-02-17T21:06:37.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 541449 6.83 MB/sec execute 311 sec latency 7.273 ms 2026-02-17T21:06:37.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 71333961 898.80 MB/sec execute 311 sec latency 6.460 ms 2026-02-17T21:06:38.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 542753 6.82 MB/sec execute 312 sec latency 5.436 ms 2026-02-17T21:06:38.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 71496396 898.72 MB/sec execute 312 sec latency 17.860 ms 2026-02-17T21:06:39.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:38 trial104 ceph-mon[20612]: pgmap v334: 129 pgs: 129 active+clean; 195 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.8 MiB/s wr, 141 op/s 2026-02-17T21:06:39.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:38 trial153 ceph-mon[25357]: pgmap v334: 129 pgs: 129 active+clean; 195 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.8 MiB/s wr, 141 op/s 2026-02-17T21:06:39.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 543962 6.83 MB/sec execute 313 sec latency 5.454 ms 2026-02-17T21:06:39.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 71659202 898.72 MB/sec execute 313 sec latency 0.677 ms 2026-02-17T21:06:40.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 545057 6.82 MB/sec execute 314 sec latency 6.716 ms 2026-02-17T21:06:40.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 71825345 898.71 MB/sec execute 314 sec latency 0.276 ms 2026-02-17T21:06:41.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:40 trial104 ceph-mon[20612]: pgmap v335: 129 pgs: 129 active+clean; 195 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.6 MiB/s wr, 160 op/s 2026-02-17T21:06:41.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:40 trial153 ceph-mon[25357]: pgmap v335: 129 pgs: 129 active+clean; 195 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.6 MiB/s wr, 160 op/s 2026-02-17T21:06:41.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 546459 6.82 MB/sec execute 315 sec latency 6.816 ms 2026-02-17T21:06:41.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 71990656 898.73 MB/sec execute 315 sec latency 0.272 ms 2026-02-17T21:06:42.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 547550 6.82 MB/sec execute 316 sec latency 5.002 ms 2026-02-17T21:06:42.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 72156523 898.73 MB/sec execute 316 sec latency 0.245 ms 2026-02-17T21:06:43.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:42 trial104 ceph-mon[20612]: pgmap v336: 129 pgs: 129 active+clean; 197 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 140 op/s 2026-02-17T21:06:43.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:42 trial153 ceph-mon[25357]: pgmap v336: 129 pgs: 129 active+clean; 197 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 140 op/s 2026-02-17T21:06:43.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 548765 6.82 MB/sec execute 317 sec latency 6.705 ms 2026-02-17T21:06:43.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 72320720 898.67 MB/sec execute 317 sec latency 3.965 ms 2026-02-17T21:06:44.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 550257 6.82 MB/sec execute 318 sec latency 5.447 ms 2026-02-17T21:06:44.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 72485572 898.70 MB/sec execute 318 sec latency 0.344 ms 2026-02-17T21:06:45.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:44 trial104 ceph-mon[20612]: pgmap v337: 129 pgs: 129 active+clean; 197 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 146 op/s 2026-02-17T21:06:45.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:44 trial153 ceph-mon[25357]: pgmap v337: 129 pgs: 129 active+clean; 197 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 146 op/s 2026-02-17T21:06:45.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 551230 6.82 MB/sec execute 319 sec latency 5.551 ms 2026-02-17T21:06:45.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 72653104 898.72 MB/sec execute 319 sec latency 0.262 ms 2026-02-17T21:06:46.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 552533 6.81 MB/sec execute 320 sec latency 6.930 ms 2026-02-17T21:06:46.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 72818927 898.70 MB/sec execute 320 sec latency 1.532 ms 2026-02-17T21:06:47.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:46 trial104 ceph-mon[20612]: pgmap v338: 129 pgs: 129 active+clean; 197 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 155 op/s 2026-02-17T21:06:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:46 trial153 ceph-mon[25357]: pgmap v338: 129 pgs: 129 active+clean; 197 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 155 op/s 2026-02-17T21:06:47.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 553942 6.82 MB/sec execute 321 sec latency 6.001 ms 2026-02-17T21:06:47.757 INFO:tasks.workunit.client.0.trial104.stdout: 1 72980906 898.67 MB/sec execute 321 sec latency 13.076 ms 2026-02-17T21:06:48.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 555024 6.82 MB/sec execute 322 sec latency 6.946 ms 2026-02-17T21:06:48.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 73147642 898.68 MB/sec execute 322 sec latency 1.132 ms 2026-02-17T21:06:49.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:48 trial104 ceph-mon[20612]: pgmap v339: 129 pgs: 129 active+clean; 198 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.7 MiB/s wr, 130 op/s 2026-02-17T21:06:49.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:06:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:48 trial153 ceph-mon[25357]: pgmap v339: 129 pgs: 129 active+clean; 198 MiB data, 1.6 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.7 MiB/s wr, 130 op/s 2026-02-17T21:06:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:06:49.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 556327 6.81 MB/sec execute 323 sec latency 6.622 ms 2026-02-17T21:06:49.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 73315055 898.68 MB/sec execute 323 sec latency 0.264 ms 2026-02-17T21:06:50.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 557787 6.83 MB/sec execute 324 sec latency 4.987 ms 2026-02-17T21:06:50.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 73478858 898.69 MB/sec execute 324 sec latency 0.269 ms 2026-02-17T21:06:51.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:50 trial104 ceph-mon[20612]: pgmap v340: 129 pgs: 129 active+clean; 201 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.5 MiB/s wr, 164 op/s 2026-02-17T21:06:51.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:50 trial153 ceph-mon[25357]: pgmap v340: 129 pgs: 129 active+clean; 201 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.5 MiB/s wr, 164 op/s 2026-02-17T21:06:51.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 558799 6.82 MB/sec execute 325 sec latency 7.075 ms 2026-02-17T21:06:51.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 73646578 898.71 MB/sec execute 325 sec latency 0.251 ms 2026-02-17T21:06:52.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 560101 6.81 MB/sec execute 326 sec latency 7.326 ms 2026-02-17T21:06:52.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 73808305 898.68 MB/sec execute 326 sec latency 11.969 ms 2026-02-17T21:06:53.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:52 trial104 ceph-mon[20612]: pgmap v341: 129 pgs: 129 active+clean; 202 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.7 MiB/s wr, 143 op/s 2026-02-17T21:06:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:52 trial153 ceph-mon[25357]: pgmap v341: 129 pgs: 129 active+clean; 202 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.7 MiB/s wr, 143 op/s 2026-02-17T21:06:53.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 561499 6.83 MB/sec execute 327 sec latency 5.295 ms 2026-02-17T21:06:53.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 73974886 898.68 MB/sec execute 327 sec latency 3.805 ms 2026-02-17T21:06:54.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 562491 6.81 MB/sec execute 328 sec latency 7.111 ms 2026-02-17T21:06:54.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 74137098 898.60 MB/sec execute 328 sec latency 0.260 ms 2026-02-17T21:06:55.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:54 trial104 ceph-mon[20612]: pgmap v342: 129 pgs: 129 active+clean; 201 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.7 MiB/s wr, 122 op/s 2026-02-17T21:06:55.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:06:55.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:06:55.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:06:55.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:06:55.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:06:55.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:06:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:54 trial153 ceph-mon[25357]: pgmap v342: 129 pgs: 129 active+clean; 201 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.7 MiB/s wr, 122 op/s 2026-02-17T21:06:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:06:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:06:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:06:55.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:06:55.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:06:55.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:06:55.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 563835 6.81 MB/sec execute 329 sec latency 6.040 ms 2026-02-17T21:06:55.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 74301659 898.63 MB/sec execute 329 sec latency 0.278 ms 2026-02-17T21:06:56.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 565137 6.82 MB/sec execute 330 sec latency 5.610 ms 2026-02-17T21:06:56.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 74467276 898.60 MB/sec execute 330 sec latency 0.581 ms 2026-02-17T21:06:57.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:56 trial104 ceph-mon[20612]: pgmap v343: 129 pgs: 129 active+clean; 203 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.2 MiB/s wr, 155 op/s 2026-02-17T21:06:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:56 trial153 ceph-mon[25357]: pgmap v343: 129 pgs: 129 active+clean; 203 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.2 MiB/s wr, 155 op/s 2026-02-17T21:06:57.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 566219 6.82 MB/sec execute 331 sec latency 7.390 ms 2026-02-17T21:06:57.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 74632280 898.57 MB/sec execute 331 sec latency 0.243 ms 2026-02-17T21:06:58.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 567567 6.81 MB/sec execute 332 sec latency 6.906 ms 2026-02-17T21:06:58.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 74795834 898.58 MB/sec execute 332 sec latency 9.605 ms 2026-02-17T21:06:59.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:06:58 trial104 ceph-mon[20612]: pgmap v344: 129 pgs: 129 active+clean; 201 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 141 op/s 2026-02-17T21:06:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:06:58 trial153 ceph-mon[25357]: pgmap v344: 129 pgs: 129 active+clean; 201 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 141 op/s 2026-02-17T21:06:59.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 568787 6.82 MB/sec execute 333 sec latency 5.210 ms 2026-02-17T21:06:59.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 74961311 898.56 MB/sec execute 333 sec latency 0.403 ms 2026-02-17T21:07:00.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 570039 6.81 MB/sec execute 334 sec latency 6.386 ms 2026-02-17T21:07:00.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 75128883 898.58 MB/sec execute 334 sec latency 0.255 ms 2026-02-17T21:07:01.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:00 trial104 ceph-mon[20612]: pgmap v345: 129 pgs: 129 active+clean; 204 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 175 op/s 2026-02-17T21:07:01.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:00 trial153 ceph-mon[25357]: pgmap v345: 129 pgs: 129 active+clean; 204 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 175 op/s 2026-02-17T21:07:01.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 571614 6.82 MB/sec execute 335 sec latency 5.058 ms 2026-02-17T21:07:01.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 75293021 898.59 MB/sec execute 335 sec latency 0.427 ms 2026-02-17T21:07:02.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 572513 6.81 MB/sec execute 336 sec latency 7.055 ms 2026-02-17T21:07:02.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 75457859 898.55 MB/sec execute 336 sec latency 0.278 ms 2026-02-17T21:07:03.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:02 trial104 ceph-mon[20612]: pgmap v346: 129 pgs: 129 active+clean; 204 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.6 MiB/s wr, 125 op/s 2026-02-17T21:07:03.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:02 trial153 ceph-mon[25357]: pgmap v346: 129 pgs: 129 active+clean; 204 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.6 MiB/s wr, 125 op/s 2026-02-17T21:07:03.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 573859 6.81 MB/sec execute 337 sec latency 5.943 ms 2026-02-17T21:07:03.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 75623028 898.53 MB/sec execute 337 sec latency 0.252 ms 2026-02-17T21:07:04.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:07:04.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:07:04.648 INFO:tasks.workunit.client.1.trial153.stdout: 1 575219 6.82 MB/sec execute 338 sec latency 7.071 ms 2026-02-17T21:07:04.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 75787134 898.54 MB/sec execute 338 sec latency 0.290 ms 2026-02-17T21:07:05.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:04 trial153 ceph-mon[25357]: pgmap v347: 129 pgs: 129 active+clean; 204 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.8 MiB/s wr, 129 op/s 2026-02-17T21:07:05.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:04 trial104 ceph-mon[20612]: pgmap v347: 129 pgs: 129 active+clean; 204 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.8 MiB/s wr, 129 op/s 2026-02-17T21:07:05.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 576305 6.81 MB/sec execute 339 sec latency 6.916 ms 2026-02-17T21:07:05.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 75953764 898.54 MB/sec execute 339 sec latency 0.264 ms 2026-02-17T21:07:06.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 577612 6.81 MB/sec execute 340 sec latency 6.584 ms 2026-02-17T21:07:06.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 76117021 898.54 MB/sec execute 340 sec latency 0.292 ms 2026-02-17T21:07:07.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:06 trial153 ceph-mon[25357]: pgmap v348: 129 pgs: 129 active+clean; 208 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.6 MiB/s wr, 166 op/s 2026-02-17T21:07:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:06 trial104 ceph-mon[20612]: pgmap v348: 129 pgs: 129 active+clean; 208 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.6 MiB/s wr, 166 op/s 2026-02-17T21:07:07.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 579052 6.82 MB/sec execute 341 sec latency 7.069 ms 2026-02-17T21:07:07.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 76281825 898.50 MB/sec execute 341 sec latency 0.245 ms 2026-02-17T21:07:08.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 579982 6.81 MB/sec execute 342 sec latency 7.412 ms 2026-02-17T21:07:08.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 76446119 898.47 MB/sec execute 342 sec latency 10.463 ms 2026-02-17T21:07:09.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:08 trial153 ceph-mon[25357]: pgmap v349: 129 pgs: 129 active+clean; 208 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.9 MiB/s wr, 133 op/s 2026-02-17T21:07:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:08 trial104 ceph-mon[20612]: pgmap v349: 129 pgs: 129 active+clean; 208 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.9 MiB/s wr, 133 op/s 2026-02-17T21:07:09.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 581277 6.81 MB/sec execute 343 sec latency 6.549 ms 2026-02-17T21:07:09.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 76609756 898.46 MB/sec execute 343 sec latency 4.213 ms 2026-02-17T21:07:10.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 582661 6.82 MB/sec execute 344 sec latency 5.455 ms 2026-02-17T21:07:10.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 76776039 898.46 MB/sec execute 344 sec latency 0.264 ms 2026-02-17T21:07:11.205 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:10 trial104 ceph-mon[20612]: pgmap v350: 129 pgs: 129 active+clean; 209 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 3.7 MiB/s wr, 177 op/s 2026-02-17T21:07:11.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:10 trial153 ceph-mon[25357]: pgmap v350: 129 pgs: 129 active+clean; 209 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 3.7 MiB/s wr, 177 op/s 2026-02-17T21:07:11.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 583599 6.81 MB/sec execute 345 sec latency 6.929 ms 2026-02-17T21:07:11.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 76941289 898.44 MB/sec execute 345 sec latency 0.423 ms 2026-02-17T21:07:12.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 584899 6.80 MB/sec execute 346 sec latency 6.747 ms 2026-02-17T21:07:12.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 77104894 898.45 MB/sec execute 346 sec latency 0.289 ms 2026-02-17T21:07:13.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:12 trial153 ceph-mon[25357]: pgmap v351: 129 pgs: 129 active+clean; 193 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.5 MiB/s wr, 128 op/s 2026-02-17T21:07:13.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:12 trial104 ceph-mon[20612]: pgmap v351: 129 pgs: 129 active+clean; 193 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.5 MiB/s wr, 128 op/s 2026-02-17T21:07:13.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 586290 6.82 MB/sec execute 347 sec latency 5.755 ms 2026-02-17T21:07:13.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 77270289 898.42 MB/sec execute 347 sec latency 7.363 ms 2026-02-17T21:07:14.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 587292 6.81 MB/sec execute 348 sec latency 6.169 ms 2026-02-17T21:07:14.758 INFO:tasks.workunit.client.0.trial104.stdout: 1 77433473 898.36 MB/sec execute 348 sec latency 10.400 ms 2026-02-17T21:07:15.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:14 trial153 ceph-mon[25357]: pgmap v352: 129 pgs: 129 active+clean; 194 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.8 MiB/s wr, 133 op/s 2026-02-17T21:07:15.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:14 trial104 ceph-mon[20612]: pgmap v352: 129 pgs: 129 active+clean; 194 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.8 MiB/s wr, 133 op/s 2026-02-17T21:07:15.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 588623 6.80 MB/sec execute 349 sec latency 6.419 ms 2026-02-17T21:07:15.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 77598130 898.39 MB/sec execute 349 sec latency 0.329 ms 2026-02-17T21:07:16.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 589957 6.82 MB/sec execute 350 sec latency 5.406 ms 2026-02-17T21:07:16.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 77764048 898.37 MB/sec execute 350 sec latency 0.235 ms 2026-02-17T21:07:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:16 trial153 ceph-mon[25357]: pgmap v353: 129 pgs: 129 active+clean; 188 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 170 op/s 2026-02-17T21:07:17.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:16 trial104 ceph-mon[20612]: pgmap v353: 129 pgs: 129 active+clean; 188 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 170 op/s 2026-02-17T21:07:17.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 591030 6.81 MB/sec execute 351 sec latency 7.960 ms 2026-02-17T21:07:17.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 77928895 898.40 MB/sec execute 351 sec latency 0.268 ms 2026-02-17T21:07:18.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 592379 6.81 MB/sec execute 352 sec latency 7.179 ms 2026-02-17T21:07:18.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 78093513 898.36 MB/sec execute 352 sec latency 0.240 ms 2026-02-17T21:07:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:18 trial153 ceph-mon[25357]: pgmap v354: 129 pgs: 129 active+clean; 188 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.6 MiB/s wr, 132 op/s 2026-02-17T21:07:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:07:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:18 trial104 ceph-mon[20612]: pgmap v354: 129 pgs: 129 active+clean; 188 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.6 MiB/s wr, 132 op/s 2026-02-17T21:07:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:07:19.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 593608 6.81 MB/sec execute 353 sec latency 5.136 ms 2026-02-17T21:07:19.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 78256845 898.32 MB/sec execute 353 sec latency 15.191 ms 2026-02-17T21:07:20.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 594804 6.81 MB/sec execute 354 sec latency 7.931 ms 2026-02-17T21:07:20.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 78422789 898.35 MB/sec execute 354 sec latency 0.626 ms 2026-02-17T21:07:21.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:20 trial153 ceph-mon[25357]: pgmap v355: 129 pgs: 129 active+clean; 190 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.6 MiB/s wr, 173 op/s 2026-02-17T21:07:21.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:20 trial104 ceph-mon[20612]: pgmap v355: 129 pgs: 129 active+clean; 190 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.6 MiB/s wr, 173 op/s 2026-02-17T21:07:21.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 596192 6.81 MB/sec execute 355 sec latency 5.383 ms 2026-02-17T21:07:21.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 78589431 898.35 MB/sec execute 355 sec latency 0.267 ms 2026-02-17T21:07:22.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 597314 6.81 MB/sec execute 356 sec latency 4.618 ms 2026-02-17T21:07:22.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 78757047 898.37 MB/sec execute 356 sec latency 0.242 ms 2026-02-17T21:07:23.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:22 trial104 ceph-mon[20612]: pgmap v356: 129 pgs: 129 active+clean; 191 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 124 op/s 2026-02-17T21:07:23.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:22 trial153 ceph-mon[25357]: pgmap v356: 129 pgs: 129 active+clean; 191 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 124 op/s 2026-02-17T21:07:23.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 598586 6.80 MB/sec execute 357 sec latency 6.808 ms 2026-02-17T21:07:23.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 78920649 898.37 MB/sec execute 357 sec latency 6.717 ms 2026-02-17T21:07:24.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 600034 6.81 MB/sec execute 358 sec latency 6.675 ms 2026-02-17T21:07:24.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 79086674 898.36 MB/sec execute 358 sec latency 5.205 ms 2026-02-17T21:07:25.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:24 trial153 ceph-mon[25357]: pgmap v357: 129 pgs: 129 active+clean; 190 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 135 op/s 2026-02-17T21:07:25.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:24 trial104 ceph-mon[20612]: pgmap v357: 129 pgs: 129 active+clean; 190 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 135 op/s 2026-02-17T21:07:25.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 601069 6.81 MB/sec execute 359 sec latency 5.678 ms 2026-02-17T21:07:25.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 79255203 898.39 MB/sec execute 359 sec latency 0.231 ms 2026-02-17T21:07:26.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 602346 6.80 MB/sec execute 360 sec latency 8.182 ms 2026-02-17T21:07:26.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 79420364 898.41 MB/sec execute 360 sec latency 0.270 ms 2026-02-17T21:07:27.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:26 trial153 ceph-mon[25357]: pgmap v358: 129 pgs: 129 active+clean; 193 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.5 MiB/s wr, 170 op/s 2026-02-17T21:07:27.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:26 trial104 ceph-mon[20612]: pgmap v358: 129 pgs: 129 active+clean; 193 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.5 MiB/s wr, 170 op/s 2026-02-17T21:07:27.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 603779 6.81 MB/sec execute 361 sec latency 5.581 ms 2026-02-17T21:07:27.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 79586459 898.40 MB/sec execute 361 sec latency 0.654 ms 2026-02-17T21:07:28.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 604745 6.80 MB/sec execute 362 sec latency 8.073 ms 2026-02-17T21:07:28.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 79751128 898.38 MB/sec execute 362 sec latency 4.620 ms 2026-02-17T21:07:29.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:28 trial153 ceph-mon[25357]: pgmap v359: 129 pgs: 129 active+clean; 192 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.7 MiB/s wr, 132 op/s 2026-02-17T21:07:29.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:28 trial104 ceph-mon[20612]: pgmap v359: 129 pgs: 129 active+clean; 192 MiB data, 1.7 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.7 MiB/s wr, 132 op/s 2026-02-17T21:07:29.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 606008 6.80 MB/sec execute 363 sec latency 6.201 ms 2026-02-17T21:07:29.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 79915907 898.39 MB/sec execute 363 sec latency 0.459 ms 2026-02-17T21:07:30.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 607476 6.81 MB/sec execute 364 sec latency 5.190 ms 2026-02-17T21:07:30.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 80082333 898.39 MB/sec execute 364 sec latency 0.384 ms 2026-02-17T21:07:31.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:30 trial153 ceph-mon[25357]: pgmap v360: 129 pgs: 129 active+clean; 193 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 3.6 MiB/s wr, 172 op/s 2026-02-17T21:07:31.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:30 trial104 ceph-mon[20612]: pgmap v360: 129 pgs: 129 active+clean; 193 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 3.6 MiB/s wr, 172 op/s 2026-02-17T21:07:31.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 608520 6.80 MB/sec execute 365 sec latency 6.141 ms 2026-02-17T21:07:31.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 80247421 898.41 MB/sec execute 365 sec latency 0.287 ms 2026-02-17T21:07:32.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 609895 6.80 MB/sec execute 366 sec latency 5.857 ms 2026-02-17T21:07:32.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 80414018 898.42 MB/sec execute 366 sec latency 0.227 ms 2026-02-17T21:07:33.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:32 trial104 ceph-mon[20612]: pgmap v361: 129 pgs: 129 active+clean; 194 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.6 MiB/s wr, 125 op/s 2026-02-17T21:07:33.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:32 trial153 ceph-mon[25357]: pgmap v361: 129 pgs: 129 active+clean; 194 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.6 MiB/s wr, 125 op/s 2026-02-17T21:07:33.649 INFO:tasks.workunit.client.1.trial153.stdout: 1 611249 6.81 MB/sec execute 367 sec latency 5.425 ms 2026-02-17T21:07:33.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 80580067 898.40 MB/sec execute 367 sec latency 0.261 ms 2026-02-17T21:07:34.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:07:34.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:07:34.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 612375 6.81 MB/sec execute 368 sec latency 7.155 ms 2026-02-17T21:07:34.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 80744618 898.42 MB/sec execute 368 sec latency 5.464 ms 2026-02-17T21:07:35.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:34 trial153 ceph-mon[25357]: pgmap v362: 129 pgs: 129 active+clean; 196 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.9 MiB/s wr, 160 op/s 2026-02-17T21:07:35.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:34 trial104 ceph-mon[20612]: pgmap v362: 129 pgs: 129 active+clean; 196 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 2.9 MiB/s wr, 160 op/s 2026-02-17T21:07:35.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 613791 6.81 MB/sec execute 369 sec latency 6.135 ms 2026-02-17T21:07:35.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 80912195 898.43 MB/sec execute 369 sec latency 0.298 ms 2026-02-17T21:07:36.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 614914 6.81 MB/sec execute 370 sec latency 6.340 ms 2026-02-17T21:07:36.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 81079868 898.45 MB/sec execute 370 sec latency 0.990 ms 2026-02-17T21:07:37.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:36 trial153 ceph-mon[25357]: pgmap v363: 129 pgs: 129 active+clean; 197 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.4 MiB/s wr, 164 op/s 2026-02-17T21:07:37.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:36 trial104 ceph-mon[20612]: pgmap v363: 129 pgs: 129 active+clean; 197 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.4 MiB/s wr, 164 op/s 2026-02-17T21:07:37.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 616181 6.80 MB/sec execute 371 sec latency 7.020 ms 2026-02-17T21:07:37.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 81244833 898.47 MB/sec execute 371 sec latency 0.296 ms 2026-02-17T21:07:38.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 617720 6.81 MB/sec execute 372 sec latency 6.024 ms 2026-02-17T21:07:38.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 81409905 898.45 MB/sec execute 372 sec latency 5.223 ms 2026-02-17T21:07:39.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:38 trial153 ceph-mon[25357]: pgmap v364: 129 pgs: 129 active+clean; 196 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.7 MiB/s wr, 127 op/s 2026-02-17T21:07:39.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:38 trial104 ceph-mon[20612]: pgmap v364: 129 pgs: 129 active+clean; 196 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.7 MiB/s wr, 127 op/s 2026-02-17T21:07:39.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 618645 6.81 MB/sec execute 373 sec latency 8.263 ms 2026-02-17T21:07:39.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 81575267 898.43 MB/sec execute 373 sec latency 4.443 ms 2026-02-17T21:07:40.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 619894 6.80 MB/sec execute 374 sec latency 6.787 ms 2026-02-17T21:07:40.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 81740434 898.45 MB/sec execute 374 sec latency 0.276 ms 2026-02-17T21:07:41.206 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:40 trial104 ceph-mon[20612]: pgmap v365: 129 pgs: 129 active+clean; 197 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 175 op/s 2026-02-17T21:07:41.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:40 trial153 ceph-mon[25357]: pgmap v365: 129 pgs: 129 active+clean; 197 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 175 op/s 2026-02-17T21:07:41.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 621308 6.81 MB/sec execute 375 sec latency 5.647 ms 2026-02-17T21:07:41.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 81907233 898.46 MB/sec execute 375 sec latency 0.251 ms 2026-02-17T21:07:42.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 622391 6.80 MB/sec execute 376 sec latency 6.444 ms 2026-02-17T21:07:42.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 82072554 898.48 MB/sec execute 376 sec latency 0.264 ms 2026-02-17T21:07:43.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:42 trial153 ceph-mon[25357]: pgmap v366: 129 pgs: 129 active+clean; 197 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 131 op/s 2026-02-17T21:07:43.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:42 trial104 ceph-mon[20612]: pgmap v366: 129 pgs: 129 active+clean; 197 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 131 op/s 2026-02-17T21:07:43.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 623712 6.80 MB/sec execute 377 sec latency 6.046 ms 2026-02-17T21:07:43.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 82238209 898.47 MB/sec execute 377 sec latency 0.246 ms 2026-02-17T21:07:44.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 625181 6.81 MB/sec execute 378 sec latency 5.886 ms 2026-02-17T21:07:44.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 82403640 898.45 MB/sec execute 378 sec latency 6.549 ms 2026-02-17T21:07:45.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:44 trial153 ceph-mon[25357]: pgmap v367: 129 pgs: 129 active+clean; 198 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 137 op/s 2026-02-17T21:07:45.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:44 trial104 ceph-mon[20612]: pgmap v367: 129 pgs: 129 active+clean; 198 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 137 op/s 2026-02-17T21:07:45.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 626174 6.80 MB/sec execute 379 sec latency 6.703 ms 2026-02-17T21:07:45.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 82569085 898.48 MB/sec execute 379 sec latency 0.592 ms 2026-02-17T21:07:46.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 627501 6.80 MB/sec execute 380 sec latency 7.195 ms 2026-02-17T21:07:46.759 INFO:tasks.workunit.client.0.trial104.stdout: 1 82735291 898.47 MB/sec execute 380 sec latency 0.243 ms 2026-02-17T21:07:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:46 trial153 ceph-mon[25357]: pgmap v368: 129 pgs: 129 active+clean; 200 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 145 op/s 2026-02-17T21:07:47.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:46 trial104 ceph-mon[20612]: pgmap v368: 129 pgs: 129 active+clean; 200 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 145 op/s 2026-02-17T21:07:47.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 628889 6.81 MB/sec execute 381 sec latency 5.601 ms 2026-02-17T21:07:47.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 82899784 898.44 MB/sec execute 381 sec latency 0.271 ms 2026-02-17T21:07:48.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 629904 6.80 MB/sec execute 382 sec latency 8.442 ms 2026-02-17T21:07:48.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 83062042 898.42 MB/sec execute 382 sec latency 1.043 ms 2026-02-17T21:07:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:48 trial153 ceph-mon[25357]: pgmap v369: 129 pgs: 129 active+clean; 200 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.8 MiB/s wr, 138 op/s 2026-02-17T21:07:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:07:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:48 trial104 ceph-mon[20612]: pgmap v369: 129 pgs: 129 active+clean; 200 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.8 MiB/s wr, 138 op/s 2026-02-17T21:07:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:07:49.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 631207 6.80 MB/sec execute 383 sec latency 7.631 ms 2026-02-17T21:07:49.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 83227565 898.40 MB/sec execute 383 sec latency 0.257 ms 2026-02-17T21:07:50.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 632533 6.81 MB/sec execute 384 sec latency 6.363 ms 2026-02-17T21:07:50.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 83393400 898.40 MB/sec execute 384 sec latency 3.443 ms 2026-02-17T21:07:51.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:50 trial153 ceph-mon[25357]: pgmap v370: 129 pgs: 129 active+clean; 203 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.7 MiB/s wr, 182 op/s 2026-02-17T21:07:51.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:50 trial104 ceph-mon[20612]: pgmap v370: 129 pgs: 129 active+clean; 203 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.7 MiB/s wr, 182 op/s 2026-02-17T21:07:51.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 633601 6.80 MB/sec execute 385 sec latency 8.195 ms 2026-02-17T21:07:51.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 83557798 898.41 MB/sec execute 385 sec latency 0.540 ms 2026-02-17T21:07:52.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 634924 6.80 MB/sec execute 386 sec latency 5.414 ms 2026-02-17T21:07:52.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 83724352 898.41 MB/sec execute 386 sec latency 0.319 ms 2026-02-17T21:07:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:52 trial153 ceph-mon[25357]: pgmap v371: 129 pgs: 129 active+clean; 203 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.6 MiB/s wr, 128 op/s 2026-02-17T21:07:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:52 trial104 ceph-mon[20612]: pgmap v371: 129 pgs: 129 active+clean; 203 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.6 MiB/s wr, 128 op/s 2026-02-17T21:07:53.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 636132 6.81 MB/sec execute 387 sec latency 5.148 ms 2026-02-17T21:07:53.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 83888083 898.41 MB/sec execute 387 sec latency 0.398 ms 2026-02-17T21:07:54.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 637287 6.80 MB/sec execute 388 sec latency 8.242 ms 2026-02-17T21:07:54.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 84051903 898.37 MB/sec execute 388 sec latency 6.826 ms 2026-02-17T21:07:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:54 trial153 ceph-mon[25357]: pgmap v372: 129 pgs: 129 active+clean; 203 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.8 MiB/s wr, 134 op/s 2026-02-17T21:07:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:07:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:07:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:54 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:07:55.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:54 trial104 ceph-mon[20612]: pgmap v372: 129 pgs: 129 active+clean; 203 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.8 MiB/s wr, 134 op/s 2026-02-17T21:07:55.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:07:55.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:07:55.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:54 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:07:55.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 638680 6.80 MB/sec execute 389 sec latency 5.613 ms 2026-02-17T21:07:55.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 84215180 898.32 MB/sec execute 389 sec latency 5.232 ms 2026-02-17T21:07:56.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:07:56.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:07:56.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:07:56.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:07:56.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:07:56.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:07:56.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 639718 6.80 MB/sec execute 390 sec latency 6.023 ms 2026-02-17T21:07:56.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 84380797 898.35 MB/sec execute 390 sec latency 0.270 ms 2026-02-17T21:07:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:56 trial153 ceph-mon[25357]: pgmap v373: 129 pgs: 129 active+clean; 206 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.5 MiB/s wr, 168 op/s 2026-02-17T21:07:57.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:56 trial104 ceph-mon[20612]: pgmap v373: 129 pgs: 129 active+clean; 206 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.5 MiB/s wr, 168 op/s 2026-02-17T21:07:57.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 640883 6.80 MB/sec execute 391 sec latency 7.445 ms 2026-02-17T21:07:57.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 84547126 898.34 MB/sec execute 391 sec latency 0.261 ms 2026-02-17T21:07:58.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 642267 6.80 MB/sec execute 392 sec latency 5.427 ms 2026-02-17T21:07:58.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 84713421 898.34 MB/sec execute 392 sec latency 0.302 ms 2026-02-17T21:07:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:07:58 trial153 ceph-mon[25357]: pgmap v374: 129 pgs: 129 active+clean; 206 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 140 op/s 2026-02-17T21:07:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:07:58 trial104 ceph-mon[20612]: pgmap v374: 129 pgs: 129 active+clean; 206 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 140 op/s 2026-02-17T21:07:59.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 643337 6.80 MB/sec execute 393 sec latency 7.269 ms 2026-02-17T21:07:59.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 84877270 898.35 MB/sec execute 393 sec latency 0.715 ms 2026-02-17T21:08:00.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 644570 6.80 MB/sec execute 394 sec latency 7.026 ms 2026-02-17T21:08:00.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 85042565 898.33 MB/sec execute 394 sec latency 0.250 ms 2026-02-17T21:08:01.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:00 trial153 ceph-mon[25357]: pgmap v375: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.6 MiB/s wr, 155 op/s 2026-02-17T21:08:01.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:00 trial104 ceph-mon[20612]: pgmap v375: 129 pgs: 129 active+clean; 207 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.6 MiB/s wr, 155 op/s 2026-02-17T21:08:01.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 646072 6.80 MB/sec execute 395 sec latency 5.404 ms 2026-02-17T21:08:01.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 85208166 898.32 MB/sec execute 395 sec latency 0.336 ms 2026-02-17T21:08:02.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 646969 6.80 MB/sec execute 396 sec latency 5.889 ms 2026-02-17T21:08:02.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 85373152 898.34 MB/sec execute 396 sec latency 0.933 ms 2026-02-17T21:08:03.208 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:02 trial104 ceph-mon[20612]: pgmap v376: 129 pgs: 129 active+clean; 210 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 133 op/s 2026-02-17T21:08:03.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:02 trial153 ceph-mon[25357]: pgmap v376: 129 pgs: 129 active+clean; 210 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 133 op/s 2026-02-17T21:08:03.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 648268 6.79 MB/sec execute 397 sec latency 9.703 ms 2026-02-17T21:08:03.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 85537170 898.31 MB/sec execute 397 sec latency 0.226 ms 2026-02-17T21:08:04.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:08:04.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:08:04.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 649679 6.80 MB/sec execute 398 sec latency 6.348 ms 2026-02-17T21:08:04.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 85701409 898.27 MB/sec execute 398 sec latency 4.824 ms 2026-02-17T21:08:05.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:04 trial153 ceph-mon[25357]: pgmap v377: 129 pgs: 129 active+clean; 210 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 143 op/s 2026-02-17T21:08:05.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:04 trial104 ceph-mon[20612]: pgmap v377: 129 pgs: 129 active+clean; 210 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 3.0 MiB/s wr, 143 op/s 2026-02-17T21:08:05.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 650763 6.79 MB/sec execute 399 sec latency 6.321 ms 2026-02-17T21:08:05.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 85865563 898.28 MB/sec execute 399 sec latency 5.692 ms 2026-02-17T21:08:06.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 652091 6.79 MB/sec execute 400 sec latency 5.750 ms 2026-02-17T21:08:06.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 86031729 898.27 MB/sec execute 400 sec latency 0.235 ms 2026-02-17T21:08:07.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:06 trial153 ceph-mon[25357]: pgmap v378: 129 pgs: 129 active+clean; 210 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 148 op/s 2026-02-17T21:08:07.350 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:06 trial104 ceph-mon[20612]: pgmap v378: 129 pgs: 129 active+clean; 210 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 148 op/s 2026-02-17T21:08:07.650 INFO:tasks.workunit.client.1.trial153.stdout: 1 653548 6.80 MB/sec execute 401 sec latency 5.889 ms 2026-02-17T21:08:07.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 86195912 898.28 MB/sec execute 401 sec latency 0.287 ms 2026-02-17T21:08:08.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 654539 6.79 MB/sec execute 402 sec latency 7.651 ms 2026-02-17T21:08:08.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 86363139 898.29 MB/sec execute 402 sec latency 0.487 ms 2026-02-17T21:08:09.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:08 trial153 ceph-mon[25357]: pgmap v379: 129 pgs: 129 active+clean; 210 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.6 MiB/s wr, 130 op/s 2026-02-17T21:08:09.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:08 trial104 ceph-mon[20612]: pgmap v379: 129 pgs: 129 active+clean; 210 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.6 MiB/s wr, 130 op/s 2026-02-17T21:08:09.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 655848 6.79 MB/sec execute 403 sec latency 5.614 ms 2026-02-17T21:08:09.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 86526147 898.24 MB/sec execute 403 sec latency 9.947 ms 2026-02-17T21:08:10.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 657237 6.80 MB/sec execute 404 sec latency 6.590 ms 2026-02-17T21:08:10.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 86690663 898.26 MB/sec execute 404 sec latency 7.692 ms 2026-02-17T21:08:11.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:10 trial153 ceph-mon[25357]: pgmap v380: 129 pgs: 129 active+clean; 192 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.5 MiB/s wr, 164 op/s 2026-02-17T21:08:11.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:10 trial104 ceph-mon[20612]: pgmap v380: 129 pgs: 129 active+clean; 192 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.5 MiB/s wr, 164 op/s 2026-02-17T21:08:11.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 658242 6.79 MB/sec execute 405 sec latency 8.060 ms 2026-02-17T21:08:11.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 86858433 898.27 MB/sec execute 405 sec latency 0.290 ms 2026-02-17T21:08:12.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 659541 6.79 MB/sec execute 406 sec latency 8.117 ms 2026-02-17T21:08:12.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 87026195 898.28 MB/sec execute 406 sec latency 0.235 ms 2026-02-17T21:08:13.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:12 trial153 ceph-mon[25357]: pgmap v381: 129 pgs: 129 active+clean; 192 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.6 MiB/s wr, 141 op/s 2026-02-17T21:08:13.327 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:12 trial104 ceph-mon[20612]: pgmap v381: 129 pgs: 129 active+clean; 192 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.6 MiB/s wr, 141 op/s 2026-02-17T21:08:13.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 660853 6.80 MB/sec execute 407 sec latency 5.808 ms 2026-02-17T21:08:13.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 87191267 898.31 MB/sec execute 407 sec latency 0.268 ms 2026-02-17T21:08:14.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 661988 6.80 MB/sec execute 408 sec latency 7.034 ms 2026-02-17T21:08:14.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 87358722 898.33 MB/sec execute 408 sec latency 0.227 ms 2026-02-17T21:08:15.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:14 trial153 ceph-mon[25357]: pgmap v382: 129 pgs: 129 active+clean; 192 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.6 MiB/s wr, 124 op/s 2026-02-17T21:08:15.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:14 trial104 ceph-mon[20612]: pgmap v382: 129 pgs: 129 active+clean; 192 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.6 MiB/s wr, 124 op/s 2026-02-17T21:08:15.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 663309 6.79 MB/sec execute 409 sec latency 5.435 ms 2026-02-17T21:08:15.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 87525611 898.33 MB/sec execute 409 sec latency 0.258 ms 2026-02-17T21:08:16.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 664496 6.80 MB/sec execute 410 sec latency 7.020 ms 2026-02-17T21:08:16.760 INFO:tasks.workunit.client.0.trial104.stdout: 1 87691512 898.35 MB/sec execute 410 sec latency 0.255 ms 2026-02-17T21:08:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:16 trial153 ceph-mon[25357]: pgmap v383: 129 pgs: 129 active+clean; 194 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 3.3 MiB/s wr, 158 op/s 2026-02-17T21:08:17.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:16 trial104 ceph-mon[20612]: pgmap v383: 129 pgs: 129 active+clean; 194 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 3.3 MiB/s wr, 158 op/s 2026-02-17T21:08:17.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 665688 6.79 MB/sec execute 411 sec latency 6.600 ms 2026-02-17T21:08:17.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 87857370 898.35 MB/sec execute 411 sec latency 0.295 ms 2026-02-17T21:08:18.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 667077 6.79 MB/sec execute 412 sec latency 6.927 ms 2026-02-17T21:08:18.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 88020822 898.34 MB/sec execute 412 sec latency 0.269 ms 2026-02-17T21:08:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:18 trial153 ceph-mon[25357]: pgmap v384: 129 pgs: 129 active+clean; 194 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.8 MiB/s wr, 149 op/s 2026-02-17T21:08:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:08:19.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:18 trial104 ceph-mon[20612]: pgmap v384: 129 pgs: 129 active+clean; 194 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.8 MiB/s wr, 149 op/s 2026-02-17T21:08:19.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:08:19.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 668099 6.79 MB/sec execute 413 sec latency 6.567 ms 2026-02-17T21:08:19.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 88188672 898.35 MB/sec execute 413 sec latency 0.233 ms 2026-02-17T21:08:20.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 669314 6.79 MB/sec execute 414 sec latency 6.678 ms 2026-02-17T21:08:20.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 88354872 898.35 MB/sec execute 414 sec latency 0.250 ms 2026-02-17T21:08:21.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:20 trial153 ceph-mon[25357]: pgmap v385: 129 pgs: 129 active+clean; 196 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.7 MiB/s wr, 174 op/s 2026-02-17T21:08:21.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:20 trial104 ceph-mon[20612]: pgmap v385: 129 pgs: 129 active+clean; 196 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.7 MiB/s wr, 174 op/s 2026-02-17T21:08:21.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 670891 6.80 MB/sec execute 415 sec latency 6.060 ms 2026-02-17T21:08:21.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 88518660 898.36 MB/sec execute 415 sec latency 4.552 ms 2026-02-17T21:08:22.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 671767 6.79 MB/sec execute 416 sec latency 5.286 ms 2026-02-17T21:08:22.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 88686087 898.36 MB/sec execute 416 sec latency 0.236 ms 2026-02-17T21:08:23.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:22 trial153 ceph-mon[25357]: pgmap v386: 129 pgs: 129 active+clean; 196 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.6 MiB/s wr, 125 op/s 2026-02-17T21:08:23.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:22 trial104 ceph-mon[20612]: pgmap v386: 129 pgs: 129 active+clean; 196 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.6 MiB/s wr, 125 op/s 2026-02-17T21:08:23.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 673032 6.79 MB/sec execute 417 sec latency 7.662 ms 2026-02-17T21:08:23.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 88852652 898.36 MB/sec execute 417 sec latency 0.265 ms 2026-02-17T21:08:24.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 674519 6.79 MB/sec execute 418 sec latency 5.408 ms 2026-02-17T21:08:24.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 89017435 898.38 MB/sec execute 418 sec latency 0.266 ms 2026-02-17T21:08:25.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:24 trial153 ceph-mon[25357]: pgmap v387: 129 pgs: 129 active+clean; 197 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-17T21:08:25.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:24 trial104 ceph-mon[20612]: pgmap v387: 129 pgs: 129 active+clean; 197 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-17T21:08:25.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 675450 6.79 MB/sec execute 419 sec latency 8.577 ms 2026-02-17T21:08:25.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 89179790 898.32 MB/sec execute 419 sec latency 10.085 ms 2026-02-17T21:08:26.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 676796 6.79 MB/sec execute 420 sec latency 6.585 ms 2026-02-17T21:08:26.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 89345330 898.31 MB/sec execute 420 sec latency 0.264 ms 2026-02-17T21:08:27.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:26 trial153 ceph-mon[25357]: pgmap v388: 129 pgs: 129 active+clean; 200 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.5 MiB/s wr, 162 op/s 2026-02-17T21:08:27.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:26 trial104 ceph-mon[20612]: pgmap v388: 129 pgs: 129 active+clean; 200 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.5 MiB/s wr, 162 op/s 2026-02-17T21:08:27.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 678154 6.79 MB/sec execute 421 sec latency 5.293 ms 2026-02-17T21:08:27.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 89508111 898.31 MB/sec execute 421 sec latency 0.282 ms 2026-02-17T21:08:28.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 679249 6.79 MB/sec execute 422 sec latency 6.067 ms 2026-02-17T21:08:28.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 89673039 898.29 MB/sec execute 422 sec latency 0.543 ms 2026-02-17T21:08:29.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:28 trial153 ceph-mon[25357]: pgmap v389: 129 pgs: 129 active+clean; 201 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.7 MiB/s wr, 124 op/s 2026-02-17T21:08:29.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:28 trial104 ceph-mon[20612]: pgmap v389: 129 pgs: 129 active+clean; 201 MiB data, 1.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.7 MiB/s wr, 124 op/s 2026-02-17T21:08:29.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 680597 6.78 MB/sec execute 423 sec latency 6.142 ms 2026-02-17T21:08:29.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 89835833 898.26 MB/sec execute 423 sec latency 6.368 ms 2026-02-17T21:08:30.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 681984 6.80 MB/sec execute 424 sec latency 9.128 ms 2026-02-17T21:08:30.653 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:30 trial104 ceph-mon[20612]: pgmap v390: 129 pgs: 129 active+clean; 202 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 3.6 MiB/s wr, 169 op/s 2026-02-17T21:08:30.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 90002152 898.28 MB/sec execute 424 sec latency 2.322 ms 2026-02-17T21:08:30.774 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:30 trial153 ceph-mon[25357]: pgmap v390: 129 pgs: 129 active+clean; 202 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 3.6 MiB/s wr, 169 op/s 2026-02-17T21:08:31.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 682981 6.79 MB/sec execute 425 sec latency 7.948 ms 2026-02-17T21:08:31.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 90167656 898.25 MB/sec execute 425 sec latency 0.275 ms 2026-02-17T21:08:32.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 684230 6.78 MB/sec execute 426 sec latency 6.994 ms 2026-02-17T21:08:32.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 90332569 898.28 MB/sec execute 426 sec latency 0.352 ms 2026-02-17T21:08:33.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:32 trial104 ceph-mon[20612]: pgmap v391: 129 pgs: 129 active+clean; 203 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 121 op/s 2026-02-17T21:08:33.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:32 trial153 ceph-mon[25357]: pgmap v391: 129 pgs: 129 active+clean; 203 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.6 MiB/s wr, 121 op/s 2026-02-17T21:08:33.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 685640 6.79 MB/sec execute 427 sec latency 6.061 ms 2026-02-17T21:08:33.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 90498798 898.27 MB/sec execute 427 sec latency 0.905 ms 2026-02-17T21:08:34.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:08:34.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:08:34.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 686650 6.78 MB/sec execute 428 sec latency 8.375 ms 2026-02-17T21:08:34.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 90666467 898.29 MB/sec execute 428 sec latency 0.260 ms 2026-02-17T21:08:35.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:34 trial104 ceph-mon[20612]: pgmap v392: 129 pgs: 129 active+clean; 202 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-17T21:08:35.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:34 trial153 ceph-mon[25357]: pgmap v392: 129 pgs: 129 active+clean; 202 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.2 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-17T21:08:35.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 687897 6.78 MB/sec execute 429 sec latency 6.439 ms 2026-02-17T21:08:35.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 90831528 898.30 MB/sec execute 429 sec latency 0.499 ms 2026-02-17T21:08:36.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 689267 6.79 MB/sec execute 430 sec latency 7.748 ms 2026-02-17T21:08:36.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 90997396 898.30 MB/sec execute 430 sec latency 9.562 ms 2026-02-17T21:08:37.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:36 trial104 ceph-mon[20612]: pgmap v393: 129 pgs: 129 active+clean; 205 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 3.4 MiB/s wr, 166 op/s 2026-02-17T21:08:37.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:36 trial153 ceph-mon[25357]: pgmap v393: 129 pgs: 129 active+clean; 205 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 3.4 MiB/s wr, 166 op/s 2026-02-17T21:08:37.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 690352 6.79 MB/sec execute 431 sec latency 8.408 ms 2026-02-17T21:08:37.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 91164825 898.30 MB/sec execute 431 sec latency 0.281 ms 2026-02-17T21:08:38.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 691553 6.78 MB/sec execute 432 sec latency 7.134 ms 2026-02-17T21:08:38.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 91329184 898.32 MB/sec execute 432 sec latency 0.488 ms 2026-02-17T21:08:38.903 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:38 trial104 ceph-mon[20612]: pgmap v394: 129 pgs: 129 active+clean; 203 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.7 MiB/s wr, 133 op/s 2026-02-17T21:08:39.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:38 trial153 ceph-mon[25357]: pgmap v394: 129 pgs: 129 active+clean; 203 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.1 KiB/s rd, 2.7 MiB/s wr, 133 op/s 2026-02-17T21:08:39.651 INFO:tasks.workunit.client.1.trial153.stdout: 1 692872 6.79 MB/sec execute 433 sec latency 6.917 ms 2026-02-17T21:08:39.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 91496516 898.32 MB/sec execute 433 sec latency 0.258 ms 2026-02-17T21:08:40.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 693983 6.79 MB/sec execute 434 sec latency 6.811 ms 2026-02-17T21:08:40.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 91663409 898.32 MB/sec execute 434 sec latency 0.248 ms 2026-02-17T21:08:41.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:40 trial104 ceph-mon[20612]: pgmap v395: 129 pgs: 129 active+clean; 205 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 3.7 MiB/s wr, 175 op/s 2026-02-17T21:08:41.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:40 trial153 ceph-mon[25357]: pgmap v395: 129 pgs: 129 active+clean; 205 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 3.7 MiB/s wr, 175 op/s 2026-02-17T21:08:41.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 695387 6.79 MB/sec execute 435 sec latency 5.127 ms 2026-02-17T21:08:41.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 91828150 898.34 MB/sec execute 435 sec latency 3.220 ms 2026-02-17T21:08:42.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 696478 6.79 MB/sec execute 436 sec latency 5.981 ms 2026-02-17T21:08:42.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 91995559 898.36 MB/sec execute 436 sec latency 0.336 ms 2026-02-17T21:08:43.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:42 trial104 ceph-mon[20612]: pgmap v396: 129 pgs: 129 active+clean; 205 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.6 MiB/s wr, 126 op/s 2026-02-17T21:08:43.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:42 trial153 ceph-mon[25357]: pgmap v396: 129 pgs: 129 active+clean; 205 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.6 MiB/s wr, 126 op/s 2026-02-17T21:08:43.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 697663 6.78 MB/sec execute 437 sec latency 7.490 ms 2026-02-17T21:08:43.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 92159775 898.36 MB/sec execute 437 sec latency 0.308 ms 2026-02-17T21:08:44.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 699213 6.79 MB/sec execute 438 sec latency 7.168 ms 2026-02-17T21:08:44.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 92326666 898.36 MB/sec execute 438 sec latency 0.315 ms 2026-02-17T21:08:45.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:44 trial104 ceph-mon[20612]: pgmap v397: 129 pgs: 129 active+clean; 206 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.8 MiB/s wr, 132 op/s 2026-02-17T21:08:45.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:44 trial153 ceph-mon[25357]: pgmap v397: 129 pgs: 129 active+clean; 206 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.8 MiB/s wr, 132 op/s 2026-02-17T21:08:45.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 700175 6.78 MB/sec execute 439 sec latency 6.528 ms 2026-02-17T21:08:45.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 92492264 898.35 MB/sec execute 439 sec latency 6.314 ms 2026-02-17T21:08:46.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 701459 6.78 MB/sec execute 440 sec latency 6.696 ms 2026-02-17T21:08:46.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 92657260 898.37 MB/sec execute 440 sec latency 0.272 ms 2026-02-17T21:08:47.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:46 trial104 ceph-mon[20612]: pgmap v398: 129 pgs: 129 active+clean; 209 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 165 op/s 2026-02-17T21:08:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:46 trial153 ceph-mon[25357]: pgmap v398: 129 pgs: 129 active+clean; 209 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 165 op/s 2026-02-17T21:08:47.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 702906 6.79 MB/sec execute 441 sec latency 6.625 ms 2026-02-17T21:08:47.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 92822965 898.36 MB/sec execute 441 sec latency 0.347 ms 2026-02-17T21:08:48.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 703945 6.78 MB/sec execute 442 sec latency 6.518 ms 2026-02-17T21:08:48.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 92989325 898.36 MB/sec execute 442 sec latency 0.850 ms 2026-02-17T21:08:49.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:48 trial104 ceph-mon[20612]: pgmap v399: 129 pgs: 129 active+clean; 209 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.6 MiB/s wr, 127 op/s 2026-02-17T21:08:49.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:08:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:48 trial153 ceph-mon[25357]: pgmap v399: 129 pgs: 129 active+clean; 209 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.6 MiB/s wr, 127 op/s 2026-02-17T21:08:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:08:49.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 705221 6.78 MB/sec execute 443 sec latency 6.955 ms 2026-02-17T21:08:49.761 INFO:tasks.workunit.client.0.trial104.stdout: 1 93154822 898.38 MB/sec execute 443 sec latency 0.426 ms 2026-02-17T21:08:50.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 706620 6.79 MB/sec execute 444 sec latency 6.653 ms 2026-02-17T21:08:50.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 93322084 898.39 MB/sec execute 444 sec latency 0.256 ms 2026-02-17T21:08:51.076 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:50 trial153 ceph-mon[25357]: pgmap v400: 129 pgs: 129 active+clean; 210 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.7 MiB/s wr, 172 op/s 2026-02-17T21:08:51.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:50 trial104 ceph-mon[20612]: pgmap v400: 129 pgs: 129 active+clean; 210 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.7 MiB/s wr, 172 op/s 2026-02-17T21:08:51.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 707652 6.78 MB/sec execute 445 sec latency 6.668 ms 2026-02-17T21:08:51.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 93488644 898.39 MB/sec execute 445 sec latency 0.273 ms 2026-02-17T21:08:52.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 709032 6.78 MB/sec execute 446 sec latency 6.461 ms 2026-02-17T21:08:52.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 93653232 898.40 MB/sec execute 446 sec latency 0.260 ms 2026-02-17T21:08:53.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:52 trial104 ceph-mon[20612]: pgmap v401: 129 pgs: 129 active+clean; 210 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.5 MiB/s wr, 125 op/s 2026-02-17T21:08:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:52 trial153 ceph-mon[25357]: pgmap v401: 129 pgs: 129 active+clean; 210 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.5 MiB/s wr, 125 op/s 2026-02-17T21:08:53.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 710452 6.79 MB/sec execute 447 sec latency 6.164 ms 2026-02-17T21:08:53.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 93820339 898.40 MB/sec execute 447 sec latency 0.477 ms 2026-02-17T21:08:54.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 711444 6.78 MB/sec execute 448 sec latency 7.073 ms 2026-02-17T21:08:54.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 93985611 898.43 MB/sec execute 448 sec latency 0.279 ms 2026-02-17T21:08:55.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:54 trial104 ceph-mon[20612]: pgmap v402: 129 pgs: 129 active+clean; 209 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 132 op/s 2026-02-17T21:08:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:54 trial153 ceph-mon[25357]: pgmap v402: 129 pgs: 129 active+clean; 209 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 132 op/s 2026-02-17T21:08:55.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 712714 6.78 MB/sec execute 449 sec latency 7.259 ms 2026-02-17T21:08:55.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 94144319 898.33 MB/sec execute 449 sec latency 0.690 ms 2026-02-17T21:08:55.948 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:55 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:08:56.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:55 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:08:56.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 714055 6.79 MB/sec execute 450 sec latency 7.876 ms 2026-02-17T21:08:56.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 94301035 898.22 MB/sec execute 450 sec latency 4.673 ms 2026-02-17T21:08:57.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: pgmap v403: 129 pgs: 129 active+clean; 211 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 169 op/s 2026-02-17T21:08:57.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:08:57.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:08:57.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-17T21:08:57.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-17T21:08:57.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-17T21:08:57.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-17T21:08:57.155 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:08:57.155 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:08:57.155 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:08:57.155 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T21:08:57.155 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T21:08:57.155 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-17T21:08:57.155 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-17T21:08:57.155 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:08:57.155 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:08:57.155 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:08:57.155 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:08:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: pgmap v403: 129 pgs: 129 active+clean; 211 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 169 op/s 2026-02-17T21:08:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:08:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:08:57.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2026-02-17T21:08:57.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2026-02-17T21:08:57.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2026-02-17T21:08:57.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2026-02-17T21:08:57.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:08:57.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:08:57.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:08:57.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2026-02-17T21:08:57.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2026-02-17T21:08:57.275 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2026-02-17T21:08:57.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2026-02-17T21:08:57.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:08:57.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:08:57.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:08:57.276 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:08:57.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 715051 6.78 MB/sec execute 451 sec latency 6.506 ms 2026-02-17T21:08:57.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 94465700 898.23 MB/sec execute 451 sec latency 1.294 ms 2026-02-17T21:08:58.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:57 trial104 ceph-mon[20612]: Adjusting osd_memory_target on trial153 to 18419M 2026-02-17T21:08:58.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:57 trial104 ceph-mon[20612]: Adjusting osd_memory_target on trial104 to 17651M 2026-02-17T21:08:58.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:57 trial153 ceph-mon[25357]: Adjusting osd_memory_target on trial153 to 18419M 2026-02-17T21:08:58.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:57 trial153 ceph-mon[25357]: Adjusting osd_memory_target on trial104 to 17651M 2026-02-17T21:08:58.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 716314 6.78 MB/sec execute 452 sec latency 8.353 ms 2026-02-17T21:08:58.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 94630654 898.20 MB/sec execute 452 sec latency 0.608 ms 2026-02-17T21:08:59.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:08:58 trial104 ceph-mon[20612]: pgmap v404: 129 pgs: 129 active+clean; 203 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.6 MiB/s wr, 131 op/s 2026-02-17T21:08:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:08:58 trial153 ceph-mon[25357]: pgmap v404: 129 pgs: 129 active+clean; 203 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.6 MiB/s wr, 131 op/s 2026-02-17T21:08:59.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 717637 6.78 MB/sec execute 453 sec latency 5.316 ms 2026-02-17T21:08:59.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 94797132 898.20 MB/sec execute 453 sec latency 0.240 ms 2026-02-17T21:09:00.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 718768 6.78 MB/sec execute 454 sec latency 7.240 ms 2026-02-17T21:09:00.653 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:00 trial104 ceph-mon[20612]: pgmap v405: 129 pgs: 129 active+clean; 189 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.6 MiB/s wr, 173 op/s 2026-02-17T21:09:00.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 94960483 898.21 MB/sec execute 454 sec latency 5.206 ms 2026-02-17T21:09:00.774 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:00 trial153 ceph-mon[25357]: pgmap v405: 129 pgs: 129 active+clean; 189 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 3.6 MiB/s wr, 173 op/s 2026-02-17T21:09:01.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 720232 6.78 MB/sec execute 455 sec latency 4.768 ms 2026-02-17T21:09:01.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 95126714 898.20 MB/sec execute 455 sec latency 2.761 ms 2026-02-17T21:09:02.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 721335 6.78 MB/sec execute 456 sec latency 5.723 ms 2026-02-17T21:09:02.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 95294094 898.21 MB/sec execute 456 sec latency 0.253 ms 2026-02-17T21:09:03.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:02 trial104 ceph-mon[20612]: pgmap v406: 129 pgs: 129 active+clean; 190 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.6 MiB/s wr, 123 op/s 2026-02-17T21:09:03.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:02 trial153 ceph-mon[25357]: pgmap v406: 129 pgs: 129 active+clean; 190 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.6 MiB/s wr, 123 op/s 2026-02-17T21:09:03.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 722600 6.78 MB/sec execute 457 sec latency 6.665 ms 2026-02-17T21:09:03.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 95458452 898.22 MB/sec execute 457 sec latency 0.278 ms 2026-02-17T21:09:04.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:09:04.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:09:04.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 724124 6.78 MB/sec execute 458 sec latency 5.755 ms 2026-02-17T21:09:04.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 95625303 898.22 MB/sec execute 458 sec latency 0.274 ms 2026-02-17T21:09:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:04 trial104 ceph-mon[20612]: pgmap v407: 129 pgs: 129 active+clean; 191 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 154 op/s 2026-02-17T21:09:05.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:04 trial153 ceph-mon[25357]: pgmap v407: 129 pgs: 129 active+clean; 191 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 3.0 MiB/s wr, 154 op/s 2026-02-17T21:09:05.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 725030 6.78 MB/sec execute 459 sec latency 6.018 ms 2026-02-17T21:09:05.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 95792891 898.24 MB/sec execute 459 sec latency 0.261 ms 2026-02-17T21:09:06.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 726299 6.78 MB/sec execute 460 sec latency 6.752 ms 2026-02-17T21:09:06.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 95957824 898.25 MB/sec execute 460 sec latency 0.282 ms 2026-02-17T21:09:07.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:06 trial104 ceph-mon[20612]: pgmap v408: 129 pgs: 129 active+clean; 193 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.5 MiB/s wr, 164 op/s 2026-02-17T21:09:07.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:06 trial153 ceph-mon[25357]: pgmap v408: 129 pgs: 129 active+clean; 193 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.5 MiB/s wr, 164 op/s 2026-02-17T21:09:07.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 727728 6.78 MB/sec execute 461 sec latency 5.296 ms 2026-02-17T21:09:07.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 96124277 898.25 MB/sec execute 461 sec latency 0.253 ms 2026-02-17T21:09:08.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 728771 6.78 MB/sec execute 462 sec latency 6.843 ms 2026-02-17T21:09:08.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 96289297 898.27 MB/sec execute 462 sec latency 0.276 ms 2026-02-17T21:09:09.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:08 trial104 ceph-mon[20612]: pgmap v409: 129 pgs: 129 active+clean; 193 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.6 MiB/s wr, 125 op/s 2026-02-17T21:09:09.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:08 trial153 ceph-mon[25357]: pgmap v409: 129 pgs: 129 active+clean; 193 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.6 MiB/s wr, 125 op/s 2026-02-17T21:09:09.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 730003 6.77 MB/sec execute 463 sec latency 7.273 ms 2026-02-17T21:09:09.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 96455216 898.26 MB/sec execute 463 sec latency 0.257 ms 2026-02-17T21:09:10.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 731310 6.78 MB/sec execute 464 sec latency 6.340 ms 2026-02-17T21:09:10.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 96620763 898.25 MB/sec execute 464 sec latency 0.254 ms 2026-02-17T21:09:11.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:10 trial104 ceph-mon[20612]: pgmap v410: 129 pgs: 129 active+clean; 195 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 3.6 MiB/s wr, 174 op/s 2026-02-17T21:09:11.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:10 trial153 ceph-mon[25357]: pgmap v410: 129 pgs: 129 active+clean; 195 MiB data, 1.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 3.6 MiB/s wr, 174 op/s 2026-02-17T21:09:11.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 732369 6.78 MB/sec execute 465 sec latency 8.277 ms 2026-02-17T21:09:11.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 96784264 898.25 MB/sec execute 465 sec latency 3.594 ms 2026-02-17T21:09:12.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 733672 6.77 MB/sec execute 466 sec latency 5.907 ms 2026-02-17T21:09:12.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 96949193 898.23 MB/sec execute 466 sec latency 2.701 ms 2026-02-17T21:09:13.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:12 trial104 ceph-mon[20612]: pgmap v411: 129 pgs: 129 active+clean; 195 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.6 MiB/s wr, 129 op/s 2026-02-17T21:09:13.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:12 trial153 ceph-mon[25357]: pgmap v411: 129 pgs: 129 active+clean; 195 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.6 MiB/s wr, 129 op/s 2026-02-17T21:09:13.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 735072 6.78 MB/sec execute 467 sec latency 7.105 ms 2026-02-17T21:09:13.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 97115545 898.23 MB/sec execute 467 sec latency 0.245 ms 2026-02-17T21:09:14.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 736105 6.78 MB/sec execute 468 sec latency 8.200 ms 2026-02-17T21:09:14.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 97279140 898.23 MB/sec execute 468 sec latency 0.284 ms 2026-02-17T21:09:15.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:14 trial104 ceph-mon[20612]: pgmap v412: 129 pgs: 129 active+clean; 195 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-17T21:09:15.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:14 trial153 ceph-mon[25357]: pgmap v412: 129 pgs: 129 active+clean; 195 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-17T21:09:15.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 737445 6.77 MB/sec execute 469 sec latency 6.006 ms 2026-02-17T21:09:15.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 97444504 898.21 MB/sec execute 469 sec latency 0.242 ms 2026-02-17T21:09:16.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 738833 6.78 MB/sec execute 470 sec latency 5.958 ms 2026-02-17T21:09:16.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 97607111 898.17 MB/sec execute 470 sec latency 13.052 ms 2026-02-17T21:09:17.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:16 trial104 ceph-mon[20612]: pgmap v413: 129 pgs: 129 active+clean; 197 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 3.3 MiB/s wr, 145 op/s 2026-02-17T21:09:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:16 trial153 ceph-mon[25357]: pgmap v413: 129 pgs: 129 active+clean; 197 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 3.3 MiB/s wr, 145 op/s 2026-02-17T21:09:17.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 739871 6.77 MB/sec execute 471 sec latency 8.243 ms 2026-02-17T21:09:17.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 97771098 898.17 MB/sec execute 471 sec latency 0.281 ms 2026-02-17T21:09:18.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 741087 6.77 MB/sec execute 472 sec latency 5.960 ms 2026-02-17T21:09:18.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 97937355 898.17 MB/sec execute 472 sec latency 0.261 ms 2026-02-17T21:09:19.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:18 trial104 ceph-mon[20612]: pgmap v414: 129 pgs: 129 active+clean; 197 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 134 op/s 2026-02-17T21:09:19.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:09:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:18 trial153 ceph-mon[25357]: pgmap v414: 129 pgs: 129 active+clean; 197 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.8 MiB/s wr, 134 op/s 2026-02-17T21:09:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:09:19.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 742447 6.78 MB/sec execute 473 sec latency 5.531 ms 2026-02-17T21:09:19.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 98101948 898.18 MB/sec execute 473 sec latency 0.294 ms 2026-02-17T21:09:20.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 743584 6.78 MB/sec execute 474 sec latency 6.421 ms 2026-02-17T21:09:20.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 98268928 898.18 MB/sec execute 474 sec latency 0.246 ms 2026-02-17T21:09:21.076 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:20 trial153 ceph-mon[25357]: pgmap v415: 129 pgs: 129 active+clean; 200 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.8 MiB/s wr, 178 op/s 2026-02-17T21:09:21.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:20 trial104 ceph-mon[20612]: pgmap v415: 129 pgs: 129 active+clean; 200 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.8 MiB/s wr, 178 op/s 2026-02-17T21:09:21.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 744888 6.78 MB/sec execute 475 sec latency 5.709 ms 2026-02-17T21:09:21.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 98434629 898.18 MB/sec execute 475 sec latency 3.330 ms 2026-02-17T21:09:22.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 746055 6.78 MB/sec execute 476 sec latency 7.570 ms 2026-02-17T21:09:22.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 98599456 898.19 MB/sec execute 476 sec latency 0.296 ms 2026-02-17T21:09:23.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:22 trial104 ceph-mon[20612]: pgmap v416: 129 pgs: 129 active+clean; 200 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.6 MiB/s wr, 123 op/s 2026-02-17T21:09:23.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:22 trial153 ceph-mon[25357]: pgmap v416: 129 pgs: 129 active+clean; 200 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.6 MiB/s wr, 123 op/s 2026-02-17T21:09:23.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 747173 6.78 MB/sec execute 477 sec latency 7.326 ms 2026-02-17T21:09:23.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 98764500 898.18 MB/sec execute 477 sec latency 0.878 ms 2026-02-17T21:09:24.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 748576 6.78 MB/sec execute 478 sec latency 5.158 ms 2026-02-17T21:09:24.762 INFO:tasks.workunit.client.0.trial104.stdout: 1 98929435 898.15 MB/sec execute 478 sec latency 0.717 ms 2026-02-17T21:09:25.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:24 trial104 ceph-mon[20612]: pgmap v417: 129 pgs: 129 active+clean; 199 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.9 MiB/s wr, 131 op/s 2026-02-17T21:09:25.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:24 trial153 ceph-mon[25357]: pgmap v417: 129 pgs: 129 active+clean; 199 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.9 MiB/s wr, 131 op/s 2026-02-17T21:09:25.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 749684 6.78 MB/sec execute 479 sec latency 5.100 ms 2026-02-17T21:09:25.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 99093498 898.16 MB/sec execute 479 sec latency 0.582 ms 2026-02-17T21:09:26.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 750923 6.77 MB/sec execute 480 sec latency 6.775 ms 2026-02-17T21:09:26.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 99258997 898.15 MB/sec execute 480 sec latency 0.249 ms 2026-02-17T21:09:27.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:26 trial104 ceph-mon[20612]: pgmap v418: 129 pgs: 129 active+clean; 201 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 166 op/s 2026-02-17T21:09:27.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:26 trial153 ceph-mon[25357]: pgmap v418: 129 pgs: 129 active+clean; 201 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.3 MiB/s wr, 166 op/s 2026-02-17T21:09:27.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 752502 6.78 MB/sec execute 481 sec latency 5.812 ms 2026-02-17T21:09:27.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 99424098 898.13 MB/sec execute 481 sec latency 6.521 ms 2026-02-17T21:09:28.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 753433 6.77 MB/sec execute 482 sec latency 6.591 ms 2026-02-17T21:09:28.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 99585435 898.11 MB/sec execute 482 sec latency 4.218 ms 2026-02-17T21:09:29.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:28 trial104 ceph-mon[20612]: pgmap v419: 129 pgs: 129 active+clean; 202 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.6 MiB/s wr, 129 op/s 2026-02-17T21:09:29.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:28 trial153 ceph-mon[25357]: pgmap v419: 129 pgs: 129 active+clean; 202 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.6 MiB/s wr, 129 op/s 2026-02-17T21:09:29.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 754772 6.77 MB/sec execute 483 sec latency 6.131 ms 2026-02-17T21:09:29.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 99750978 898.10 MB/sec execute 483 sec latency 0.595 ms 2026-02-17T21:09:30.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 756109 6.78 MB/sec execute 484 sec latency 18.209 ms 2026-02-17T21:09:30.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 99917064 898.09 MB/sec execute 484 sec latency 0.902 ms 2026-02-17T21:09:31.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:30 trial104 ceph-mon[20612]: pgmap v420: 129 pgs: 129 active+clean; 204 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.6 MiB/s wr, 173 op/s 2026-02-17T21:09:31.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:30 trial153 ceph-mon[25357]: pgmap v420: 129 pgs: 129 active+clean; 204 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.6 MiB/s wr, 173 op/s 2026-02-17T21:09:31.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 757185 6.77 MB/sec execute 485 sec latency 6.678 ms 2026-02-17T21:09:31.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 100079473 898.08 MB/sec execute 485 sec latency 3.469 ms 2026-02-17T21:09:32.652 INFO:tasks.workunit.client.1.trial153.stdout: 1 758479 6.77 MB/sec execute 486 sec latency 6.101 ms 2026-02-17T21:09:32.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 100246253 898.08 MB/sec execute 486 sec latency 0.243 ms 2026-02-17T21:09:33.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:32 trial104 ceph-mon[20612]: pgmap v421: 129 pgs: 129 active+clean; 203 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.5 MiB/s wr, 124 op/s 2026-02-17T21:09:33.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:32 trial153 ceph-mon[25357]: pgmap v421: 129 pgs: 129 active+clean; 203 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.5 MiB/s wr, 124 op/s 2026-02-17T21:09:33.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 759808 6.78 MB/sec execute 487 sec latency 6.176 ms 2026-02-17T21:09:33.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 100410300 898.09 MB/sec execute 487 sec latency 0.416 ms 2026-02-17T21:09:34.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:09:34.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:09:34.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 760804 6.77 MB/sec execute 488 sec latency 8.255 ms 2026-02-17T21:09:34.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 100573994 898.06 MB/sec execute 488 sec latency 0.291 ms 2026-02-17T21:09:35.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:34 trial104 ceph-mon[20612]: pgmap v422: 129 pgs: 129 active+clean; 204 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.8 MiB/s wr, 132 op/s 2026-02-17T21:09:35.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:34 trial153 ceph-mon[25357]: pgmap v422: 129 pgs: 129 active+clean; 204 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.8 MiB/s wr, 132 op/s 2026-02-17T21:09:35.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 762126 6.77 MB/sec execute 489 sec latency 6.501 ms 2026-02-17T21:09:35.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 100740686 898.06 MB/sec execute 489 sec latency 0.242 ms 2026-02-17T21:09:36.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 763539 6.78 MB/sec execute 490 sec latency 6.993 ms 2026-02-17T21:09:36.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 100906457 898.09 MB/sec execute 490 sec latency 0.268 ms 2026-02-17T21:09:37.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:36 trial104 ceph-mon[20612]: pgmap v423: 129 pgs: 129 active+clean; 205 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.4 MiB/s wr, 163 op/s 2026-02-17T21:09:37.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:36 trial153 ceph-mon[25357]: pgmap v423: 129 pgs: 129 active+clean; 205 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.4 MiB/s wr, 163 op/s 2026-02-17T21:09:37.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 764531 6.77 MB/sec execute 491 sec latency 7.025 ms 2026-02-17T21:09:37.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 101073372 898.09 MB/sec execute 491 sec latency 0.597 ms 2026-02-17T21:09:38.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 765805 6.77 MB/sec execute 492 sec latency 6.433 ms 2026-02-17T21:09:38.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 101239858 898.09 MB/sec execute 492 sec latency 0.425 ms 2026-02-17T21:09:39.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:38 trial104 ceph-mon[20612]: pgmap v424: 129 pgs: 129 active+clean; 205 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.7 MiB/s wr, 129 op/s 2026-02-17T21:09:39.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:38 trial153 ceph-mon[25357]: pgmap v424: 129 pgs: 129 active+clean; 205 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.7 MiB/s wr, 129 op/s 2026-02-17T21:09:39.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 767189 6.78 MB/sec execute 493 sec latency 7.441 ms 2026-02-17T21:09:39.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 101404529 898.10 MB/sec execute 493 sec latency 0.277 ms 2026-02-17T21:09:40.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 768207 6.77 MB/sec execute 494 sec latency 8.553 ms 2026-02-17T21:09:40.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 101573189 898.12 MB/sec execute 494 sec latency 0.254 ms 2026-02-17T21:09:41.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:40 trial104 ceph-mon[20612]: pgmap v425: 129 pgs: 129 active+clean; 206 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.6 MiB/s wr, 169 op/s 2026-02-17T21:09:41.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:40 trial153 ceph-mon[25357]: pgmap v425: 129 pgs: 129 active+clean; 206 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.6 MiB/s wr, 169 op/s 2026-02-17T21:09:41.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 769506 6.77 MB/sec execute 495 sec latency 7.178 ms 2026-02-17T21:09:41.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 101739321 898.12 MB/sec execute 495 sec latency 0.259 ms 2026-02-17T21:09:42.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 770857 6.78 MB/sec execute 496 sec latency 5.884 ms 2026-02-17T21:09:42.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 101903718 898.13 MB/sec execute 496 sec latency 3.070 ms 2026-02-17T21:09:43.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:42 trial104 ceph-mon[20612]: pgmap v426: 129 pgs: 129 active+clean; 207 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.6 MiB/s wr, 119 op/s 2026-02-17T21:09:43.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:42 trial153 ceph-mon[25357]: pgmap v426: 129 pgs: 129 active+clean; 207 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.6 MiB/s wr, 119 op/s 2026-02-17T21:09:43.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 772007 6.77 MB/sec execute 497 sec latency 6.141 ms 2026-02-17T21:09:43.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 102068488 898.11 MB/sec execute 497 sec latency 12.209 ms 2026-02-17T21:09:44.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 773428 6.77 MB/sec execute 498 sec latency 6.787 ms 2026-02-17T21:09:44.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 102231492 898.10 MB/sec execute 498 sec latency 0.276 ms 2026-02-17T21:09:45.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:44 trial104 ceph-mon[20612]: pgmap v427: 129 pgs: 129 active+clean; 209 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.0 MiB/s wr, 156 op/s 2026-02-17T21:09:45.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:44 trial153 ceph-mon[25357]: pgmap v427: 129 pgs: 129 active+clean; 209 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 3.0 MiB/s wr, 156 op/s 2026-02-17T21:09:45.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 774520 6.77 MB/sec execute 499 sec latency 6.332 ms 2026-02-17T21:09:45.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 102396786 898.09 MB/sec execute 499 sec latency 0.256 ms 2026-02-17T21:09:46.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 775755 6.77 MB/sec execute 500 sec latency 7.058 ms 2026-02-17T21:09:46.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 102562288 898.08 MB/sec execute 500 sec latency 0.236 ms 2026-02-17T21:09:47.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:46 trial104 ceph-mon[20612]: pgmap v428: 129 pgs: 129 active+clean; 199 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.4 MiB/s wr, 163 op/s 2026-02-17T21:09:47.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:46 trial153 ceph-mon[25357]: pgmap v428: 129 pgs: 129 active+clean; 199 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.4 MiB/s wr, 163 op/s 2026-02-17T21:09:47.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 777315 6.77 MB/sec execute 501 sec latency 5.493 ms 2026-02-17T21:09:47.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 102723761 898.06 MB/sec execute 501 sec latency 10.239 ms 2026-02-17T21:09:48.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 778151 6.77 MB/sec execute 502 sec latency 8.324 ms 2026-02-17T21:09:48.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 102889595 898.05 MB/sec execute 502 sec latency 0.265 ms 2026-02-17T21:09:49.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:48 trial104 ceph-mon[20612]: pgmap v429: 129 pgs: 129 active+clean; 190 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.6 MiB/s wr, 127 op/s 2026-02-17T21:09:49.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:09:49.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:48 trial153 ceph-mon[25357]: pgmap v429: 129 pgs: 129 active+clean; 190 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.6 KiB/s rd, 2.6 MiB/s wr, 127 op/s 2026-02-17T21:09:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:09:49.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 779366 6.77 MB/sec execute 503 sec latency 6.757 ms 2026-02-17T21:09:49.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 103054586 898.03 MB/sec execute 503 sec latency 0.346 ms 2026-02-17T21:09:50.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 780785 6.77 MB/sec execute 504 sec latency 6.435 ms 2026-02-17T21:09:50.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 103217534 898.03 MB/sec execute 504 sec latency 0.359 ms 2026-02-17T21:09:51.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:50 trial104 ceph-mon[20612]: pgmap v430: 129 pgs: 129 active+clean; 188 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.7 MiB/s wr, 175 op/s 2026-02-17T21:09:51.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:50 trial153 ceph-mon[25357]: pgmap v430: 129 pgs: 129 active+clean; 188 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.7 MiB/s wr, 175 op/s 2026-02-17T21:09:51.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 781723 6.77 MB/sec execute 505 sec latency 7.845 ms 2026-02-17T21:09:51.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 103383399 898.02 MB/sec execute 505 sec latency 0.415 ms 2026-02-17T21:09:52.653 INFO:tasks.workunit.client.1.trial153.stdout: 1 782988 6.77 MB/sec execute 506 sec latency 6.223 ms 2026-02-17T21:09:52.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 103547289 897.99 MB/sec execute 506 sec latency 0.289 ms 2026-02-17T21:09:53.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:52 trial104 ceph-mon[20612]: pgmap v431: 129 pgs: 129 active+clean; 189 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.7 MiB/s wr, 130 op/s 2026-02-17T21:09:53.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:52 trial153 ceph-mon[25357]: pgmap v431: 129 pgs: 129 active+clean; 189 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.7 MiB/s wr, 130 op/s 2026-02-17T21:09:53.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 784448 6.77 MB/sec execute 507 sec latency 5.893 ms 2026-02-17T21:09:53.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 103710959 897.99 MB/sec execute 507 sec latency 0.276 ms 2026-02-17T21:09:54.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 785376 6.77 MB/sec execute 508 sec latency 6.018 ms 2026-02-17T21:09:54.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 103876694 897.99 MB/sec execute 508 sec latency 0.275 ms 2026-02-17T21:09:55.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:54 trial104 ceph-mon[20612]: pgmap v432: 129 pgs: 129 active+clean; 190 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 137 op/s 2026-02-17T21:09:55.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:54 trial153 ceph-mon[25357]: pgmap v432: 129 pgs: 129 active+clean; 190 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 137 op/s 2026-02-17T21:09:55.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 786696 6.76 MB/sec execute 509 sec latency 6.689 ms 2026-02-17T21:09:55.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 104043170 897.98 MB/sec execute 509 sec latency 0.286 ms 2026-02-17T21:09:56.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 788056 6.77 MB/sec execute 510 sec latency 6.216 ms 2026-02-17T21:09:56.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 104204600 897.96 MB/sec execute 510 sec latency 0.556 ms 2026-02-17T21:09:57.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:56 trial104 ceph-mon[20612]: pgmap v433: 129 pgs: 129 active+clean; 191 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 3.3 MiB/s wr, 141 op/s 2026-02-17T21:09:57.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:09:57.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:09:57.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:09:57.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:09:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:56 trial153 ceph-mon[25357]: pgmap v433: 129 pgs: 129 active+clean; 191 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 3.3 MiB/s wr, 141 op/s 2026-02-17T21:09:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:09:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:09:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:09:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:09:57.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 789168 6.76 MB/sec execute 511 sec latency 6.356 ms 2026-02-17T21:09:57.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 104370218 897.95 MB/sec execute 511 sec latency 0.245 ms 2026-02-17T21:09:58.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 790524 6.76 MB/sec execute 512 sec latency 6.659 ms 2026-02-17T21:09:58.763 INFO:tasks.workunit.client.0.trial104.stdout: 1 104534172 897.96 MB/sec execute 512 sec latency 5.303 ms 2026-02-17T21:09:59.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:09:58 trial104 ceph-mon[20612]: pgmap v434: 129 pgs: 129 active+clean; 191 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 132 op/s 2026-02-17T21:09:59.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:09:58 trial153 ceph-mon[25357]: pgmap v434: 129 pgs: 129 active+clean; 191 MiB data, 2.0 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 132 op/s 2026-02-17T21:09:59.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 791895 6.77 MB/sec execute 513 sec latency 6.639 ms 2026-02-17T21:09:59.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 104699303 897.94 MB/sec execute 513 sec latency 0.273 ms 2026-02-17T21:10:00.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 792937 6.77 MB/sec execute 514 sec latency 7.841 ms 2026-02-17T21:10:00.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 104866030 897.94 MB/sec execute 514 sec latency 0.260 ms 2026-02-17T21:10:01.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:00 trial104 ceph-mon[20612]: pgmap v435: 129 pgs: 129 active+clean; 193 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 177 op/s 2026-02-17T21:10:01.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:00 trial104 ceph-mon[20612]: overall HEALTH_OK 2026-02-17T21:10:01.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:00 trial153 ceph-mon[25357]: pgmap v435: 129 pgs: 129 active+clean; 193 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 177 op/s 2026-02-17T21:10:01.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:00 trial153 ceph-mon[25357]: overall HEALTH_OK 2026-02-17T21:10:01.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 794205 6.76 MB/sec execute 515 sec latency 6.743 ms 2026-02-17T21:10:01.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 105030616 897.95 MB/sec execute 515 sec latency 0.304 ms 2026-02-17T21:10:02.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 795604 6.77 MB/sec execute 516 sec latency 5.985 ms 2026-02-17T21:10:02.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 105193260 897.92 MB/sec execute 516 sec latency 12.580 ms 2026-02-17T21:10:03.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:02 trial104 ceph-mon[20612]: pgmap v436: 129 pgs: 129 active+clean; 193 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.5 MiB/s wr, 123 op/s 2026-02-17T21:10:03.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:02 trial153 ceph-mon[25357]: pgmap v436: 129 pgs: 129 active+clean; 193 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.5 MiB/s wr, 123 op/s 2026-02-17T21:10:03.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 796717 6.77 MB/sec execute 517 sec latency 7.257 ms 2026-02-17T21:10:03.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 105360475 897.92 MB/sec execute 517 sec latency 0.240 ms 2026-02-17T21:10:04.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:10:04.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:10:04.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 797921 6.76 MB/sec execute 518 sec latency 6.825 ms 2026-02-17T21:10:04.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 105520959 897.89 MB/sec execute 518 sec latency 15.420 ms 2026-02-17T21:10:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:04 trial104 ceph-mon[20612]: pgmap v437: 129 pgs: 129 active+clean; 192 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-17T21:10:05.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:04 trial153 ceph-mon[25357]: pgmap v437: 129 pgs: 129 active+clean; 192 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-17T21:10:05.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 799254 6.77 MB/sec execute 519 sec latency 6.594 ms 2026-02-17T21:10:05.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 105689004 897.91 MB/sec execute 519 sec latency 0.235 ms 2026-02-17T21:10:06.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 800392 6.77 MB/sec execute 520 sec latency 7.275 ms 2026-02-17T21:10:06.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 105856530 897.92 MB/sec execute 520 sec latency 0.258 ms 2026-02-17T21:10:07.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:06 trial104 ceph-mon[20612]: pgmap v438: 129 pgs: 129 active+clean; 194 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.3 MiB/s wr, 165 op/s 2026-02-17T21:10:07.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:06 trial153 ceph-mon[25357]: pgmap v438: 129 pgs: 129 active+clean; 194 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.3 MiB/s wr, 165 op/s 2026-02-17T21:10:07.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 801789 6.77 MB/sec execute 521 sec latency 6.899 ms 2026-02-17T21:10:07.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 106021807 897.93 MB/sec execute 521 sec latency 0.738 ms 2026-02-17T21:10:08.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 802890 6.77 MB/sec execute 522 sec latency 6.776 ms 2026-02-17T21:10:08.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 106188539 897.94 MB/sec execute 522 sec latency 0.227 ms 2026-02-17T21:10:09.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:08 trial104 ceph-mon[20612]: pgmap v439: 129 pgs: 129 active+clean; 194 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.6 MiB/s wr, 131 op/s 2026-02-17T21:10:09.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:08 trial153 ceph-mon[25357]: pgmap v439: 129 pgs: 129 active+clean; 194 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.6 MiB/s wr, 131 op/s 2026-02-17T21:10:09.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 804118 6.76 MB/sec execute 523 sec latency 6.304 ms 2026-02-17T21:10:09.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 106352686 897.95 MB/sec execute 523 sec latency 3.310 ms 2026-02-17T21:10:10.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 805688 6.77 MB/sec execute 524 sec latency 7.521 ms 2026-02-17T21:10:10.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 106517710 897.93 MB/sec execute 524 sec latency 0.545 ms 2026-02-17T21:10:11.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:10 trial104 ceph-mon[20612]: pgmap v440: 129 pgs: 129 active+clean; 198 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 3.6 MiB/s wr, 176 op/s 2026-02-17T21:10:11.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:10 trial153 ceph-mon[25357]: pgmap v440: 129 pgs: 129 active+clean; 198 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.1 KiB/s rd, 3.6 MiB/s wr, 176 op/s 2026-02-17T21:10:11.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 806619 6.77 MB/sec execute 525 sec latency 6.436 ms 2026-02-17T21:10:11.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 106685250 897.94 MB/sec execute 525 sec latency 0.226 ms 2026-02-17T21:10:12.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 807969 6.76 MB/sec execute 526 sec latency 6.262 ms 2026-02-17T21:10:12.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 106849119 897.95 MB/sec execute 526 sec latency 0.772 ms 2026-02-17T21:10:13.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:12 trial104 ceph-mon[20612]: pgmap v441: 129 pgs: 129 active+clean; 198 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.6 MiB/s wr, 127 op/s 2026-02-17T21:10:13.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:12 trial153 ceph-mon[25357]: pgmap v441: 129 pgs: 129 active+clean; 198 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.6 MiB/s wr, 127 op/s 2026-02-17T21:10:13.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 809344 6.77 MB/sec execute 527 sec latency 6.855 ms 2026-02-17T21:10:13.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 107014607 897.94 MB/sec execute 527 sec latency 4.929 ms 2026-02-17T21:10:14.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 810388 6.76 MB/sec execute 528 sec latency 7.277 ms 2026-02-17T21:10:14.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 107178906 897.91 MB/sec execute 528 sec latency 0.248 ms 2026-02-17T21:10:15.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:14 trial104 ceph-mon[20612]: pgmap v442: 129 pgs: 129 active+clean; 198 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-17T21:10:15.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:14 trial153 ceph-mon[25357]: pgmap v442: 129 pgs: 129 active+clean; 198 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.9 MiB/s wr, 134 op/s 2026-02-17T21:10:15.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 811673 6.76 MB/sec execute 529 sec latency 6.647 ms 2026-02-17T21:10:15.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 107342784 897.92 MB/sec execute 529 sec latency 0.495 ms 2026-02-17T21:10:16.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 813079 6.77 MB/sec execute 530 sec latency 6.374 ms 2026-02-17T21:10:16.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 107509023 897.91 MB/sec execute 530 sec latency 0.245 ms 2026-02-17T21:10:17.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:16 trial104 ceph-mon[20612]: pgmap v443: 129 pgs: 129 active+clean; 200 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.5 MiB/s wr, 166 op/s 2026-02-17T21:10:17.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:16 trial153 ceph-mon[25357]: pgmap v443: 129 pgs: 129 active+clean; 200 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.5 MiB/s wr, 166 op/s 2026-02-17T21:10:17.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 814090 6.76 MB/sec execute 531 sec latency 7.180 ms 2026-02-17T21:10:17.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 107673998 897.90 MB/sec execute 531 sec latency 1.073 ms 2026-02-17T21:10:18.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 815409 6.76 MB/sec execute 532 sec latency 7.134 ms 2026-02-17T21:10:18.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 107835112 897.88 MB/sec execute 532 sec latency 19.638 ms 2026-02-17T21:10:19.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:18 trial104 ceph-mon[20612]: pgmap v444: 129 pgs: 129 active+clean; 199 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.9 MiB/s wr, 131 op/s 2026-02-17T21:10:19.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:10:19.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:18 trial153 ceph-mon[25357]: pgmap v444: 129 pgs: 129 active+clean; 199 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.9 MiB/s wr, 131 op/s 2026-02-17T21:10:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:10:19.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 816825 6.77 MB/sec execute 533 sec latency 5.233 ms 2026-02-17T21:10:19.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 108000583 897.86 MB/sec execute 533 sec latency 0.270 ms 2026-02-17T21:10:20.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 817852 6.76 MB/sec execute 534 sec latency 7.685 ms 2026-02-17T21:10:20.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 108167296 897.86 MB/sec execute 534 sec latency 0.247 ms 2026-02-17T21:10:21.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:20 trial104 ceph-mon[20612]: pgmap v445: 129 pgs: 129 active+clean; 201 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.7 MiB/s wr, 172 op/s 2026-02-17T21:10:21.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:20 trial153 ceph-mon[25357]: pgmap v445: 129 pgs: 129 active+clean; 201 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.7 MiB/s wr, 172 op/s 2026-02-17T21:10:21.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 819208 6.76 MB/sec execute 535 sec latency 5.504 ms 2026-02-17T21:10:21.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 108331375 897.87 MB/sec execute 535 sec latency 0.297 ms 2026-02-17T21:10:22.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 820541 6.77 MB/sec execute 536 sec latency 6.099 ms 2026-02-17T21:10:22.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 108496322 897.86 MB/sec execute 536 sec latency 0.253 ms 2026-02-17T21:10:23.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:22 trial104 ceph-mon[20612]: pgmap v446: 129 pgs: 129 active+clean; 202 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.6 MiB/s wr, 122 op/s 2026-02-17T21:10:23.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:22 trial153 ceph-mon[25357]: pgmap v446: 129 pgs: 129 active+clean; 202 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.6 MiB/s wr, 122 op/s 2026-02-17T21:10:23.654 INFO:tasks.workunit.client.1.trial153.stdout: 1 821705 6.77 MB/sec execute 537 sec latency 7.992 ms 2026-02-17T21:10:23.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 108660592 897.87 MB/sec execute 537 sec latency 0.270 ms 2026-02-17T21:10:24.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 823128 6.77 MB/sec execute 538 sec latency 5.053 ms 2026-02-17T21:10:24.764 INFO:tasks.workunit.client.0.trial104.stdout: 1 108827156 897.87 MB/sec execute 538 sec latency 1.305 ms 2026-02-17T21:10:25.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:24 trial104 ceph-mon[20612]: pgmap v447: 129 pgs: 129 active+clean; 201 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.8 MiB/s wr, 130 op/s 2026-02-17T21:10:25.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:24 trial153 ceph-mon[25357]: pgmap v447: 129 pgs: 129 active+clean; 201 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.8 MiB/s wr, 130 op/s 2026-02-17T21:10:25.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 824218 6.77 MB/sec execute 539 sec latency 5.545 ms 2026-02-17T21:10:25.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 108994118 897.87 MB/sec execute 539 sec latency 0.255 ms 2026-02-17T21:10:26.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 825520 6.76 MB/sec execute 540 sec latency 6.469 ms 2026-02-17T21:10:26.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 109158454 897.88 MB/sec execute 540 sec latency 0.285 ms 2026-02-17T21:10:27.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:26 trial104 ceph-mon[20612]: pgmap v448: 129 pgs: 129 active+clean; 207 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.6 MiB/s wr, 169 op/s 2026-02-17T21:10:27.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:26 trial153 ceph-mon[25357]: pgmap v448: 129 pgs: 129 active+clean; 207 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.6 MiB/s wr, 169 op/s 2026-02-17T21:10:27.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 826992 6.77 MB/sec execute 541 sec latency 5.391 ms 2026-02-17T21:10:27.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 109324452 897.87 MB/sec execute 541 sec latency 0.281 ms 2026-02-17T21:10:28.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 828017 6.77 MB/sec execute 542 sec latency 8.518 ms 2026-02-17T21:10:28.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 109489190 897.85 MB/sec execute 542 sec latency 3.962 ms 2026-02-17T21:10:29.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:28 trial104 ceph-mon[20612]: pgmap v449: 129 pgs: 129 active+clean; 206 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.8 MiB/s wr, 134 op/s 2026-02-17T21:10:29.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:28 trial153 ceph-mon[25357]: pgmap v449: 129 pgs: 129 active+clean; 206 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.8 MiB/s wr, 134 op/s 2026-02-17T21:10:29.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 829339 6.76 MB/sec execute 543 sec latency 6.266 ms 2026-02-17T21:10:29.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 109654454 897.88 MB/sec execute 543 sec latency 0.259 ms 2026-02-17T21:10:30.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 830772 6.77 MB/sec execute 544 sec latency 6.292 ms 2026-02-17T21:10:30.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 109819745 897.86 MB/sec execute 544 sec latency 0.246 ms 2026-02-17T21:10:31.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:30 trial104 ceph-mon[20612]: pgmap v450: 129 pgs: 129 active+clean; 206 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.7 MiB/s wr, 177 op/s 2026-02-17T21:10:31.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:30 trial153 ceph-mon[25357]: pgmap v450: 129 pgs: 129 active+clean; 206 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.7 MiB/s wr, 177 op/s 2026-02-17T21:10:31.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 831755 6.76 MB/sec execute 545 sec latency 5.894 ms 2026-02-17T21:10:31.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 109986991 897.87 MB/sec execute 545 sec latency 0.255 ms 2026-02-17T21:10:32.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 833112 6.76 MB/sec execute 546 sec latency 7.146 ms 2026-02-17T21:10:32.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 110150787 897.87 MB/sec execute 546 sec latency 0.476 ms 2026-02-17T21:10:33.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:32 trial104 ceph-mon[20612]: pgmap v451: 129 pgs: 129 active+clean; 206 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 132 op/s 2026-02-17T21:10:33.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:32 trial153 ceph-mon[25357]: pgmap v451: 129 pgs: 129 active+clean; 206 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 132 op/s 2026-02-17T21:10:33.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 834529 6.77 MB/sec execute 547 sec latency 5.807 ms 2026-02-17T21:10:33.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 110313237 897.83 MB/sec execute 547 sec latency 21.310 ms 2026-02-17T21:10:34.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:10:34.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:10:34.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 835486 6.76 MB/sec execute 548 sec latency 6.502 ms 2026-02-17T21:10:34.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 110478327 897.85 MB/sec execute 548 sec latency 0.334 ms 2026-02-17T21:10:35.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:34 trial104 ceph-mon[20612]: pgmap v452: 129 pgs: 129 active+clean; 207 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 138 op/s 2026-02-17T21:10:35.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:34 trial153 ceph-mon[25357]: pgmap v452: 129 pgs: 129 active+clean; 207 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.9 MiB/s wr, 138 op/s 2026-02-17T21:10:35.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 836805 6.76 MB/sec execute 549 sec latency 8.591 ms 2026-02-17T21:10:35.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 110645143 897.85 MB/sec execute 549 sec latency 0.243 ms 2026-02-17T21:10:36.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 838175 6.77 MB/sec execute 550 sec latency 32.494 ms 2026-02-17T21:10:36.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 110812392 897.86 MB/sec execute 550 sec latency 0.255 ms 2026-02-17T21:10:37.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:36 trial104 ceph-mon[20612]: pgmap v453: 129 pgs: 129 active+clean; 201 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.5 MiB/s wr, 175 op/s 2026-02-17T21:10:37.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:36 trial153 ceph-mon[25357]: pgmap v453: 129 pgs: 129 active+clean; 201 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.5 MiB/s wr, 175 op/s 2026-02-17T21:10:37.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 839197 6.76 MB/sec execute 551 sec latency 6.284 ms 2026-02-17T21:10:37.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 110976271 897.87 MB/sec execute 551 sec latency 0.847 ms 2026-02-17T21:10:38.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 840401 6.76 MB/sec execute 552 sec latency 6.309 ms 2026-02-17T21:10:38.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 111143494 897.87 MB/sec execute 552 sec latency 0.235 ms 2026-02-17T21:10:39.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:38 trial104 ceph-mon[20612]: pgmap v454: 129 pgs: 129 active+clean; 188 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.6 MiB/s wr, 134 op/s 2026-02-17T21:10:39.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:38 trial153 ceph-mon[25357]: pgmap v454: 129 pgs: 129 active+clean; 188 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.6 MiB/s wr, 134 op/s 2026-02-17T21:10:39.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 841751 6.77 MB/sec execute 553 sec latency 5.735 ms 2026-02-17T21:10:39.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 111308916 897.86 MB/sec execute 553 sec latency 0.369 ms 2026-02-17T21:10:40.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 842840 6.77 MB/sec execute 554 sec latency 8.039 ms 2026-02-17T21:10:40.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 111470556 897.84 MB/sec execute 554 sec latency 5.413 ms 2026-02-17T21:10:41.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:40 trial104 ceph-mon[20612]: pgmap v455: 129 pgs: 129 active+clean; 191 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.7 MiB/s wr, 176 op/s 2026-02-17T21:10:41.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:40 trial153 ceph-mon[25357]: pgmap v455: 129 pgs: 129 active+clean; 191 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 3.7 MiB/s wr, 176 op/s 2026-02-17T21:10:41.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 844087 6.76 MB/sec execute 555 sec latency 5.845 ms 2026-02-17T21:10:41.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 111636198 897.83 MB/sec execute 555 sec latency 0.255 ms 2026-02-17T21:10:42.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 845381 6.77 MB/sec execute 556 sec latency 5.533 ms 2026-02-17T21:10:42.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 111801383 897.82 MB/sec execute 556 sec latency 0.250 ms 2026-02-17T21:10:43.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:42 trial104 ceph-mon[20612]: pgmap v456: 129 pgs: 129 active+clean; 192 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.7 MiB/s wr, 125 op/s 2026-02-17T21:10:43.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:42 trial153 ceph-mon[25357]: pgmap v456: 129 pgs: 129 active+clean; 192 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.7 MiB/s wr, 125 op/s 2026-02-17T21:10:43.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 846492 6.76 MB/sec execute 557 sec latency 7.049 ms 2026-02-17T21:10:43.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 111964553 897.82 MB/sec execute 557 sec latency 0.274 ms 2026-02-17T21:10:44.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 847915 6.76 MB/sec execute 558 sec latency 5.892 ms 2026-02-17T21:10:44.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 112129927 897.81 MB/sec execute 558 sec latency 4.251 ms 2026-02-17T21:10:45.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:44 trial104 ceph-mon[20612]: pgmap v457: 129 pgs: 129 active+clean; 191 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-17T21:10:45.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:44 trial153 ceph-mon[25357]: pgmap v457: 129 pgs: 129 active+clean; 191 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-17T21:10:45.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 849020 6.76 MB/sec execute 559 sec latency 5.334 ms 2026-02-17T21:10:45.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 112294345 897.79 MB/sec execute 559 sec latency 0.257 ms 2026-02-17T21:10:46.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 850183 6.76 MB/sec execute 560 sec latency 6.936 ms 2026-02-17T21:10:46.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 112458873 897.80 MB/sec execute 560 sec latency 0.422 ms 2026-02-17T21:10:47.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:46 trial153 ceph-mon[25357]: pgmap v458: 129 pgs: 129 active+clean; 194 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 165 op/s 2026-02-17T21:10:47.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:46 trial104 ceph-mon[20612]: pgmap v458: 129 pgs: 129 active+clean; 194 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 3.4 MiB/s wr, 165 op/s 2026-02-17T21:10:47.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 851555 6.76 MB/sec execute 561 sec latency 5.615 ms 2026-02-17T21:10:47.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 112625594 897.80 MB/sec execute 561 sec latency 0.248 ms 2026-02-17T21:10:48.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 852633 6.76 MB/sec execute 562 sec latency 7.074 ms 2026-02-17T21:10:48.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 112789432 897.80 MB/sec execute 562 sec latency 7.667 ms 2026-02-17T21:10:49.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:48 trial153 ceph-mon[25357]: pgmap v459: 129 pgs: 129 active+clean; 194 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 123 op/s 2026-02-17T21:10:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:10:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:48 trial104 ceph-mon[20612]: pgmap v459: 129 pgs: 129 active+clean; 194 MiB data, 2.1 GiB used, 5.5 TiB / 5.5 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 123 op/s 2026-02-17T21:10:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:10:49.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 853951 6.76 MB/sec execute 563 sec latency 7.059 ms 2026-02-17T21:10:49.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 112955854 897.80 MB/sec execute 563 sec latency 0.422 ms 2026-02-17T21:10:50.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 855400 6.76 MB/sec execute 564 sec latency 5.544 ms 2026-02-17T21:10:50.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 113122054 897.80 MB/sec execute 564 sec latency 0.240 ms 2026-02-17T21:10:51.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:50 trial153 ceph-mon[25357]: pgmap v460: 129 pgs: 129 active+clean; 197 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.6 MiB/s wr, 171 op/s 2026-02-17T21:10:51.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:50 trial104 ceph-mon[20612]: pgmap v460: 129 pgs: 129 active+clean; 197 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.6 MiB/s wr, 171 op/s 2026-02-17T21:10:51.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 856318 6.76 MB/sec execute 565 sec latency 7.573 ms 2026-02-17T21:10:51.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 113286385 897.81 MB/sec execute 565 sec latency 0.603 ms 2026-02-17T21:10:52.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 857632 6.76 MB/sec execute 566 sec latency 6.637 ms 2026-02-17T21:10:52.765 INFO:tasks.workunit.client.0.trial104.stdout: 1 113453405 897.81 MB/sec execute 566 sec latency 0.315 ms 2026-02-17T21:10:53.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:52 trial153 ceph-mon[25357]: pgmap v461: 129 pgs: 129 active+clean; 196 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.5 MiB/s wr, 124 op/s 2026-02-17T21:10:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:52 trial104 ceph-mon[20612]: pgmap v461: 129 pgs: 129 active+clean; 196 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.5 MiB/s wr, 124 op/s 2026-02-17T21:10:53.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 858974 6.76 MB/sec execute 567 sec latency 6.352 ms 2026-02-17T21:10:53.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 113617280 897.79 MB/sec execute 567 sec latency 6.320 ms 2026-02-17T21:10:54.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 859932 6.76 MB/sec execute 568 sec latency 6.429 ms 2026-02-17T21:10:54.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 113782230 897.80 MB/sec execute 568 sec latency 0.851 ms 2026-02-17T21:10:55.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:54 trial153 ceph-mon[25357]: pgmap v462: 129 pgs: 129 active+clean; 195 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.8 MiB/s wr, 133 op/s 2026-02-17T21:10:55.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:54 trial104 ceph-mon[20612]: pgmap v462: 129 pgs: 129 active+clean; 195 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.8 MiB/s wr, 133 op/s 2026-02-17T21:10:55.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 861182 6.76 MB/sec execute 569 sec latency 7.074 ms 2026-02-17T21:10:55.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 113946667 897.78 MB/sec execute 569 sec latency 6.580 ms 2026-02-17T21:10:56.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 862551 6.76 MB/sec execute 570 sec latency 5.510 ms 2026-02-17T21:10:56.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 114112724 897.78 MB/sec execute 570 sec latency 0.239 ms 2026-02-17T21:10:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:56 trial153 ceph-mon[25357]: pgmap v463: 129 pgs: 129 active+clean; 197 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.5 MiB/s wr, 167 op/s 2026-02-17T21:10:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:56 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:10:57.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:56 trial104 ceph-mon[20612]: pgmap v463: 129 pgs: 129 active+clean; 197 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.5 MiB/s wr, 167 op/s 2026-02-17T21:10:57.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:56 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:10:57.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 863617 6.76 MB/sec execute 571 sec latency 7.791 ms 2026-02-17T21:10:57.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 114274755 897.77 MB/sec execute 571 sec latency 0.277 ms 2026-02-17T21:10:58.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:57 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:10:58.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:57 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:10:58.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:57 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:10:58.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:57 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:10:58.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:57 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:10:58.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:57 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:10:58.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 864911 6.75 MB/sec execute 572 sec latency 6.703 ms 2026-02-17T21:10:58.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 114441308 897.77 MB/sec execute 572 sec latency 0.229 ms 2026-02-17T21:10:59.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:10:59 trial153 ceph-mon[25357]: pgmap v464: 129 pgs: 129 active+clean; 198 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-17T21:10:59.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:10:59 trial104 ceph-mon[20612]: pgmap v464: 129 pgs: 129 active+clean; 198 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.8 KiB/s rd, 2.8 MiB/s wr, 131 op/s 2026-02-17T21:10:59.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 866290 6.76 MB/sec execute 573 sec latency 9.710 ms 2026-02-17T21:10:59.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 114605273 897.77 MB/sec execute 573 sec latency 4.939 ms 2026-02-17T21:11:00.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 867272 6.76 MB/sec execute 574 sec latency 7.967 ms 2026-02-17T21:11:00.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 114771458 897.77 MB/sec execute 574 sec latency 0.247 ms 2026-02-17T21:11:01.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:01 trial153 ceph-mon[25357]: pgmap v465: 129 pgs: 129 active+clean; 201 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 174 op/s 2026-02-17T21:11:01.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:01 trial104 ceph-mon[20612]: pgmap v465: 129 pgs: 129 active+clean; 201 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.7 MiB/s wr, 174 op/s 2026-02-17T21:11:01.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 868597 6.75 MB/sec execute 575 sec latency 5.852 ms 2026-02-17T21:11:01.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 114938931 897.78 MB/sec execute 575 sec latency 0.435 ms 2026-02-17T21:11:02.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 869944 6.76 MB/sec execute 576 sec latency 5.909 ms 2026-02-17T21:11:02.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 115104094 897.80 MB/sec execute 576 sec latency 0.259 ms 2026-02-17T21:11:03.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:03 trial153 ceph-mon[25357]: pgmap v466: 129 pgs: 129 active+clean; 201 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.6 MiB/s wr, 123 op/s 2026-02-17T21:11:03.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:03 trial104 ceph-mon[20612]: pgmap v466: 129 pgs: 129 active+clean; 201 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.6 MiB/s wr, 123 op/s 2026-02-17T21:11:03.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 870890 6.76 MB/sec execute 577 sec latency 7.226 ms 2026-02-17T21:11:03.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 115269725 897.78 MB/sec execute 577 sec latency 0.364 ms 2026-02-17T21:11:04.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:11:04.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:11:04.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 872205 6.75 MB/sec execute 578 sec latency 5.556 ms 2026-02-17T21:11:04.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 115434758 897.78 MB/sec execute 578 sec latency 4.097 ms 2026-02-17T21:11:05.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:05 trial104 ceph-mon[20612]: pgmap v467: 129 pgs: 129 active+clean; 200 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.8 MiB/s wr, 132 op/s 2026-02-17T21:11:05.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:05 trial153 ceph-mon[25357]: pgmap v467: 129 pgs: 129 active+clean; 200 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 2.8 MiB/s wr, 132 op/s 2026-02-17T21:11:05.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 873613 6.76 MB/sec execute 579 sec latency 5.734 ms 2026-02-17T21:11:05.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 115599795 897.79 MB/sec execute 579 sec latency 0.269 ms 2026-02-17T21:11:06.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 874584 6.75 MB/sec execute 580 sec latency 6.162 ms 2026-02-17T21:11:06.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 115766386 897.79 MB/sec execute 580 sec latency 0.270 ms 2026-02-17T21:11:07.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:07 trial153 ceph-mon[25357]: pgmap v468: 129 pgs: 129 active+clean; 202 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.3 MiB/s wr, 163 op/s 2026-02-17T21:11:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:07 trial104 ceph-mon[20612]: pgmap v468: 129 pgs: 129 active+clean; 202 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.3 MiB/s wr, 163 op/s 2026-02-17T21:11:07.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 875838 6.75 MB/sec execute 581 sec latency 6.917 ms 2026-02-17T21:11:07.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 115933167 897.79 MB/sec execute 581 sec latency 0.279 ms 2026-02-17T21:11:08.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 877217 6.76 MB/sec execute 582 sec latency 5.591 ms 2026-02-17T21:11:08.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 116099032 897.81 MB/sec execute 582 sec latency 0.276 ms 2026-02-17T21:11:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:09 trial104 ceph-mon[20612]: pgmap v469: 129 pgs: 129 active+clean; 203 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.5 MiB/s wr, 123 op/s 2026-02-17T21:11:09.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:09 trial153 ceph-mon[25357]: pgmap v469: 129 pgs: 129 active+clean; 203 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 2.5 MiB/s wr, 123 op/s 2026-02-17T21:11:09.655 INFO:tasks.workunit.client.1.trial153.stdout: 1 878352 6.76 MB/sec execute 583 sec latency 6.767 ms 2026-02-17T21:11:09.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 116263647 897.80 MB/sec execute 583 sec latency 9.197 ms 2026-02-17T21:11:10.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 879800 6.76 MB/sec execute 584 sec latency 5.726 ms 2026-02-17T21:11:10.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 116427154 897.80 MB/sec execute 584 sec latency 6.568 ms 2026-02-17T21:11:11.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:11 trial104 ceph-mon[20612]: pgmap v470: 129 pgs: 129 active+clean; 204 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 3.5 MiB/s wr, 169 op/s 2026-02-17T21:11:11.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:11 trial153 ceph-mon[25357]: pgmap v470: 129 pgs: 129 active+clean; 204 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 3.5 MiB/s wr, 169 op/s 2026-02-17T21:11:11.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 880914 6.76 MB/sec execute 585 sec latency 5.577 ms 2026-02-17T21:11:11.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 116594090 897.80 MB/sec execute 585 sec latency 0.243 ms 2026-02-17T21:11:12.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 882126 6.76 MB/sec execute 586 sec latency 6.735 ms 2026-02-17T21:11:12.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 116759070 897.79 MB/sec execute 586 sec latency 0.243 ms 2026-02-17T21:11:13.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:13 trial104 ceph-mon[20612]: pgmap v471: 129 pgs: 129 active+clean; 205 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.5 MiB/s wr, 122 op/s 2026-02-17T21:11:13.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:13 trial153 ceph-mon[25357]: pgmap v471: 129 pgs: 129 active+clean; 205 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.5 MiB/s wr, 122 op/s 2026-02-17T21:11:13.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 883675 6.76 MB/sec execute 587 sec latency 5.334 ms 2026-02-17T21:11:13.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 116924023 897.80 MB/sec execute 587 sec latency 0.658 ms 2026-02-17T21:11:14.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 884593 6.76 MB/sec execute 588 sec latency 7.343 ms 2026-02-17T21:11:14.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 117089877 897.79 MB/sec execute 588 sec latency 0.244 ms 2026-02-17T21:11:15.322 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:15 trial104 ceph-mon[20612]: pgmap v472: 129 pgs: 129 active+clean; 205 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.7 MiB/s wr, 131 op/s 2026-02-17T21:11:15.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:15 trial153 ceph-mon[25357]: pgmap v472: 129 pgs: 129 active+clean; 205 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.4 KiB/s rd, 2.7 MiB/s wr, 131 op/s 2026-02-17T21:11:15.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 885862 6.75 MB/sec execute 589 sec latency 6.899 ms 2026-02-17T21:11:15.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 117254030 897.78 MB/sec execute 589 sec latency 4.550 ms 2026-02-17T21:11:16.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 887323 6.76 MB/sec execute 590 sec latency 6.250 ms 2026-02-17T21:11:16.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 117418185 897.78 MB/sec execute 590 sec latency 0.274 ms 2026-02-17T21:11:17.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:17 trial153 ceph-mon[25357]: pgmap v473: 129 pgs: 129 active+clean; 207 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 3.5 MiB/s wr, 162 op/s 2026-02-17T21:11:17.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:17 trial104 ceph-mon[20612]: pgmap v473: 129 pgs: 129 active+clean; 207 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 3.5 MiB/s wr, 162 op/s 2026-02-17T21:11:17.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 888259 6.75 MB/sec execute 591 sec latency 6.254 ms 2026-02-17T21:11:17.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 117582909 897.76 MB/sec execute 591 sec latency 0.234 ms 2026-02-17T21:11:18.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 889582 6.75 MB/sec execute 592 sec latency 6.429 ms 2026-02-17T21:11:18.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 117747890 897.75 MB/sec execute 592 sec latency 0.235 ms 2026-02-17T21:11:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:19 trial104 ceph-mon[20612]: pgmap v474: 129 pgs: 129 active+clean; 207 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.7 MiB/s wr, 129 op/s 2026-02-17T21:11:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:11:19.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:19 trial153 ceph-mon[25357]: pgmap v474: 129 pgs: 129 active+clean; 207 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.7 MiB/s wr, 129 op/s 2026-02-17T21:11:19.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:11:19.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 890927 6.76 MB/sec execute 593 sec latency 6.366 ms 2026-02-17T21:11:19.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 117909798 897.73 MB/sec execute 593 sec latency 3.724 ms 2026-02-17T21:11:20.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 892012 6.75 MB/sec execute 594 sec latency 6.279 ms 2026-02-17T21:11:20.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 118074390 897.72 MB/sec execute 594 sec latency 0.249 ms 2026-02-17T21:11:21.326 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:21 trial153 ceph-mon[25357]: pgmap v475: 129 pgs: 129 active+clean; 209 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.8 MiB/s wr, 174 op/s 2026-02-17T21:11:21.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:21 trial104 ceph-mon[20612]: pgmap v475: 129 pgs: 129 active+clean; 209 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 3.8 MiB/s wr, 174 op/s 2026-02-17T21:11:21.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 893366 6.75 MB/sec execute 595 sec latency 6.138 ms 2026-02-17T21:11:21.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 118240230 897.71 MB/sec execute 595 sec latency 0.234 ms 2026-02-17T21:11:22.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 894762 6.76 MB/sec execute 596 sec latency 7.391 ms 2026-02-17T21:11:22.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 118403577 897.71 MB/sec execute 596 sec latency 0.350 ms 2026-02-17T21:11:23.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:23 trial104 ceph-mon[20612]: pgmap v476: 129 pgs: 129 active+clean; 209 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.7 MiB/s wr, 125 op/s 2026-02-17T21:11:23.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:23 trial153 ceph-mon[25357]: pgmap v476: 129 pgs: 129 active+clean; 209 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.7 MiB/s wr, 125 op/s 2026-02-17T21:11:23.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 895754 6.75 MB/sec execute 597 sec latency 6.293 ms 2026-02-17T21:11:23.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 118568844 897.70 MB/sec execute 597 sec latency 0.234 ms 2026-02-17T21:11:24.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 897087 6.75 MB/sec execute 598 sec latency 7.633 ms 2026-02-17T21:11:24.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 118730544 897.69 MB/sec execute 598 sec latency 4.165 ms 2026-02-17T21:11:25.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:25 trial104 ceph-mon[20612]: pgmap v477: 129 pgs: 129 active+clean; 208 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.8 MiB/s wr, 132 op/s 2026-02-17T21:11:25.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:25 trial153 ceph-mon[25357]: pgmap v477: 129 pgs: 129 active+clean; 208 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 2.8 MiB/s wr, 132 op/s 2026-02-17T21:11:25.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 898470 6.76 MB/sec execute 599 sec latency 5.591 ms 2026-02-17T21:11:25.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 118896354 897.68 MB/sec execute 599 sec latency 0.238 ms 2026-02-17T21:11:26.656 INFO:tasks.workunit.client.1.trial153.stdout: 1 cleanup 600 sec 2026-02-17T21:11:26.766 INFO:tasks.workunit.client.0.trial104.stdout: 1 cleanup 600 sec 2026-02-17T21:11:26.770 INFO:tasks.workunit.client.0.trial104.stdout: 0 cleanup 600 sec 2026-02-17T21:11:26.771 INFO:tasks.workunit.client.0.trial104.stdout: 2026-02-17T21:11:26.771 INFO:tasks.workunit.client.0.trial104.stdout: Operation Count AvgLat MaxLat 2026-02-17T21:11:26.771 INFO:tasks.workunit.client.0.trial104.stdout: ---------------------------------------- 2026-02-17T21:11:26.771 INFO:tasks.workunit.client.0.trial104.stdout: NTCreateX 17151685 0.007 1.004 2026-02-17T21:11:26.771 INFO:tasks.workunit.client.0.trial104.stdout: Close 12599103 0.001 2.332 2026-02-17T21:11:26.771 INFO:tasks.workunit.client.0.trial104.stdout: Rename 726291 0.015 0.244 2026-02-17T21:11:26.772 INFO:tasks.workunit.client.0.trial104.stdout: Unlink 3463685 0.012 0.449 2026-02-17T21:11:26.772 INFO:tasks.workunit.client.0.trial104.stdout: Deltree 432 1.802 3.992 2026-02-17T21:11:26.772 INFO:tasks.workunit.client.0.trial104.stdout: Mkdir 216 0.002 0.004 2026-02-17T21:11:26.772 INFO:tasks.workunit.client.0.trial104.stdout: Qpathinfo 15546316 0.003 0.590 2026-02-17T21:11:26.772 INFO:tasks.workunit.client.0.trial104.stdout: Qfileinfo 2724371 0.001 0.109 2026-02-17T21:11:26.772 INFO:tasks.workunit.client.0.trial104.stdout: Qfsinfo 2850606 0.001 0.528 2026-02-17T21:11:26.773 INFO:tasks.workunit.client.0.trial104.stdout: Sfileinfo 1397158 0.003 0.624 2026-02-17T21:11:26.773 INFO:tasks.workunit.client.0.trial104.stdout: Find 6010562 0.012 2.015 2026-02-17T21:11:26.773 INFO:tasks.workunit.client.0.trial104.stdout: WriteX 8551206 0.007 1.530 2026-02-17T21:11:26.773 INFO:tasks.workunit.client.0.trial104.stdout: ReadX 26886615 0.001 0.656 2026-02-17T21:11:26.773 INFO:tasks.workunit.client.0.trial104.stdout: LockX 55852 0.001 0.091 2026-02-17T21:11:26.773 INFO:tasks.workunit.client.0.trial104.stdout: UnlockX 55852 0.001 0.097 2026-02-17T21:11:26.774 INFO:tasks.workunit.client.0.trial104.stdout: Flush 1202107 0.099 32.095 2026-02-17T21:11:26.774 INFO:tasks.workunit.client.0.trial104.stdout: 2026-02-17T21:11:26.774 INFO:tasks.workunit.client.0.trial104.stdout:Throughput 897.68 MB/sec 1 clients 1 procs max_latency=32.098 ms 2026-02-17T21:11:26.775 INFO:tasks.workunit.client.0.trial104.stderr:+ dbench 10 2026-02-17T21:11:26.775 INFO:tasks.workunit.client.0.trial104.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2026-02-17T21:11:26.776 INFO:tasks.workunit.client.0.trial104.stdout: 2026-02-17T21:11:26.776 INFO:tasks.workunit.client.0.trial104.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2026-02-17T21:11:26.776 INFO:tasks.workunit.client.0.trial104.stdout:8 of 10 processes prepared for launch 0 sec 2026-02-17T21:11:26.799 INFO:tasks.workunit.client.1.trial153.stdout: 0 cleanup 600 sec 2026-02-17T21:11:26.799 INFO:tasks.workunit.client.1.trial153.stdout: 2026-02-17T21:11:26.799 INFO:tasks.workunit.client.1.trial153.stdout: Operation Count AvgLat MaxLat 2026-02-17T21:11:26.799 INFO:tasks.workunit.client.1.trial153.stdout: ---------------------------------------- 2026-02-17T21:11:26.799 INFO:tasks.workunit.client.1.trial153.stdout: NTCreateX 129317 1.597 9.056 2026-02-17T21:11:26.799 INFO:tasks.workunit.client.1.trial153.stdout: Close 94957 0.021 0.799 2026-02-17T21:11:26.799 INFO:tasks.workunit.client.1.trial153.stdout: Rename 5484 4.097 25.513 2026-02-17T21:11:26.799 INFO:tasks.workunit.client.1.trial153.stdout: Unlink 26152 1.555 3.473 2026-02-17T21:11:26.799 INFO:tasks.workunit.client.1.trial153.stdout: Deltree 2 64.995 99.313 2026-02-17T21:11:26.800 INFO:tasks.workunit.client.1.trial153.stdout: Mkdir 1 0.219 0.219 2026-02-17T21:11:26.800 INFO:tasks.workunit.client.1.trial153.stdout: Qpathinfo 117219 0.937 7.678 2026-02-17T21:11:26.800 INFO:tasks.workunit.client.1.trial153.stdout: Qfileinfo 20498 0.058 1.308 2026-02-17T21:11:26.800 INFO:tasks.workunit.client.1.trial153.stdout: Qfsinfo 21526 0.177 3.231 2026-02-17T21:11:26.800 INFO:tasks.workunit.client.1.trial153.stdout: Sfileinfo 10547 0.552 1.677 2026-02-17T21:11:26.800 INFO:tasks.workunit.client.1.trial153.stdout: Find 45333 4.149 32.492 2026-02-17T21:11:26.800 INFO:tasks.workunit.client.1.trial153.stdout: WriteX 64259 0.099 1.330 2026-02-17T21:11:26.800 INFO:tasks.workunit.client.1.trial153.stdout: ReadX 202966 0.002 0.120 2026-02-17T21:11:26.800 INFO:tasks.workunit.client.1.trial153.stdout: LockX 422 0.205 0.763 2026-02-17T21:11:26.800 INFO:tasks.workunit.client.1.trial153.stdout: UnlockX 422 0.188 0.320 2026-02-17T21:11:26.800 INFO:tasks.workunit.client.1.trial153.stdout: Flush 9071 1.270 6.370 2026-02-17T21:11:26.800 INFO:tasks.workunit.client.1.trial153.stdout: 2026-02-17T21:11:26.800 INFO:tasks.workunit.client.1.trial153.stdout:Throughput 6.75891 MB/sec 1 clients 1 procs max_latency=32.494 ms 2026-02-17T21:11:26.801 INFO:tasks.workunit.client.1.trial153.stderr:+ dbench 10 2026-02-17T21:11:26.801 INFO:tasks.workunit.client.1.trial153.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2026-02-17T21:11:26.801 INFO:tasks.workunit.client.1.trial153.stdout: 2026-02-17T21:11:26.802 INFO:tasks.workunit.client.1.trial153.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2026-02-17T21:11:26.802 INFO:tasks.workunit.client.1.trial153.stdout:8 of 10 processes prepared for launch 0 sec 2026-02-17T21:11:26.872 INFO:tasks.workunit.client.0.trial104.stdout:10 of 10 processes prepared for launch 0 sec 2026-02-17T21:11:26.872 INFO:tasks.workunit.client.0.trial104.stdout:releasing clients 2026-02-17T21:11:26.900 INFO:tasks.workunit.client.1.trial153.stdout:10 of 10 processes prepared for launch 0 sec 2026-02-17T21:11:26.900 INFO:tasks.workunit.client.1.trial153.stdout:releasing clients 2026-02-17T21:11:27.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:27 trial153 ceph-mon[25357]: pgmap v478: 129 pgs: 129 active+clean; 194 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.3 MiB/s wr, 162 op/s 2026-02-17T21:11:27.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:27 trial104 ceph-mon[20612]: pgmap v478: 129 pgs: 129 active+clean; 194 MiB data, 2.2 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 3.3 MiB/s wr, 162 op/s 2026-02-17T21:11:27.872 INFO:tasks.workunit.client.0.trial104.stdout: 10 100440 5581.84 MB/sec warmup 1 sec latency 2.310 ms 2026-02-17T21:11:27.900 INFO:tasks.workunit.client.1.trial153.stdout: 10 441 154.97 MB/sec warmup 1 sec latency 23.361 ms 2026-02-17T21:11:28.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 200182 5480.71 MB/sec warmup 2 sec latency 2.075 ms 2026-02-17T21:11:28.900 INFO:tasks.workunit.client.1.trial153.stdout: 10 810 107.41 MB/sec warmup 2 sec latency 38.732 ms 2026-02-17T21:11:29.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:29 trial104 ceph-mon[20612]: pgmap v479: 129 pgs: 129 active+clean; 210 MiB data, 2.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 4.2 MiB/s wr, 148 op/s 2026-02-17T21:11:29.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:29 trial153 ceph-mon[25357]: pgmap v479: 129 pgs: 129 active+clean; 210 MiB data, 2.3 GiB used, 5.5 TiB / 5.5 TiB avail; 4.5 KiB/s rd, 4.2 MiB/s wr, 148 op/s 2026-02-17T21:11:29.872 INFO:tasks.workunit.client.0.trial104.stdout: 10 302173 5483.71 MB/sec warmup 3 sec latency 1.799 ms 2026-02-17T21:11:29.900 INFO:tasks.workunit.client.1.trial153.stdout: 10 1056 76.32 MB/sec warmup 3 sec latency 38.029 ms 2026-02-17T21:11:30.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 401030 5449.08 MB/sec warmup 4 sec latency 18.678 ms 2026-02-17T21:11:30.900 INFO:tasks.workunit.client.1.trial153.stdout: 10 1290 58.57 MB/sec warmup 4 sec latency 40.262 ms 2026-02-17T21:11:31.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:31 trial104 ceph-mon[20612]: pgmap v480: 129 pgs: 129 active+clean; 326 MiB data, 2.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 16 MiB/s wr, 214 op/s 2026-02-17T21:11:31.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:31 trial153 ceph-mon[25357]: pgmap v480: 129 pgs: 129 active+clean; 326 MiB data, 2.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.3 KiB/s rd, 16 MiB/s wr, 214 op/s 2026-02-17T21:11:31.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 499170 5448.60 MB/sec warmup 5 sec latency 6.744 ms 2026-02-17T21:11:31.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 1565 52.24 MB/sec warmup 5 sec latency 39.501 ms 2026-02-17T21:11:32.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 597495 5424.32 MB/sec warmup 6 sec latency 2.591 ms 2026-02-17T21:11:32.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 1801 43.87 MB/sec warmup 6 sec latency 76.939 ms 2026-02-17T21:11:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:33 trial104 ceph-mon[20612]: pgmap v481: 129 pgs: 129 active+clean; 350 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 17 MiB/s wr, 201 op/s 2026-02-17T21:11:33.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:33 trial153 ceph-mon[25357]: pgmap v481: 129 pgs: 129 active+clean; 350 MiB data, 2.7 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 17 MiB/s wr, 201 op/s 2026-02-17T21:11:33.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 696739 5414.60 MB/sec warmup 7 sec latency 3.604 ms 2026-02-17T21:11:33.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 2030 37.95 MB/sec warmup 7 sec latency 40.260 ms 2026-02-17T21:11:34.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:34 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:11:34.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:34 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:11:34.872 INFO:tasks.workunit.client.0.trial104.stdout: 10 794297 5395.00 MB/sec warmup 8 sec latency 13.305 ms 2026-02-17T21:11:34.900 INFO:tasks.workunit.client.1.trial153.stdout: 10 2284 34.35 MB/sec warmup 8 sec latency 39.500 ms 2026-02-17T21:11:35.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:35 trial104 ceph-mon[20612]: pgmap v482: 129 pgs: 129 active+clean; 372 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 20 MiB/s wr, 228 op/s 2026-02-17T21:11:35.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:35 trial153 ceph-mon[25357]: pgmap v482: 129 pgs: 129 active+clean; 372 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 4.9 KiB/s rd, 20 MiB/s wr, 228 op/s 2026-02-17T21:11:35.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 892906 5386.50 MB/sec warmup 9 sec latency 2.051 ms 2026-02-17T21:11:35.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 2494 31.81 MB/sec warmup 9 sec latency 43.383 ms 2026-02-17T21:11:36.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 990322 5389.31 MB/sec warmup 10 sec latency 1.770 ms 2026-02-17T21:11:36.900 INFO:tasks.workunit.client.1.trial153.stdout: 10 2881 32.61 MB/sec warmup 10 sec latency 38.613 ms 2026-02-17T21:11:37.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:37 trial153 ceph-mon[25357]: pgmap v483: 129 pgs: 129 active+clean; 375 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 20 MiB/s wr, 272 op/s 2026-02-17T21:11:37.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:37 trial104 ceph-mon[20612]: pgmap v483: 129 pgs: 129 active+clean; 375 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 20 MiB/s wr, 272 op/s 2026-02-17T21:11:37.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 1090277 5390.09 MB/sec warmup 11 sec latency 2.239 ms 2026-02-17T21:11:37.900 INFO:tasks.workunit.client.1.trial153.stdout: 10 3282 32.13 MB/sec warmup 11 sec latency 38.851 ms 2026-02-17T21:11:38.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 1190045 5388.50 MB/sec warmup 12 sec latency 1.672 ms 2026-02-17T21:11:38.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 3360 29.52 MB/sec warmup 12 sec latency 34.325 ms 2026-02-17T21:11:39.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:39 trial104 ceph-mon[20612]: pgmap v484: 129 pgs: 129 active+clean; 378 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 20 MiB/s wr, 244 op/s 2026-02-17T21:11:39.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:39 trial153 ceph-mon[25357]: pgmap v484: 129 pgs: 129 active+clean; 378 MiB data, 2.8 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 20 MiB/s wr, 244 op/s 2026-02-17T21:11:39.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 1289119 5385.27 MB/sec warmup 13 sec latency 2.280 ms 2026-02-17T21:11:39.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 3682 29.92 MB/sec warmup 13 sec latency 41.370 ms 2026-02-17T21:11:40.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 1386628 5387.93 MB/sec warmup 14 sec latency 1.536 ms 2026-02-17T21:11:40.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 3864 28.44 MB/sec warmup 14 sec latency 44.689 ms 2026-02-17T21:11:41.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:41 trial104 ceph-mon[20612]: pgmap v485: 129 pgs: 129 active+clean; 399 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 21 MiB/s wr, 288 op/s 2026-02-17T21:11:41.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:41 trial153 ceph-mon[25357]: pgmap v485: 129 pgs: 129 active+clean; 399 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 21 MiB/s wr, 288 op/s 2026-02-17T21:11:41.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 1483134 5376.06 MB/sec warmup 15 sec latency 1.418 ms 2026-02-17T21:11:41.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 4006 26.71 MB/sec warmup 15 sec latency 37.852 ms 2026-02-17T21:11:42.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 1578412 5360.95 MB/sec warmup 16 sec latency 3.847 ms 2026-02-17T21:11:42.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 4166 25.07 MB/sec warmup 16 sec latency 59.704 ms 2026-02-17T21:11:43.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:43 trial104 ceph-mon[20612]: pgmap v486: 129 pgs: 129 active+clean; 401 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 9.4 MiB/s wr, 216 op/s 2026-02-17T21:11:43.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:43 trial153 ceph-mon[25357]: pgmap v486: 129 pgs: 129 active+clean; 401 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 9.4 MiB/s wr, 216 op/s 2026-02-17T21:11:43.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 1675479 5353.05 MB/sec warmup 17 sec latency 2.675 ms 2026-02-17T21:11:43.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 4429 23.95 MB/sec warmup 17 sec latency 55.283 ms 2026-02-17T21:11:44.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 1769737 5338.08 MB/sec warmup 18 sec latency 3.232 ms 2026-02-17T21:11:44.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 4668 23.37 MB/sec warmup 18 sec latency 46.939 ms 2026-02-17T21:11:45.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:45 trial104 ceph-mon[20612]: pgmap v487: 129 pgs: 129 active+clean; 403 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 8.1 MiB/s wr, 189 op/s 2026-02-17T21:11:45.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:45 trial153 ceph-mon[25357]: pgmap v487: 129 pgs: 129 active+clean; 403 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 8.1 MiB/s wr, 189 op/s 2026-02-17T21:11:45.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 1858482 5317.91 MB/sec warmup 19 sec latency 29.663 ms 2026-02-17T21:11:45.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 4927 23.17 MB/sec warmup 19 sec latency 47.146 ms 2026-02-17T21:11:46.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 1952978 5306.84 MB/sec warmup 20 sec latency 29.498 ms 2026-02-17T21:11:46.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 5167 22.64 MB/sec warmup 20 sec latency 40.122 ms 2026-02-17T21:11:47.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:47 trial153 ceph-mon[25357]: pgmap v488: 129 pgs: 129 active+clean; 406 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 215 op/s 2026-02-17T21:11:47.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:47 trial104 ceph-mon[20612]: pgmap v488: 129 pgs: 129 active+clean; 406 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 215 op/s 2026-02-17T21:11:47.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 2049861 5302.87 MB/sec warmup 21 sec latency 3.572 ms 2026-02-17T21:11:47.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 5401 21.65 MB/sec warmup 21 sec latency 41.232 ms 2026-02-17T21:11:48.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 2145312 5295.60 MB/sec warmup 22 sec latency 1.999 ms 2026-02-17T21:11:48.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 5635 20.79 MB/sec warmup 22 sec latency 39.750 ms 2026-02-17T21:11:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:49 trial104 ceph-mon[20612]: pgmap v489: 129 pgs: 129 active+clean; 405 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 6.5 MiB/s wr, 214 op/s 2026-02-17T21:11:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:49 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:11:49.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:49 trial153 ceph-mon[25357]: pgmap v489: 129 pgs: 129 active+clean; 405 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 6.5 MiB/s wr, 214 op/s 2026-02-17T21:11:49.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:49 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:11:49.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 2238525 5283.64 MB/sec warmup 23 sec latency 3.768 ms 2026-02-17T21:11:49.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 5893 20.42 MB/sec warmup 23 sec latency 43.390 ms 2026-02-17T21:11:50.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 2329876 5275.98 MB/sec warmup 24 sec latency 26.101 ms 2026-02-17T21:11:50.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 6091 19.98 MB/sec warmup 24 sec latency 40.915 ms 2026-02-17T21:11:51.325 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:51 trial153 ceph-mon[25357]: pgmap v490: 129 pgs: 129 active+clean; 390 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.9 MiB/s wr, 292 op/s 2026-02-17T21:11:51.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:51 trial104 ceph-mon[20612]: pgmap v490: 129 pgs: 129 active+clean; 390 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.9 MiB/s wr, 292 op/s 2026-02-17T21:11:51.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 2426474 5273.40 MB/sec warmup 25 sec latency 15.738 ms 2026-02-17T21:11:51.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 6516 21.00 MB/sec warmup 25 sec latency 39.812 ms 2026-02-17T21:11:52.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 2521065 5266.33 MB/sec warmup 26 sec latency 2.001 ms 2026-02-17T21:11:52.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 6852 20.95 MB/sec warmup 26 sec latency 40.123 ms 2026-02-17T21:11:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:53 trial104 ceph-mon[20612]: pgmap v491: 129 pgs: 129 active+clean; 395 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 4.7 MiB/s wr, 239 op/s 2026-02-17T21:11:53.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:53 trial153 ceph-mon[25357]: pgmap v491: 129 pgs: 129 active+clean; 395 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 4.7 MiB/s wr, 239 op/s 2026-02-17T21:11:53.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 2618771 5266.66 MB/sec warmup 27 sec latency 1.397 ms 2026-02-17T21:11:53.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 7000 20.56 MB/sec warmup 27 sec latency 38.276 ms 2026-02-17T21:11:54.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 2716907 5267.35 MB/sec warmup 28 sec latency 2.734 ms 2026-02-17T21:11:54.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 7277 20.78 MB/sec warmup 28 sec latency 62.670 ms 2026-02-17T21:11:55.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:55 trial104 ceph-mon[20612]: pgmap v492: 129 pgs: 129 active+clean; 394 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 5.5 MiB/s wr, 258 op/s 2026-02-17T21:11:55.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:55 trial153 ceph-mon[25357]: pgmap v492: 129 pgs: 129 active+clean; 394 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 5.5 MiB/s wr, 258 op/s 2026-02-17T21:11:55.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 2812564 5269.69 MB/sec warmup 29 sec latency 17.386 ms 2026-02-17T21:11:55.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 7446 20.35 MB/sec warmup 29 sec latency 39.365 ms 2026-02-17T21:11:56.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 2910598 5270.14 MB/sec warmup 30 sec latency 1.595 ms 2026-02-17T21:11:56.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 7591 19.73 MB/sec warmup 30 sec latency 41.700 ms 2026-02-17T21:11:57.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:57 trial153 ceph-mon[25357]: pgmap v493: 129 pgs: 129 active+clean; 389 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 273 op/s 2026-02-17T21:11:57.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:57 trial104 ceph-mon[20612]: pgmap v493: 129 pgs: 129 active+clean; 389 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 273 op/s 2026-02-17T21:11:57.873 INFO:tasks.workunit.client.0.trial104.stdout: 10 3006926 5267.63 MB/sec warmup 31 sec latency 2.368 ms 2026-02-17T21:11:57.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 7777 19.15 MB/sec warmup 31 sec latency 53.412 ms 2026-02-17T21:11:58.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:58 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:11:58.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:58 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:11:58.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:58 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:11:58.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:58 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:11:58.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:58 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:11:58.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:58 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:11:58.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:58 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:11:58.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:58 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:11:58.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 3103140 5265.10 MB/sec warmup 32 sec latency 2.321 ms 2026-02-17T21:11:58.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 8041 18.81 MB/sec warmup 32 sec latency 46.515 ms 2026-02-17T21:11:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:11:59 trial104 ceph-mon[20612]: pgmap v494: 129 pgs: 129 active+clean; 397 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 6.3 MiB/s wr, 272 op/s 2026-02-17T21:11:59.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:11:59 trial153 ceph-mon[25357]: pgmap v494: 129 pgs: 129 active+clean; 397 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 6.3 MiB/s wr, 272 op/s 2026-02-17T21:11:59.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 3201170 5265.74 MB/sec warmup 33 sec latency 2.766 ms 2026-02-17T21:11:59.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 8278 18.56 MB/sec warmup 33 sec latency 51.033 ms 2026-02-17T21:12:00.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 3297962 5269.26 MB/sec warmup 34 sec latency 2.326 ms 2026-02-17T21:12:00.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 8559 18.91 MB/sec warmup 34 sec latency 42.189 ms 2026-02-17T21:12:01.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:01 trial104 ceph-mon[20612]: pgmap v495: 129 pgs: 129 active+clean; 387 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.9 MiB/s wr, 285 op/s 2026-02-17T21:12:01.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:01 trial153 ceph-mon[25357]: pgmap v495: 129 pgs: 129 active+clean; 387 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.9 MiB/s wr, 285 op/s 2026-02-17T21:12:01.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 3393321 5265.63 MB/sec warmup 35 sec latency 10.979 ms 2026-02-17T21:12:01.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 8777 18.41 MB/sec warmup 35 sec latency 42.056 ms 2026-02-17T21:12:02.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:02 trial104 ceph-mon[20612]: pgmap v496: 129 pgs: 129 active+clean; 383 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 6.2 MiB/s wr, 205 op/s 2026-02-17T21:12:02.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:02 trial153 ceph-mon[25357]: pgmap v496: 129 pgs: 129 active+clean; 383 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 6.2 MiB/s wr, 205 op/s 2026-02-17T21:12:02.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 3491042 5265.77 MB/sec warmup 36 sec latency 6.110 ms 2026-02-17T21:12:02.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 9009 17.96 MB/sec warmup 36 sec latency 40.827 ms 2026-02-17T21:12:03.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 3589056 5266.15 MB/sec warmup 37 sec latency 1.806 ms 2026-02-17T21:12:03.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 9247 17.57 MB/sec warmup 37 sec latency 37.482 ms 2026-02-17T21:12:04.023 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:12:04.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:12:04.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 3685484 5268.60 MB/sec warmup 38 sec latency 2.372 ms 2026-02-17T21:12:04.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 9490 17.43 MB/sec warmup 38 sec latency 43.645 ms 2026-02-17T21:12:05.023 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:04 trial153 ceph-mon[25357]: pgmap v497: 129 pgs: 129 active+clean; 380 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 6.4 MiB/s wr, 229 op/s 2026-02-17T21:12:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:04 trial104 ceph-mon[20612]: pgmap v497: 129 pgs: 129 active+clean; 380 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 6.4 MiB/s wr, 229 op/s 2026-02-17T21:12:05.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 3782272 5267.60 MB/sec warmup 39 sec latency 18.518 ms 2026-02-17T21:12:05.901 INFO:tasks.workunit.client.1.trial153.stdout: 10 9748 17.47 MB/sec warmup 39 sec latency 49.398 ms 2026-02-17T21:12:06.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 3878894 5266.14 MB/sec warmup 40 sec latency 7.616 ms 2026-02-17T21:12:06.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 10165 18.07 MB/sec warmup 40 sec latency 42.863 ms 2026-02-17T21:12:07.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:06 trial104 ceph-mon[20612]: pgmap v498: 129 pgs: 129 active+clean; 381 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 270 op/s 2026-02-17T21:12:07.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:06 trial153 ceph-mon[25357]: pgmap v498: 129 pgs: 129 active+clean; 381 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 270 op/s 2026-02-17T21:12:07.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 3977452 5267.28 MB/sec warmup 41 sec latency 2.868 ms 2026-02-17T21:12:07.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 10415 17.95 MB/sec warmup 41 sec latency 37.611 ms 2026-02-17T21:12:08.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 4075859 5268.14 MB/sec warmup 42 sec latency 1.281 ms 2026-02-17T21:12:08.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 10633 18.08 MB/sec warmup 42 sec latency 39.391 ms 2026-02-17T21:12:09.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:08 trial104 ceph-mon[20612]: pgmap v499: 129 pgs: 129 active+clean; 386 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.0 MiB/s wr, 257 op/s 2026-02-17T21:12:09.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:08 trial153 ceph-mon[25357]: pgmap v499: 129 pgs: 129 active+clean; 386 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 5.0 MiB/s wr, 257 op/s 2026-02-17T21:12:09.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 4173361 5271.79 MB/sec warmup 43 sec latency 3.000 ms 2026-02-17T21:12:09.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 10882 18.12 MB/sec warmup 43 sec latency 44.069 ms 2026-02-17T21:12:10.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 4271690 5272.60 MB/sec warmup 44 sec latency 2.185 ms 2026-02-17T21:12:10.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 11030 17.80 MB/sec warmup 44 sec latency 57.197 ms 2026-02-17T21:12:11.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:10 trial104 ceph-mon[20612]: pgmap v500: 129 pgs: 129 active+clean; 408 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 285 op/s 2026-02-17T21:12:11.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:10 trial153 ceph-mon[25357]: pgmap v500: 129 pgs: 129 active+clean; 408 MiB data, 2.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 285 op/s 2026-02-17T21:12:11.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 4369569 5272.53 MB/sec warmup 45 sec latency 13.153 ms 2026-02-17T21:12:11.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 11173 17.40 MB/sec warmup 45 sec latency 50.495 ms 2026-02-17T21:12:12.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 4467651 5273.08 MB/sec warmup 46 sec latency 2.530 ms 2026-02-17T21:12:12.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 11393 17.10 MB/sec warmup 46 sec latency 43.497 ms 2026-02-17T21:12:13.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:12 trial104 ceph-mon[20612]: pgmap v501: 129 pgs: 129 active+clean; 408 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 5.5 MiB/s wr, 223 op/s 2026-02-17T21:12:13.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:12 trial153 ceph-mon[25357]: pgmap v501: 129 pgs: 129 active+clean; 408 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 5.5 MiB/s wr, 223 op/s 2026-02-17T21:12:13.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 4563992 5271.09 MB/sec warmup 47 sec latency 1.905 ms 2026-02-17T21:12:13.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 11651 16.94 MB/sec warmup 47 sec latency 42.899 ms 2026-02-17T21:12:14.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 4659169 5271.68 MB/sec warmup 48 sec latency 2.924 ms 2026-02-17T21:12:14.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 11906 16.93 MB/sec warmup 48 sec latency 46.060 ms 2026-02-17T21:12:15.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:14 trial104 ceph-mon[20612]: pgmap v502: 129 pgs: 129 active+clean; 410 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 6.1 MiB/s wr, 223 op/s 2026-02-17T21:12:15.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:14 trial153 ceph-mon[25357]: pgmap v502: 129 pgs: 129 active+clean; 410 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 6.1 MiB/s wr, 223 op/s 2026-02-17T21:12:15.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 4757154 5272.16 MB/sec warmup 49 sec latency 1.497 ms 2026-02-17T21:12:15.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 12167 17.03 MB/sec warmup 49 sec latency 48.595 ms 2026-02-17T21:12:16.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 4852790 5269.75 MB/sec warmup 50 sec latency 18.674 ms 2026-02-17T21:12:16.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 12381 16.72 MB/sec warmup 50 sec latency 43.710 ms 2026-02-17T21:12:17.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:16 trial104 ceph-mon[20612]: pgmap v503: 129 pgs: 129 active+clean; 403 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 243 op/s 2026-02-17T21:12:17.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:16 trial153 ceph-mon[25357]: pgmap v503: 129 pgs: 129 active+clean; 403 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 243 op/s 2026-02-17T21:12:17.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 4950609 5269.85 MB/sec warmup 51 sec latency 1.981 ms 2026-02-17T21:12:17.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 12612 16.44 MB/sec warmup 51 sec latency 41.262 ms 2026-02-17T21:12:18.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 5047932 5271.66 MB/sec warmup 52 sec latency 2.680 ms 2026-02-17T21:12:18.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 12857 16.23 MB/sec warmup 52 sec latency 36.785 ms 2026-02-17T21:12:19.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:18 trial104 ceph-mon[20612]: pgmap v504: 129 pgs: 129 active+clean; 401 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 6.7 MiB/s wr, 244 op/s 2026-02-17T21:12:19.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:12:19.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:18 trial153 ceph-mon[25357]: pgmap v504: 129 pgs: 129 active+clean; 401 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 6.7 MiB/s wr, 244 op/s 2026-02-17T21:12:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:12:19.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 5144858 5271.62 MB/sec warmup 53 sec latency 2.821 ms 2026-02-17T21:12:19.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 13090 16.15 MB/sec warmup 53 sec latency 41.045 ms 2026-02-17T21:12:20.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 5241564 5270.67 MB/sec warmup 54 sec latency 13.551 ms 2026-02-17T21:12:20.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 13376 16.30 MB/sec warmup 54 sec latency 44.102 ms 2026-02-17T21:12:21.140 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:20 trial104 ceph-mon[20612]: pgmap v505: 129 pgs: 129 active+clean; 397 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 299 op/s 2026-02-17T21:12:21.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:20 trial153 ceph-mon[25357]: pgmap v505: 129 pgs: 129 active+clean; 397 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 299 op/s 2026-02-17T21:12:21.874 INFO:tasks.workunit.client.0.trial104.stdout: 10 5336593 5267.94 MB/sec warmup 55 sec latency 19.656 ms 2026-02-17T21:12:21.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 13788 16.67 MB/sec warmup 55 sec latency 42.397 ms 2026-02-17T21:12:22.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 5433657 5267.45 MB/sec warmup 56 sec latency 12.059 ms 2026-02-17T21:12:22.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 14002 16.62 MB/sec warmup 56 sec latency 35.743 ms 2026-02-17T21:12:23.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:22 trial104 ceph-mon[20612]: pgmap v506: 129 pgs: 129 active+clean; 399 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 4.3 MiB/s wr, 224 op/s 2026-02-17T21:12:23.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:22 trial153 ceph-mon[25357]: pgmap v506: 129 pgs: 129 active+clean; 399 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 4.3 MiB/s wr, 224 op/s 2026-02-17T21:12:23.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 5530002 5269.12 MB/sec warmup 57 sec latency 1.633 ms 2026-02-17T21:12:23.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 14271 16.88 MB/sec warmup 57 sec latency 51.124 ms 2026-02-17T21:12:24.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 5626535 5268.01 MB/sec warmup 58 sec latency 2.842 ms 2026-02-17T21:12:24.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 14475 16.76 MB/sec warmup 58 sec latency 67.445 ms 2026-02-17T21:12:25.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:24 trial104 ceph-mon[20612]: pgmap v507: 129 pgs: 129 active+clean; 409 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 5.5 MiB/s wr, 244 op/s 2026-02-17T21:12:25.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:24 trial153 ceph-mon[25357]: pgmap v507: 129 pgs: 129 active+clean; 409 MiB data, 3.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 5.5 MiB/s wr, 244 op/s 2026-02-17T21:12:25.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 5724620 5268.36 MB/sec warmup 59 sec latency 1.821 ms 2026-02-17T21:12:25.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 14615 16.51 MB/sec warmup 59 sec latency 49.597 ms 2026-02-17T21:12:26.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 5821501 5267.50 MB/sec warmup 60 sec latency 1.952 ms 2026-02-17T21:12:26.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 14767 16.25 MB/sec warmup 60 sec latency 65.002 ms 2026-02-17T21:12:27.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:26 trial104 ceph-mon[20612]: pgmap v508: 129 pgs: 129 active+clean; 408 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.4 MiB/s wr, 295 op/s 2026-02-17T21:12:27.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:26 trial153 ceph-mon[25357]: pgmap v508: 129 pgs: 129 active+clean; 408 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.4 MiB/s wr, 295 op/s 2026-02-17T21:12:27.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 5914979 5263.79 MB/sec warmup 61 sec latency 9.149 ms 2026-02-17T21:12:27.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 15001 16.05 MB/sec warmup 61 sec latency 46.707 ms 2026-02-17T21:12:28.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 6010501 5264.69 MB/sec warmup 62 sec latency 2.858 ms 2026-02-17T21:12:28.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 15247 15.94 MB/sec warmup 62 sec latency 46.029 ms 2026-02-17T21:12:29.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:28 trial104 ceph-mon[20612]: pgmap v509: 129 pgs: 129 active+clean; 408 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 6.1 MiB/s wr, 253 op/s 2026-02-17T21:12:29.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:28 trial153 ceph-mon[25357]: pgmap v509: 129 pgs: 129 active+clean; 408 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 6.1 MiB/s wr, 253 op/s 2026-02-17T21:12:29.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 6104978 5262.00 MB/sec warmup 63 sec latency 1.565 ms 2026-02-17T21:12:29.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 15504 15.99 MB/sec warmup 63 sec latency 48.541 ms 2026-02-17T21:12:30.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:30 trial104 ceph-mon[20612]: pgmap v510: 129 pgs: 129 active+clean; 399 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 248 op/s 2026-02-17T21:12:30.773 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:30 trial153 ceph-mon[25357]: pgmap v510: 129 pgs: 129 active+clean; 399 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.7 MiB/s wr, 248 op/s 2026-02-17T21:12:30.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 6200264 5260.03 MB/sec warmup 64 sec latency 2.070 ms 2026-02-17T21:12:30.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 15751 16.03 MB/sec warmup 64 sec latency 53.665 ms 2026-02-17T21:12:31.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 6296477 5258.89 MB/sec warmup 65 sec latency 1.769 ms 2026-02-17T21:12:31.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 15974 15.81 MB/sec warmup 65 sec latency 45.410 ms 2026-02-17T21:12:32.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 6391297 5256.70 MB/sec warmup 66 sec latency 21.526 ms 2026-02-17T21:12:32.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 16215 15.61 MB/sec warmup 66 sec latency 40.366 ms 2026-02-17T21:12:33.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:32 trial104 ceph-mon[20612]: pgmap v511: 129 pgs: 129 active+clean; 398 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.2 MiB/s wr, 209 op/s 2026-02-17T21:12:33.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:32 trial153 ceph-mon[25357]: pgmap v511: 129 pgs: 129 active+clean; 398 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.2 MiB/s wr, 209 op/s 2026-02-17T21:12:33.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 6483657 5254.99 MB/sec warmup 67 sec latency 2.672 ms 2026-02-17T21:12:33.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 16449 15.47 MB/sec warmup 67 sec latency 43.042 ms 2026-02-17T21:12:34.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:12:34.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:12:34.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 6579487 5253.77 MB/sec warmup 68 sec latency 2.890 ms 2026-02-17T21:12:34.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 16678 15.43 MB/sec warmup 68 sec latency 45.464 ms 2026-02-17T21:12:35.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:34 trial104 ceph-mon[20612]: pgmap v512: 129 pgs: 129 active+clean; 391 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.7 MiB/s wr, 268 op/s 2026-02-17T21:12:35.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:34 trial153 ceph-mon[25357]: pgmap v512: 129 pgs: 129 active+clean; 391 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.7 MiB/s wr, 268 op/s 2026-02-17T21:12:35.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 6676068 5253.18 MB/sec warmup 69 sec latency 2.327 ms 2026-02-17T21:12:35.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 17019 15.73 MB/sec warmup 69 sec latency 41.836 ms 2026-02-17T21:12:36.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 6765478 5246.93 MB/sec warmup 70 sec latency 36.739 ms 2026-02-17T21:12:36.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 17402 15.88 MB/sec warmup 70 sec latency 42.297 ms 2026-02-17T21:12:37.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:36 trial104 ceph-mon[20612]: pgmap v513: 129 pgs: 129 active+clean; 393 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 286 op/s 2026-02-17T21:12:37.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:36 trial153 ceph-mon[25357]: pgmap v513: 129 pgs: 129 active+clean; 393 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 286 op/s 2026-02-17T21:12:37.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 6858155 5243.43 MB/sec warmup 71 sec latency 13.478 ms 2026-02-17T21:12:37.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 17589 15.88 MB/sec warmup 71 sec latency 34.276 ms 2026-02-17T21:12:38.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 6953437 5244.24 MB/sec warmup 72 sec latency 2.823 ms 2026-02-17T21:12:38.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 17851 16.02 MB/sec warmup 72 sec latency 40.114 ms 2026-02-17T21:12:39.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:38 trial104 ceph-mon[20612]: pgmap v514: 129 pgs: 129 active+clean; 397 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 4.7 MiB/s wr, 237 op/s 2026-02-17T21:12:39.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:38 trial153 ceph-mon[25357]: pgmap v514: 129 pgs: 129 active+clean; 397 MiB data, 3.1 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 4.7 MiB/s wr, 237 op/s 2026-02-17T21:12:39.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 7047454 5241.94 MB/sec warmup 73 sec latency 1.367 ms 2026-02-17T21:12:39.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 18045 15.94 MB/sec warmup 73 sec latency 59.259 ms 2026-02-17T21:12:40.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 7142969 5240.57 MB/sec warmup 74 sec latency 3.333 ms 2026-02-17T21:12:40.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 18185 15.75 MB/sec warmup 74 sec latency 47.505 ms 2026-02-17T21:12:41.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:40 trial104 ceph-mon[20612]: pgmap v515: 129 pgs: 129 active+clean; 419 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 293 op/s 2026-02-17T21:12:41.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:40 trial153 ceph-mon[25357]: pgmap v515: 129 pgs: 129 active+clean; 419 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 293 op/s 2026-02-17T21:12:41.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 7238673 5239.51 MB/sec warmup 75 sec latency 5.508 ms 2026-02-17T21:12:41.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 18357 15.56 MB/sec warmup 75 sec latency 47.135 ms 2026-02-17T21:12:42.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 7334527 5239.84 MB/sec warmup 76 sec latency 2.569 ms 2026-02-17T21:12:42.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 18605 15.43 MB/sec warmup 76 sec latency 46.790 ms 2026-02-17T21:12:43.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:42 trial104 ceph-mon[20612]: pgmap v516: 129 pgs: 129 active+clean; 420 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 5.6 MiB/s wr, 235 op/s 2026-02-17T21:12:43.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:42 trial153 ceph-mon[25357]: pgmap v516: 129 pgs: 129 active+clean; 420 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 5.6 MiB/s wr, 235 op/s 2026-02-17T21:12:43.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 7430548 5240.00 MB/sec warmup 77 sec latency 2.235 ms 2026-02-17T21:12:43.902 INFO:tasks.workunit.client.1.trial153.stdout: 10 18851 15.37 MB/sec warmup 77 sec latency 42.217 ms 2026-02-17T21:12:44.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 7527568 5239.95 MB/sec warmup 78 sec latency 2.807 ms 2026-02-17T21:12:44.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 19106 15.41 MB/sec warmup 78 sec latency 52.409 ms 2026-02-17T21:12:45.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:44 trial104 ceph-mon[20612]: pgmap v517: 129 pgs: 129 active+clean; 420 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 6.1 MiB/s wr, 222 op/s 2026-02-17T21:12:45.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:44 trial153 ceph-mon[25357]: pgmap v517: 129 pgs: 129 active+clean; 420 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 6.1 MiB/s wr, 222 op/s 2026-02-17T21:12:45.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 7625052 5240.08 MB/sec warmup 79 sec latency 2.634 ms 2026-02-17T21:12:45.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 19358 15.41 MB/sec warmup 79 sec latency 48.957 ms 2026-02-17T21:12:46.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 7720794 5239.13 MB/sec warmup 80 sec latency 17.659 ms 2026-02-17T21:12:46.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 19591 15.25 MB/sec warmup 80 sec latency 41.128 ms 2026-02-17T21:12:47.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:46 trial104 ceph-mon[20612]: pgmap v518: 129 pgs: 129 active+clean; 414 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 248 op/s 2026-02-17T21:12:47.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:46 trial153 ceph-mon[25357]: pgmap v518: 129 pgs: 129 active+clean; 414 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 248 op/s 2026-02-17T21:12:47.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 7814156 5238.53 MB/sec warmup 81 sec latency 16.148 ms 2026-02-17T21:12:47.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 19833 15.10 MB/sec warmup 81 sec latency 38.570 ms 2026-02-17T21:12:48.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 7912166 5239.13 MB/sec warmup 82 sec latency 3.190 ms 2026-02-17T21:12:48.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 20082 15.01 MB/sec warmup 82 sec latency 39.787 ms 2026-02-17T21:12:49.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:48 trial104 ceph-mon[20612]: pgmap v519: 129 pgs: 129 active+clean; 407 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 6.5 MiB/s wr, 232 op/s 2026-02-17T21:12:49.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:12:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:48 trial153 ceph-mon[25357]: pgmap v519: 129 pgs: 129 active+clean; 407 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 6.5 MiB/s wr, 232 op/s 2026-02-17T21:12:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:12:49.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 8010689 5240.01 MB/sec warmup 83 sec latency 1.597 ms 2026-02-17T21:12:49.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 20327 15.04 MB/sec warmup 83 sec latency 38.915 ms 2026-02-17T21:12:50.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 8109761 5241.22 MB/sec warmup 84 sec latency 1.894 ms 2026-02-17T21:12:50.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 20717 15.30 MB/sec warmup 84 sec latency 37.592 ms 2026-02-17T21:12:51.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:50 trial104 ceph-mon[20612]: pgmap v520: 129 pgs: 129 active+clean; 408 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 299 op/s 2026-02-17T21:12:51.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:50 trial153 ceph-mon[25357]: pgmap v520: 129 pgs: 129 active+clean; 408 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 299 op/s 2026-02-17T21:12:51.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 8207189 5241.39 MB/sec warmup 85 sec latency 7.223 ms 2026-02-17T21:12:51.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 21068 15.39 MB/sec warmup 85 sec latency 35.513 ms 2026-02-17T21:12:52.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 8302977 5242.43 MB/sec warmup 86 sec latency 8.745 ms 2026-02-17T21:12:52.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 21231 15.39 MB/sec warmup 86 sec latency 36.732 ms 2026-02-17T21:12:53.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:52 trial104 ceph-mon[20612]: pgmap v521: 129 pgs: 129 active+clean; 412 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 4.3 MiB/s wr, 228 op/s 2026-02-17T21:12:53.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:52 trial153 ceph-mon[25357]: pgmap v521: 129 pgs: 129 active+clean; 412 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 4.3 MiB/s wr, 228 op/s 2026-02-17T21:12:53.875 INFO:tasks.workunit.client.0.trial104.stdout: 10 8400778 5242.80 MB/sec warmup 87 sec latency 1.979 ms 2026-02-17T21:12:53.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 21484 15.48 MB/sec warmup 87 sec latency 43.391 ms 2026-02-17T21:12:54.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 8498982 5243.38 MB/sec warmup 88 sec latency 1.596 ms 2026-02-17T21:12:54.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 21663 15.40 MB/sec warmup 88 sec latency 52.296 ms 2026-02-17T21:12:55.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:54 trial104 ceph-mon[20612]: pgmap v522: 129 pgs: 129 active+clean; 413 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 5.2 MiB/s wr, 247 op/s 2026-02-17T21:12:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:54 trial153 ceph-mon[25357]: pgmap v522: 129 pgs: 129 active+clean; 413 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 5.2 MiB/s wr, 247 op/s 2026-02-17T21:12:55.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 8597412 5244.04 MB/sec warmup 89 sec latency 3.414 ms 2026-02-17T21:12:55.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 21808 15.25 MB/sec warmup 89 sec latency 51.581 ms 2026-02-17T21:12:56.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 8694314 5243.85 MB/sec warmup 90 sec latency 11.067 ms 2026-02-17T21:12:56.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 21995 15.10 MB/sec warmup 90 sec latency 45.021 ms 2026-02-17T21:12:57.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:56 trial104 ceph-mon[20612]: pgmap v523: 129 pgs: 129 active+clean; 410 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 288 op/s 2026-02-17T21:12:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:56 trial153 ceph-mon[25357]: pgmap v523: 129 pgs: 129 active+clean; 410 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 288 op/s 2026-02-17T21:12:57.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 8787415 5243.24 MB/sec warmup 91 sec latency 2.682 ms 2026-02-17T21:12:57.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 22253 15.03 MB/sec warmup 91 sec latency 53.704 ms 2026-02-17T21:12:58.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:57 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:12:58.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:57 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:12:58.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:57 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:12:58.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:57 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:12:58.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:57 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:12:58.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:57 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:12:58.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:57 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:12:58.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:57 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:12:58.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 8884572 5243.20 MB/sec warmup 92 sec latency 4.188 ms 2026-02-17T21:12:58.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 22506 15.04 MB/sec warmup 92 sec latency 48.493 ms 2026-02-17T21:12:59.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:12:58 trial104 ceph-mon[20612]: pgmap v524: 129 pgs: 129 active+clean; 414 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 6.0 MiB/s wr, 230 op/s 2026-02-17T21:12:59.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:12:58 trial153 ceph-mon[25357]: pgmap v524: 129 pgs: 129 active+clean; 414 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 5.0 KiB/s rd, 6.0 MiB/s wr, 230 op/s 2026-02-17T21:12:59.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 8981603 5243.11 MB/sec warmup 93 sec latency 1.556 ms 2026-02-17T21:12:59.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 22756 15.05 MB/sec warmup 93 sec latency 54.565 ms 2026-02-17T21:13:00.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 9079981 5243.68 MB/sec warmup 94 sec latency 2.559 ms 2026-02-17T21:13:00.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 22991 15.00 MB/sec warmup 94 sec latency 43.950 ms 2026-02-17T21:13:01.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:00 trial104 ceph-mon[20612]: pgmap v525: 129 pgs: 129 active+clean; 403 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 7.1 MiB/s wr, 291 op/s 2026-02-17T21:13:01.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:00 trial153 ceph-mon[25357]: pgmap v525: 129 pgs: 129 active+clean; 403 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 7.1 MiB/s wr, 291 op/s 2026-02-17T21:13:01.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 9176468 5244.90 MB/sec warmup 95 sec latency 2.377 ms 2026-02-17T21:13:01.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 23231 14.86 MB/sec warmup 95 sec latency 40.497 ms 2026-02-17T21:13:02.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 9272256 5244.23 MB/sec warmup 96 sec latency 13.437 ms 2026-02-17T21:13:02.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 23474 14.77 MB/sec warmup 96 sec latency 40.121 ms 2026-02-17T21:13:03.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:02 trial104 ceph-mon[20612]: pgmap v526: 129 pgs: 129 active+clean; 399 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 6.2 MiB/s wr, 218 op/s 2026-02-17T21:13:03.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:02 trial153 ceph-mon[25357]: pgmap v526: 129 pgs: 129 active+clean; 399 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 6.2 MiB/s wr, 218 op/s 2026-02-17T21:13:03.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 9368351 5243.56 MB/sec warmup 97 sec latency 16.659 ms 2026-02-17T21:13:03.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 23714 14.73 MB/sec warmup 97 sec latency 36.922 ms 2026-02-17T21:13:04.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:13:04.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:13:04.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 9466670 5244.18 MB/sec warmup 98 sec latency 1.558 ms 2026-02-17T21:13:04.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 23993 14.81 MB/sec warmup 98 sec latency 50.360 ms 2026-02-17T21:13:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:04 trial104 ceph-mon[20612]: pgmap v527: 129 pgs: 129 active+clean; 394 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 6.3 MiB/s wr, 242 op/s 2026-02-17T21:13:05.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:04 trial153 ceph-mon[25357]: pgmap v527: 129 pgs: 129 active+clean; 394 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 6.3 MiB/s wr, 242 op/s 2026-02-17T21:13:05.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 9565062 5244.77 MB/sec warmup 99 sec latency 2.592 ms 2026-02-17T21:13:05.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 24371 15.01 MB/sec warmup 99 sec latency 40.480 ms 2026-02-17T21:13:06.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 9661953 5246.25 MB/sec warmup 100 sec latency 2.240 ms 2026-02-17T21:13:06.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 24639 15.02 MB/sec warmup 100 sec latency 42.510 ms 2026-02-17T21:13:07.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:06 trial104 ceph-mon[20612]: pgmap v528: 129 pgs: 129 active+clean; 400 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 289 op/s 2026-02-17T21:13:07.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:06 trial153 ceph-mon[25357]: pgmap v528: 129 pgs: 129 active+clean; 400 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 289 op/s 2026-02-17T21:13:07.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 9760227 5246.71 MB/sec warmup 101 sec latency 1.786 ms 2026-02-17T21:13:07.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 24842 15.05 MB/sec warmup 101 sec latency 38.092 ms 2026-02-17T21:13:08.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 9858618 5247.35 MB/sec warmup 102 sec latency 2.154 ms 2026-02-17T21:13:08.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 25087 15.11 MB/sec warmup 102 sec latency 57.615 ms 2026-02-17T21:13:09.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:08 trial104 ceph-mon[20612]: pgmap v529: 129 pgs: 129 active+clean; 407 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 5.0 MiB/s wr, 245 op/s 2026-02-17T21:13:09.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:08 trial153 ceph-mon[25357]: pgmap v529: 129 pgs: 129 active+clean; 407 MiB data, 3.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 5.0 MiB/s wr, 245 op/s 2026-02-17T21:13:09.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 9956738 5247.74 MB/sec warmup 103 sec latency 2.271 ms 2026-02-17T21:13:09.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 25245 15.02 MB/sec warmup 103 sec latency 54.126 ms 2026-02-17T21:13:10.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 10054777 5248.12 MB/sec warmup 104 sec latency 2.553 ms 2026-02-17T21:13:10.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 25400 14.89 MB/sec warmup 104 sec latency 53.242 ms 2026-02-17T21:13:11.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:10 trial104 ceph-mon[20612]: pgmap v530: 129 pgs: 129 active+clean; 427 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 285 op/s 2026-02-17T21:13:11.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:10 trial153 ceph-mon[25357]: pgmap v530: 129 pgs: 129 active+clean; 427 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 285 op/s 2026-02-17T21:13:11.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 10146651 5246.88 MB/sec warmup 105 sec latency 28.498 ms 2026-02-17T21:13:11.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 25604 14.78 MB/sec warmup 105 sec latency 39.368 ms 2026-02-17T21:13:12.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 10240875 5245.36 MB/sec warmup 106 sec latency 2.017 ms 2026-02-17T21:13:12.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 25854 14.72 MB/sec warmup 106 sec latency 42.543 ms 2026-02-17T21:13:13.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:12 trial104 ceph-mon[20612]: pgmap v531: 129 pgs: 129 active+clean; 427 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 5.5 MiB/s wr, 204 op/s 2026-02-17T21:13:13.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:12 trial153 ceph-mon[25357]: pgmap v531: 129 pgs: 129 active+clean; 427 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 5.5 MiB/s wr, 204 op/s 2026-02-17T21:13:13.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 10336319 5244.39 MB/sec warmup 107 sec latency 3.172 ms 2026-02-17T21:13:13.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 26101 14.75 MB/sec warmup 107 sec latency 52.207 ms 2026-02-17T21:13:14.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 10431838 5243.53 MB/sec warmup 108 sec latency 1.647 ms 2026-02-17T21:13:14.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 26347 14.76 MB/sec warmup 108 sec latency 54.411 ms 2026-02-17T21:13:15.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:14 trial104 ceph-mon[20612]: pgmap v532: 129 pgs: 129 active+clean; 430 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 6.2 MiB/s wr, 211 op/s 2026-02-17T21:13:15.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:14 trial153 ceph-mon[25357]: pgmap v532: 129 pgs: 129 active+clean; 430 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 5.2 KiB/s rd, 6.2 MiB/s wr, 211 op/s 2026-02-17T21:13:15.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 10525963 5242.16 MB/sec warmup 109 sec latency 3.267 ms 2026-02-17T21:13:15.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 26578 14.69 MB/sec warmup 109 sec latency 46.601 ms 2026-02-17T21:13:16.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 10619542 5241.72 MB/sec warmup 110 sec latency 2.200 ms 2026-02-17T21:13:16.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 26817 14.58 MB/sec warmup 110 sec latency 48.755 ms 2026-02-17T21:13:17.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:16 trial104 ceph-mon[20612]: pgmap v533: 129 pgs: 129 active+clean; 424 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.9 MiB/s wr, 267 op/s 2026-02-17T21:13:17.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:16 trial153 ceph-mon[25357]: pgmap v533: 129 pgs: 129 active+clean; 424 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.9 MiB/s wr, 267 op/s 2026-02-17T21:13:17.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 10714647 5240.68 MB/sec warmup 111 sec latency 15.496 ms 2026-02-17T21:13:17.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 27056 14.51 MB/sec warmup 111 sec latency 39.454 ms 2026-02-17T21:13:18.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 10810007 5239.87 MB/sec warmup 112 sec latency 18.673 ms 2026-02-17T21:13:18.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 27298 14.48 MB/sec warmup 112 sec latency 51.753 ms 2026-02-17T21:13:19.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:18 trial104 ceph-mon[20612]: pgmap v534: 129 pgs: 129 active+clean; 416 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 6.3 MiB/s wr, 221 op/s 2026-02-17T21:13:19.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:13:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:18 trial153 ceph-mon[25357]: pgmap v534: 129 pgs: 129 active+clean; 416 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 6.3 MiB/s wr, 221 op/s 2026-02-17T21:13:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:13:19.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 10908216 5240.29 MB/sec warmup 113 sec latency 2.492 ms 2026-02-17T21:13:19.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 27608 14.58 MB/sec warmup 113 sec latency 49.677 ms 2026-02-17T21:13:20.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 11006215 5241.89 MB/sec warmup 114 sec latency 2.147 ms 2026-02-17T21:13:20.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 27982 14.74 MB/sec warmup 114 sec latency 40.060 ms 2026-02-17T21:13:21.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:20 trial104 ceph-mon[20612]: pgmap v535: 129 pgs: 129 active+clean; 396 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 296 op/s 2026-02-17T21:13:21.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:20 trial153 ceph-mon[25357]: pgmap v535: 129 pgs: 129 active+clean; 396 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 296 op/s 2026-02-17T21:13:21.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 11104464 5242.65 MB/sec warmup 115 sec latency 2.274 ms 2026-02-17T21:13:21.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 28219 14.75 MB/sec warmup 115 sec latency 39.605 ms 2026-02-17T21:13:22.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 11198874 5241.33 MB/sec warmup 116 sec latency 26.152 ms 2026-02-17T21:13:22.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 28446 14.81 MB/sec warmup 116 sec latency 48.780 ms 2026-02-17T21:13:23.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:22 trial104 ceph-mon[20612]: pgmap v536: 129 pgs: 129 active+clean; 397 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 4.3 MiB/s wr, 230 op/s 2026-02-17T21:13:23.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:22 trial153 ceph-mon[25357]: pgmap v536: 129 pgs: 129 active+clean; 397 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 4.3 MiB/s wr, 230 op/s 2026-02-17T21:13:23.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 11296358 5241.44 MB/sec warmup 117 sec latency 2.773 ms 2026-02-17T21:13:23.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 28677 14.83 MB/sec warmup 117 sec latency 61.733 ms 2026-02-17T21:13:24.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 11393891 5241.50 MB/sec warmup 118 sec latency 2.258 ms 2026-02-17T21:13:24.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 28830 14.74 MB/sec warmup 118 sec latency 58.765 ms 2026-02-17T21:13:25.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:24 trial104 ceph-mon[20612]: pgmap v537: 129 pgs: 129 active+clean; 405 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 5.5 MiB/s wr, 248 op/s 2026-02-17T21:13:25.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:24 trial153 ceph-mon[25357]: pgmap v537: 129 pgs: 129 active+clean; 405 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 5.5 MiB/s wr, 248 op/s 2026-02-17T21:13:25.876 INFO:tasks.workunit.client.0.trial104.stdout: 10 11490116 5242.38 MB/sec warmup 119 sec latency 4.268 ms 2026-02-17T21:13:25.903 INFO:tasks.workunit.client.1.trial153.stdout: 10 28995 14.63 MB/sec warmup 119 sec latency 51.913 ms 2026-02-17T21:13:27.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:26 trial104 ceph-mon[20612]: pgmap v538: 129 pgs: 129 active+clean; 418 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 288 op/s 2026-02-17T21:13:27.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:26 trial153 ceph-mon[25357]: pgmap v538: 129 pgs: 129 active+clean; 418 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 288 op/s 2026-02-17T21:13:27.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 11683369 5131.68 MB/sec execute 1 sec latency 2.493 ms 2026-02-17T21:13:27.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 29454 8.62 MB/sec execute 1 sec latency 49.192 ms 2026-02-17T21:13:28.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 11779509 5155.69 MB/sec execute 2 sec latency 23.030 ms 2026-02-17T21:13:28.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 29710 13.70 MB/sec execute 2 sec latency 39.186 ms 2026-02-17T21:13:29.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:28 trial104 ceph-mon[20612]: pgmap v539: 129 pgs: 129 active+clean; 418 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 5.9 MiB/s wr, 214 op/s 2026-02-17T21:13:29.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:28 trial153 ceph-mon[25357]: pgmap v539: 129 pgs: 129 active+clean; 418 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 5.1 KiB/s rd, 5.9 MiB/s wr, 214 op/s 2026-02-17T21:13:29.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 11877506 5197.41 MB/sec execute 3 sec latency 3.358 ms 2026-02-17T21:13:29.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 29965 15.39 MB/sec execute 3 sec latency 50.825 ms 2026-02-17T21:13:30.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 11974156 5244.37 MB/sec execute 4 sec latency 4.553 ms 2026-02-17T21:13:30.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 30183 12.02 MB/sec execute 4 sec latency 41.866 ms 2026-02-17T21:13:31.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:30 trial104 ceph-mon[20612]: pgmap v540: 129 pgs: 129 active+clean; 412 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 299 op/s 2026-02-17T21:13:31.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:30 trial153 ceph-mon[25357]: pgmap v540: 129 pgs: 129 active+clean; 412 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 299 op/s 2026-02-17T21:13:31.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 12072506 5255.90 MB/sec execute 5 sec latency 2.143 ms 2026-02-17T21:13:31.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 30414 10.25 MB/sec execute 5 sec latency 68.071 ms 2026-02-17T21:13:32.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 12169920 5255.62 MB/sec execute 6 sec latency 10.409 ms 2026-02-17T21:13:32.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 30652 9.74 MB/sec execute 6 sec latency 43.128 ms 2026-02-17T21:13:33.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:32 trial104 ceph-mon[20612]: pgmap v541: 129 pgs: 129 active+clean; 407 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.2 MiB/s wr, 221 op/s 2026-02-17T21:13:33.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:32 trial153 ceph-mon[25357]: pgmap v541: 129 pgs: 129 active+clean; 407 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.2 MiB/s wr, 221 op/s 2026-02-17T21:13:33.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 12267751 5258.07 MB/sec execute 7 sec latency 12.161 ms 2026-02-17T21:13:33.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 30894 10.29 MB/sec execute 7 sec latency 42.039 ms 2026-02-17T21:13:34.153 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:13:34.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:13:34.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 12366263 5268.64 MB/sec execute 8 sec latency 1.694 ms 2026-02-17T21:13:34.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 31220 12.30 MB/sec execute 8 sec latency 37.815 ms 2026-02-17T21:13:35.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:34 trial153 ceph-mon[25357]: pgmap v542: 129 pgs: 129 active+clean; 402 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.2 MiB/s wr, 241 op/s 2026-02-17T21:13:35.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:34 trial104 ceph-mon[20612]: pgmap v542: 129 pgs: 129 active+clean; 402 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.2 MiB/s wr, 241 op/s 2026-02-17T21:13:35.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 12463990 5283.40 MB/sec execute 9 sec latency 1.731 ms 2026-02-17T21:13:35.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 31574 14.45 MB/sec execute 9 sec latency 41.018 ms 2026-02-17T21:13:36.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 12562703 5287.64 MB/sec execute 10 sec latency 3.160 ms 2026-02-17T21:13:36.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 31804 14.54 MB/sec execute 10 sec latency 34.942 ms 2026-02-17T21:13:37.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:36 trial153 ceph-mon[25357]: pgmap v543: 129 pgs: 129 active+clean; 407 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.8 MiB/s wr, 284 op/s 2026-02-17T21:13:37.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:36 trial104 ceph-mon[20612]: pgmap v543: 129 pgs: 129 active+clean; 407 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.8 MiB/s wr, 284 op/s 2026-02-17T21:13:37.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 12658693 5277.19 MB/sec execute 11 sec latency 15.566 ms 2026-02-17T21:13:37.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 32027 15.10 MB/sec execute 11 sec latency 45.159 ms 2026-02-17T21:13:38.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 12756705 5278.20 MB/sec execute 12 sec latency 1.370 ms 2026-02-17T21:13:38.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 32250 15.16 MB/sec execute 12 sec latency 49.780 ms 2026-02-17T21:13:39.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:38 trial153 ceph-mon[25357]: pgmap v544: 129 pgs: 129 active+clean; 410 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 4.8 MiB/s wr, 243 op/s 2026-02-17T21:13:39.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:38 trial104 ceph-mon[20612]: pgmap v544: 129 pgs: 129 active+clean; 410 MiB data, 3.3 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 4.8 MiB/s wr, 243 op/s 2026-02-17T21:13:39.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 12854009 5287.33 MB/sec execute 13 sec latency 2.306 ms 2026-02-17T21:13:39.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 32399 14.25 MB/sec execute 13 sec latency 46.586 ms 2026-02-17T21:13:40.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 12952022 5288.28 MB/sec execute 14 sec latency 3.035 ms 2026-02-17T21:13:40.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 32572 13.38 MB/sec execute 14 sec latency 52.986 ms 2026-02-17T21:13:41.205 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:40 trial104 ceph-mon[20612]: pgmap v545: 129 pgs: 129 active+clean; 427 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 285 op/s 2026-02-17T21:13:41.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:40 trial153 ceph-mon[25357]: pgmap v545: 129 pgs: 129 active+clean; 427 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.7 MiB/s wr, 285 op/s 2026-02-17T21:13:41.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 13049504 5285.92 MB/sec execute 15 sec latency 2.513 ms 2026-02-17T21:13:41.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 32800 12.86 MB/sec execute 15 sec latency 44.507 ms 2026-02-17T21:13:42.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 13147069 5284.55 MB/sec execute 16 sec latency 2.609 ms 2026-02-17T21:13:42.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 33050 12.71 MB/sec execute 16 sec latency 47.220 ms 2026-02-17T21:13:43.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:42 trial153 ceph-mon[25357]: pgmap v546: 129 pgs: 129 active+clean; 432 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 5.6 MiB/s wr, 211 op/s 2026-02-17T21:13:43.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:42 trial104 ceph-mon[20612]: pgmap v546: 129 pgs: 129 active+clean; 432 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 5.6 MiB/s wr, 211 op/s 2026-02-17T21:13:43.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 13243286 5278.74 MB/sec execute 17 sec latency 12.459 ms 2026-02-17T21:13:43.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 33299 13.04 MB/sec execute 17 sec latency 54.857 ms 2026-02-17T21:13:44.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 13339067 5281.71 MB/sec execute 18 sec latency 2.418 ms 2026-02-17T21:13:44.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 33546 13.20 MB/sec execute 18 sec latency 44.648 ms 2026-02-17T21:13:45.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:44 trial153 ceph-mon[25357]: pgmap v547: 129 pgs: 129 active+clean; 437 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.6 MiB/s wr, 254 op/s 2026-02-17T21:13:45.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:44 trial104 ceph-mon[20612]: pgmap v547: 129 pgs: 129 active+clean; 437 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.6 MiB/s wr, 254 op/s 2026-02-17T21:13:45.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 13435996 5278.47 MB/sec execute 19 sec latency 1.542 ms 2026-02-17T21:13:45.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 33762 12.61 MB/sec execute 19 sec latency 41.489 ms 2026-02-17T21:13:46.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 13534334 5279.92 MB/sec execute 20 sec latency 2.198 ms 2026-02-17T21:13:46.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 34001 12.15 MB/sec execute 20 sec latency 43.064 ms 2026-02-17T21:13:47.272 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:46 trial104 ceph-mon[20612]: pgmap v548: 129 pgs: 129 active+clean; 421 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.8 MiB/s wr, 274 op/s 2026-02-17T21:13:47.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:46 trial153 ceph-mon[25357]: pgmap v548: 129 pgs: 129 active+clean; 421 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.8 MiB/s wr, 274 op/s 2026-02-17T21:13:47.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 13630975 5276.44 MB/sec execute 21 sec latency 2.456 ms 2026-02-17T21:13:47.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 34238 11.92 MB/sec execute 21 sec latency 39.610 ms 2026-02-17T21:13:48.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 13728150 5275.60 MB/sec execute 22 sec latency 11.499 ms 2026-02-17T21:13:48.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 34500 12.18 MB/sec execute 22 sec latency 39.716 ms 2026-02-17T21:13:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:48 trial153 ceph-mon[25357]: pgmap v549: 129 pgs: 129 active+clean; 417 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 233 op/s 2026-02-17T21:13:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:13:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:48 trial104 ceph-mon[20612]: pgmap v549: 129 pgs: 129 active+clean; 417 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 233 op/s 2026-02-17T21:13:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:13:49.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 13823793 5277.03 MB/sec execute 23 sec latency 11.514 ms 2026-02-17T21:13:49.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 34848 12.99 MB/sec execute 23 sec latency 39.981 ms 2026-02-17T21:13:50.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 13921395 5276.50 MB/sec execute 24 sec latency 4.637 ms 2026-02-17T21:13:50.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 35180 13.52 MB/sec execute 24 sec latency 36.414 ms 2026-02-17T21:13:51.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:50 trial153 ceph-mon[25357]: pgmap v550: 129 pgs: 129 active+clean; 402 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.9 MiB/s wr, 299 op/s 2026-02-17T21:13:51.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:50 trial104 ceph-mon[20612]: pgmap v550: 129 pgs: 129 active+clean; 402 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.9 MiB/s wr, 299 op/s 2026-02-17T21:13:51.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 14018719 5275.46 MB/sec execute 25 sec latency 2.633 ms 2026-02-17T21:13:51.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 35389 13.60 MB/sec execute 25 sec latency 64.397 ms 2026-02-17T21:13:52.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 14115786 5273.73 MB/sec execute 26 sec latency 11.420 ms 2026-02-17T21:13:52.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 35636 14.09 MB/sec execute 26 sec latency 44.768 ms 2026-02-17T21:13:53.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:52 trial153 ceph-mon[25357]: pgmap v551: 129 pgs: 129 active+clean; 405 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 254 op/s 2026-02-17T21:13:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:52 trial104 ceph-mon[20612]: pgmap v551: 129 pgs: 129 active+clean; 405 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 254 op/s 2026-02-17T21:13:53.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 14213279 5276.86 MB/sec execute 27 sec latency 2.661 ms 2026-02-17T21:13:53.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 35827 13.89 MB/sec execute 27 sec latency 58.178 ms 2026-02-17T21:13:54.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 14311004 5278.99 MB/sec execute 28 sec latency 1.442 ms 2026-02-17T21:13:54.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 35975 13.47 MB/sec execute 28 sec latency 42.094 ms 2026-02-17T21:13:55.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:54 trial153 ceph-mon[25357]: pgmap v552: 129 pgs: 129 active+clean; 413 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.3 KiB/s rd, 5.6 MiB/s wr, 238 op/s 2026-02-17T21:13:55.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:54 trial104 ceph-mon[20612]: pgmap v552: 129 pgs: 129 active+clean; 413 MiB data, 3.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.3 KiB/s rd, 5.6 MiB/s wr, 238 op/s 2026-02-17T21:13:55.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 14408433 5277.98 MB/sec execute 29 sec latency 2.510 ms 2026-02-17T21:13:55.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 36154 13.07 MB/sec execute 29 sec latency 48.863 ms 2026-02-17T21:13:56.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 14506229 5277.97 MB/sec execute 30 sec latency 2.390 ms 2026-02-17T21:13:56.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 36394 12.87 MB/sec execute 30 sec latency 46.900 ms 2026-02-17T21:13:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:56 trial153 ceph-mon[25357]: pgmap v553: 129 pgs: 129 active+clean; 425 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 8.3 KiB/s rd, 6.1 MiB/s wr, 243 op/s 2026-02-17T21:13:57.401 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:56 trial104 ceph-mon[20612]: pgmap v553: 129 pgs: 129 active+clean; 425 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 8.3 KiB/s rd, 6.1 MiB/s wr, 243 op/s 2026-02-17T21:13:57.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 14602325 5274.68 MB/sec execute 31 sec latency 2.251 ms 2026-02-17T21:13:57.904 INFO:tasks.workunit.client.1.trial153.stdout: 10 36645 12.90 MB/sec execute 31 sec latency 51.737 ms 2026-02-17T21:13:58.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:57 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:13:58.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:57 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:13:58.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 14695218 5271.07 MB/sec execute 32 sec latency 13.623 ms 2026-02-17T21:13:58.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 36877 12.91 MB/sec execute 32 sec latency 66.254 ms 2026-02-17T21:13:59.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:58 trial153 ceph-mon[25357]: pgmap v554: 129 pgs: 129 active+clean; 427 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 207 op/s 2026-02-17T21:13:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:58 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:13:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:58 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:13:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:13:58 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:13:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:58 trial104 ceph-mon[20612]: pgmap v554: 129 pgs: 129 active+clean; 427 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 207 op/s 2026-02-17T21:13:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:58 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:13:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:58 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:13:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:13:58 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:13:59.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 14792112 5270.41 MB/sec execute 33 sec latency 1.812 ms 2026-02-17T21:13:59.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 37136 13.01 MB/sec execute 33 sec latency 43.532 ms 2026-02-17T21:14:00.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 14890007 5270.32 MB/sec execute 34 sec latency 4.376 ms 2026-02-17T21:14:00.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 37360 12.69 MB/sec execute 34 sec latency 40.850 ms 2026-02-17T21:14:01.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:00 trial153 ceph-mon[25357]: pgmap v555: 129 pgs: 129 active+clean; 418 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 7.0 MiB/s wr, 286 op/s 2026-02-17T21:14:01.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:00 trial104 ceph-mon[20612]: pgmap v555: 129 pgs: 129 active+clean; 418 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 6.5 KiB/s rd, 7.0 MiB/s wr, 286 op/s 2026-02-17T21:14:01.877 INFO:tasks.workunit.client.0.trial104.stdout: 10 14988142 5271.10 MB/sec execute 35 sec latency 1.427 ms 2026-02-17T21:14:01.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 37609 12.48 MB/sec execute 35 sec latency 37.853 ms 2026-02-17T21:14:02.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 15084799 5269.52 MB/sec execute 36 sec latency 2.235 ms 2026-02-17T21:14:02.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 37846 12.37 MB/sec execute 36 sec latency 41.231 ms 2026-02-17T21:14:03.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:02 trial153 ceph-mon[25357]: pgmap v556: 129 pgs: 129 active+clean; 415 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 233 op/s 2026-02-17T21:14:03.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:02 trial104 ceph-mon[20612]: pgmap v556: 129 pgs: 129 active+clean; 415 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 233 op/s 2026-02-17T21:14:03.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 15179952 5269.89 MB/sec execute 37 sec latency 18.100 ms 2026-02-17T21:14:03.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 38118 12.60 MB/sec execute 37 sec latency 41.288 ms 2026-02-17T21:14:04.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:14:04.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:14:04.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 15275677 5267.21 MB/sec execute 38 sec latency 15.818 ms 2026-02-17T21:14:04.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 38487 13.06 MB/sec execute 38 sec latency 39.823 ms 2026-02-17T21:14:05.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:04 trial153 ceph-mon[25357]: pgmap v557: 129 pgs: 129 active+clean; 410 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.8 KiB/s rd, 6.0 MiB/s wr, 258 op/s 2026-02-17T21:14:05.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:04 trial104 ceph-mon[20612]: pgmap v557: 129 pgs: 129 active+clean; 410 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.8 KiB/s rd, 6.0 MiB/s wr, 258 op/s 2026-02-17T21:14:05.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 15373643 5267.57 MB/sec execute 39 sec latency 2.424 ms 2026-02-17T21:14:05.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 38806 13.33 MB/sec execute 39 sec latency 35.115 ms 2026-02-17T21:14:06.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 15471805 5268.31 MB/sec execute 40 sec latency 3.181 ms 2026-02-17T21:14:06.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 39004 13.49 MB/sec execute 40 sec latency 42.518 ms 2026-02-17T21:14:07.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:06 trial153 ceph-mon[25357]: pgmap v558: 129 pgs: 129 active+clean; 418 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.8 KiB/s rd, 5.5 MiB/s wr, 271 op/s 2026-02-17T21:14:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:06 trial104 ceph-mon[20612]: pgmap v558: 129 pgs: 129 active+clean; 418 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.8 KiB/s rd, 5.5 MiB/s wr, 271 op/s 2026-02-17T21:14:07.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 15569363 5268.95 MB/sec execute 41 sec latency 2.704 ms 2026-02-17T21:14:07.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 39238 13.65 MB/sec execute 41 sec latency 50.361 ms 2026-02-17T21:14:08.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 15663388 5267.55 MB/sec execute 42 sec latency 24.482 ms 2026-02-17T21:14:08.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 39413 13.49 MB/sec execute 42 sec latency 56.810 ms 2026-02-17T21:14:09.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:08 trial153 ceph-mon[25357]: pgmap v559: 129 pgs: 129 active+clean; 428 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 264 op/s 2026-02-17T21:14:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:08 trial104 ceph-mon[20612]: pgmap v559: 129 pgs: 129 active+clean; 428 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 264 op/s 2026-02-17T21:14:09.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 15762128 5268.68 MB/sec execute 43 sec latency 2.919 ms 2026-02-17T21:14:09.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 39573 13.23 MB/sec execute 43 sec latency 44.438 ms 2026-02-17T21:14:10.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 15858991 5267.72 MB/sec execute 44 sec latency 2.152 ms 2026-02-17T21:14:10.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 39768 12.99 MB/sec execute 44 sec latency 47.759 ms 2026-02-17T21:14:11.205 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:10 trial104 ceph-mon[20612]: pgmap v560: 129 pgs: 129 active+clean; 438 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.7 MiB/s wr, 285 op/s 2026-02-17T21:14:11.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:10 trial153 ceph-mon[25357]: pgmap v560: 129 pgs: 129 active+clean; 438 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.7 MiB/s wr, 285 op/s 2026-02-17T21:14:11.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 15956314 5266.98 MB/sec execute 45 sec latency 2.207 ms 2026-02-17T21:14:11.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 40021 12.89 MB/sec execute 45 sec latency 38.182 ms 2026-02-17T21:14:12.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 16052143 5268.03 MB/sec execute 46 sec latency 1.808 ms 2026-02-17T21:14:12.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 40273 12.95 MB/sec execute 46 sec latency 53.148 ms 2026-02-17T21:14:13.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:12 trial153 ceph-mon[25357]: pgmap v561: 129 pgs: 129 active+clean; 441 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 5.7 MiB/s wr, 207 op/s 2026-02-17T21:14:13.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:12 trial104 ceph-mon[20612]: pgmap v561: 129 pgs: 129 active+clean; 441 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 5.7 MiB/s wr, 207 op/s 2026-02-17T21:14:13.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 16148400 5266.79 MB/sec execute 47 sec latency 3.120 ms 2026-02-17T21:14:13.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 40513 12.99 MB/sec execute 47 sec latency 49.280 ms 2026-02-17T21:14:14.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 16244856 5265.46 MB/sec execute 48 sec latency 10.145 ms 2026-02-17T21:14:14.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 40748 12.94 MB/sec execute 48 sec latency 45.714 ms 2026-02-17T21:14:15.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:14 trial153 ceph-mon[25357]: pgmap v562: 129 pgs: 129 active+clean; 438 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 6.2 MiB/s wr, 201 op/s 2026-02-17T21:14:15.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:14 trial104 ceph-mon[20612]: pgmap v562: 129 pgs: 129 active+clean; 438 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 6.2 MiB/s wr, 201 op/s 2026-02-17T21:14:15.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 16342046 5265.00 MB/sec execute 49 sec latency 3.108 ms 2026-02-17T21:14:15.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 40986 12.72 MB/sec execute 49 sec latency 47.487 ms 2026-02-17T21:14:16.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 16439235 5264.47 MB/sec execute 50 sec latency 2.540 ms 2026-02-17T21:14:16.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 41212 12.59 MB/sec execute 50 sec latency 69.138 ms 2026-02-17T21:14:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:16 trial153 ceph-mon[25357]: pgmap v563: 129 pgs: 129 active+clean; 430 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 6.7 MiB/s wr, 257 op/s 2026-02-17T21:14:17.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:16 trial104 ceph-mon[20612]: pgmap v563: 129 pgs: 129 active+clean; 430 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 6.7 MiB/s wr, 257 op/s 2026-02-17T21:14:17.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 16535519 5265.89 MB/sec execute 51 sec latency 1.506 ms 2026-02-17T21:14:17.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 41457 12.53 MB/sec execute 51 sec latency 43.250 ms 2026-02-17T21:14:18.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 16632337 5265.41 MB/sec execute 52 sec latency 2.266 ms 2026-02-17T21:14:18.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 41763 12.81 MB/sec execute 52 sec latency 37.890 ms 2026-02-17T21:14:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:18 trial153 ceph-mon[25357]: pgmap v564: 129 pgs: 129 active+clean; 425 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 259 op/s 2026-02-17T21:14:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:14:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:18 trial104 ceph-mon[20612]: pgmap v564: 129 pgs: 129 active+clean; 425 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 259 op/s 2026-02-17T21:14:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:14:19.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 16728134 5263.54 MB/sec execute 53 sec latency 18.847 ms 2026-02-17T21:14:19.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 42135 13.18 MB/sec execute 53 sec latency 37.062 ms 2026-02-17T21:14:20.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 16823874 5261.63 MB/sec execute 54 sec latency 18.821 ms 2026-02-17T21:14:20.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 42412 13.30 MB/sec execute 54 sec latency 32.850 ms 2026-02-17T21:14:21.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:20 trial153 ceph-mon[25357]: pgmap v565: 129 pgs: 129 active+clean; 409 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.1 MiB/s wr, 259 op/s 2026-02-17T21:14:21.403 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:20 trial104 ceph-mon[20612]: pgmap v565: 129 pgs: 129 active+clean; 409 MiB data, 3.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.1 MiB/s wr, 259 op/s 2026-02-17T21:14:21.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 16921937 5262.49 MB/sec execute 55 sec latency 2.518 ms 2026-02-17T21:14:21.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 42604 13.32 MB/sec execute 55 sec latency 43.836 ms 2026-02-17T21:14:22.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 17019015 5264.63 MB/sec execute 56 sec latency 2.545 ms 2026-02-17T21:14:22.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 42839 13.46 MB/sec execute 56 sec latency 48.629 ms 2026-02-17T21:14:23.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:22 trial104 ceph-mon[20612]: pgmap v566: 129 pgs: 129 active+clean; 415 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.8 MiB/s wr, 262 op/s 2026-02-17T21:14:23.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:22 trial153 ceph-mon[25357]: pgmap v566: 129 pgs: 129 active+clean; 415 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.8 MiB/s wr, 262 op/s 2026-02-17T21:14:23.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 17117381 5265.37 MB/sec execute 57 sec latency 2.448 ms 2026-02-17T21:14:23.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 43004 13.31 MB/sec execute 57 sec latency 48.038 ms 2026-02-17T21:14:24.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 17212091 5262.62 MB/sec execute 58 sec latency 19.090 ms 2026-02-17T21:14:24.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 43178 13.12 MB/sec execute 58 sec latency 48.981 ms 2026-02-17T21:14:25.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:24 trial153 ceph-mon[25357]: pgmap v567: 129 pgs: 129 active+clean; 424 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 6.0 MiB/s wr, 254 op/s 2026-02-17T21:14:25.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:24 trial104 ceph-mon[20612]: pgmap v567: 129 pgs: 129 active+clean; 424 MiB data, 3.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 6.0 MiB/s wr, 254 op/s 2026-02-17T21:14:25.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 17309046 5261.96 MB/sec execute 59 sec latency 4.878 ms 2026-02-17T21:14:25.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 43384 12.98 MB/sec execute 59 sec latency 47.349 ms 2026-02-17T21:14:26.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 17404882 5260.85 MB/sec execute 60 sec latency 2.717 ms 2026-02-17T21:14:26.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 43632 12.89 MB/sec execute 60 sec latency 45.497 ms 2026-02-17T21:14:27.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:26 trial153 ceph-mon[25357]: pgmap v568: 129 pgs: 129 active+clean; 434 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 6.6 MiB/s wr, 279 op/s 2026-02-17T21:14:27.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:26 trial104 ceph-mon[20612]: pgmap v568: 129 pgs: 129 active+clean; 434 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 6.6 MiB/s wr, 279 op/s 2026-02-17T21:14:27.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 17499358 5260.40 MB/sec execute 61 sec latency 2.376 ms 2026-02-17T21:14:27.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 43886 12.99 MB/sec execute 61 sec latency 47.019 ms 2026-02-17T21:14:28.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 17594704 5258.40 MB/sec execute 62 sec latency 3.473 ms 2026-02-17T21:14:28.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 44132 12.99 MB/sec execute 62 sec latency 43.440 ms 2026-02-17T21:14:29.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:28 trial153 ceph-mon[25357]: pgmap v569: 129 pgs: 129 active+clean; 432 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 199 op/s 2026-02-17T21:14:29.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:28 trial104 ceph-mon[20612]: pgmap v569: 129 pgs: 129 active+clean; 432 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 199 op/s 2026-02-17T21:14:29.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 17689748 5256.29 MB/sec execute 63 sec latency 18.544 ms 2026-02-17T21:14:29.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 44366 12.90 MB/sec execute 63 sec latency 42.538 ms 2026-02-17T21:14:30.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 17783030 5252.87 MB/sec execute 64 sec latency 4.569 ms 2026-02-17T21:14:30.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 44599 12.75 MB/sec execute 64 sec latency 40.972 ms 2026-02-17T21:14:31.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:30 trial153 ceph-mon[25357]: pgmap v570: 129 pgs: 129 active+clean; 420 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 6.9 MiB/s wr, 260 op/s 2026-02-17T21:14:31.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:30 trial104 ceph-mon[20612]: pgmap v570: 129 pgs: 129 active+clean; 420 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.4 KiB/s rd, 6.9 MiB/s wr, 260 op/s 2026-02-17T21:14:31.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 17877854 5251.95 MB/sec execute 65 sec latency 2.302 ms 2026-02-17T21:14:31.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 44839 12.67 MB/sec execute 65 sec latency 37.790 ms 2026-02-17T21:14:32.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 17973877 5252.08 MB/sec execute 66 sec latency 1.502 ms 2026-02-17T21:14:32.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 45103 12.77 MB/sec execute 66 sec latency 47.025 ms 2026-02-17T21:14:33.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:32 trial104 ceph-mon[20612]: pgmap v571: 129 pgs: 129 active+clean; 422 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 255 op/s 2026-02-17T21:14:33.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:32 trial153 ceph-mon[25357]: pgmap v571: 129 pgs: 129 active+clean; 422 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 255 op/s 2026-02-17T21:14:33.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 18068417 5249.78 MB/sec execute 67 sec latency 2.899 ms 2026-02-17T21:14:33.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 45434 12.92 MB/sec execute 67 sec latency 41.003 ms 2026-02-17T21:14:34.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:14:34.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:14:34.878 INFO:tasks.workunit.client.0.trial104.stdout: 10 18156040 5242.06 MB/sec execute 68 sec latency 37.721 ms 2026-02-17T21:14:34.905 INFO:tasks.workunit.client.1.trial153.stdout: 10 45773 13.17 MB/sec execute 68 sec latency 37.900 ms 2026-02-17T21:14:35.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:34 trial153 ceph-mon[25357]: pgmap v572: 129 pgs: 129 active+clean; 419 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.0 MiB/s wr, 247 op/s 2026-02-17T21:14:35.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:34 trial104 ceph-mon[20612]: pgmap v572: 129 pgs: 129 active+clean; 419 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.0 MiB/s wr, 247 op/s 2026-02-17T21:14:35.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 18251530 5240.73 MB/sec execute 69 sec latency 24.109 ms 2026-02-17T21:14:35.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 46026 13.28 MB/sec execute 69 sec latency 38.001 ms 2026-02-17T21:14:36.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 18347372 5241.19 MB/sec execute 70 sec latency 2.997 ms 2026-02-17T21:14:36.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 46225 13.30 MB/sec execute 70 sec latency 43.308 ms 2026-02-17T21:14:37.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:36 trial153 ceph-mon[25357]: pgmap v573: 129 pgs: 129 active+clean; 430 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.6 MiB/s wr, 262 op/s 2026-02-17T21:14:37.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:36 trial104 ceph-mon[20612]: pgmap v573: 129 pgs: 129 active+clean; 430 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.6 MiB/s wr, 262 op/s 2026-02-17T21:14:37.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 18445300 5242.56 MB/sec execute 71 sec latency 3.424 ms 2026-02-17T21:14:37.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 46446 13.33 MB/sec execute 71 sec latency 56.216 ms 2026-02-17T21:14:38.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 18544422 5243.97 MB/sec execute 72 sec latency 1.751 ms 2026-02-17T21:14:38.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 46603 13.20 MB/sec execute 72 sec latency 44.012 ms 2026-02-17T21:14:39.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:38 trial153 ceph-mon[25357]: pgmap v574: 129 pgs: 129 active+clean; 438 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 268 op/s 2026-02-17T21:14:39.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:38 trial104 ceph-mon[20612]: pgmap v574: 129 pgs: 129 active+clean; 438 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 268 op/s 2026-02-17T21:14:39.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 18643037 5245.01 MB/sec execute 73 sec latency 2.408 ms 2026-02-17T21:14:39.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 46790 13.05 MB/sec execute 73 sec latency 44.743 ms 2026-02-17T21:14:40.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 18740597 5245.21 MB/sec execute 74 sec latency 3.583 ms 2026-02-17T21:14:40.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 47020 12.96 MB/sec execute 74 sec latency 47.311 ms 2026-02-17T21:14:41.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:40 trial153 ceph-mon[25357]: pgmap v575: 129 pgs: 129 active+clean; 449 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 7.0 MiB/s wr, 304 op/s 2026-02-17T21:14:41.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:40 trial104 ceph-mon[20612]: pgmap v575: 129 pgs: 129 active+clean; 449 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 7.0 MiB/s wr, 304 op/s 2026-02-17T21:14:41.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 18836402 5246.36 MB/sec execute 75 sec latency 2.841 ms 2026-02-17T21:14:41.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 47282 13.00 MB/sec execute 75 sec latency 44.686 ms 2026-02-17T21:14:42.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 18933887 5246.62 MB/sec execute 76 sec latency 4.902 ms 2026-02-17T21:14:42.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 47514 12.98 MB/sec execute 76 sec latency 45.110 ms 2026-02-17T21:14:43.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:42 trial153 ceph-mon[25357]: pgmap v576: 129 pgs: 129 active+clean; 452 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 248 op/s 2026-02-17T21:14:43.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:42 trial104 ceph-mon[20612]: pgmap v576: 129 pgs: 129 active+clean; 452 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 248 op/s 2026-02-17T21:14:43.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 19030203 5245.78 MB/sec execute 77 sec latency 2.429 ms 2026-02-17T21:14:43.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 47768 13.02 MB/sec execute 77 sec latency 41.985 ms 2026-02-17T21:14:44.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 19127020 5245.46 MB/sec execute 78 sec latency 2.166 ms 2026-02-17T21:14:44.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 47995 12.88 MB/sec execute 78 sec latency 42.089 ms 2026-02-17T21:14:45.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:44 trial153 ceph-mon[25357]: pgmap v577: 129 pgs: 129 active+clean; 446 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 6.6 MiB/s wr, 226 op/s 2026-02-17T21:14:45.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:44 trial104 ceph-mon[20612]: pgmap v577: 129 pgs: 129 active+clean; 446 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 6.6 MiB/s wr, 226 op/s 2026-02-17T21:14:45.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 19223234 5245.00 MB/sec execute 79 sec latency 3.308 ms 2026-02-17T21:14:45.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 48233 12.78 MB/sec execute 79 sec latency 61.472 ms 2026-02-17T21:14:46.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 19320033 5246.45 MB/sec execute 80 sec latency 2.111 ms 2026-02-17T21:14:46.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 48464 12.71 MB/sec execute 80 sec latency 47.228 ms 2026-02-17T21:14:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:46 trial153 ceph-mon[25357]: pgmap v578: 129 pgs: 129 active+clean; 410 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 6.4 MiB/s wr, 239 op/s 2026-02-17T21:14:47.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:46 trial104 ceph-mon[20612]: pgmap v578: 129 pgs: 129 active+clean; 410 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 6.4 MiB/s wr, 239 op/s 2026-02-17T21:14:47.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 19417240 5246.46 MB/sec execute 81 sec latency 2.844 ms 2026-02-17T21:14:47.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 48745 12.83 MB/sec execute 81 sec latency 39.665 ms 2026-02-17T21:14:48.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 19512589 5245.12 MB/sec execute 82 sec latency 6.970 ms 2026-02-17T21:14:48.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 49075 13.00 MB/sec execute 82 sec latency 68.805 ms 2026-02-17T21:14:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:48 trial153 ceph-mon[25357]: pgmap v579: 129 pgs: 129 active+clean; 413 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 279 op/s 2026-02-17T21:14:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:14:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:48 trial104 ceph-mon[20612]: pgmap v579: 129 pgs: 129 active+clean; 413 MiB data, 3.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 279 op/s 2026-02-17T21:14:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:14:49.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 19609311 5244.82 MB/sec execute 83 sec latency 17.053 ms 2026-02-17T21:14:49.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 49385 13.13 MB/sec execute 83 sec latency 37.200 ms 2026-02-17T21:14:50.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 19701924 5242.45 MB/sec execute 84 sec latency 38.525 ms 2026-02-17T21:14:50.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 49615 13.22 MB/sec execute 84 sec latency 36.959 ms 2026-02-17T21:14:51.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:50 trial153 ceph-mon[25357]: pgmap v580: 129 pgs: 129 active+clean; 425 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.3 MiB/s wr, 359 op/s 2026-02-17T21:14:51.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:50 trial104 ceph-mon[20612]: pgmap v580: 129 pgs: 129 active+clean; 425 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.3 MiB/s wr, 359 op/s 2026-02-17T21:14:51.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 19799157 5243.76 MB/sec execute 85 sec latency 1.960 ms 2026-02-17T21:14:51.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 49826 13.26 MB/sec execute 85 sec latency 45.467 ms 2026-02-17T21:14:52.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 19897068 5244.18 MB/sec execute 86 sec latency 1.142 ms 2026-02-17T21:14:52.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 50031 13.26 MB/sec execute 86 sec latency 50.487 ms 2026-02-17T21:14:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:52 trial153 ceph-mon[25357]: pgmap v581: 129 pgs: 129 active+clean; 432 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 5.1 MiB/s wr, 370 op/s 2026-02-17T21:14:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:52 trial104 ceph-mon[20612]: pgmap v581: 129 pgs: 129 active+clean; 432 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 5.1 MiB/s wr, 370 op/s 2026-02-17T21:14:53.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 19994610 5244.32 MB/sec execute 87 sec latency 1.671 ms 2026-02-17T21:14:53.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 50190 13.13 MB/sec execute 87 sec latency 53.508 ms 2026-02-17T21:14:54.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 20092872 5244.94 MB/sec execute 88 sec latency 1.872 ms 2026-02-17T21:14:54.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 50389 13.01 MB/sec execute 88 sec latency 44.467 ms 2026-02-17T21:14:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:54 trial153 ceph-mon[25357]: pgmap v582: 129 pgs: 129 active+clean; 437 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 5.9 MiB/s wr, 368 op/s 2026-02-17T21:14:55.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:54 trial104 ceph-mon[20612]: pgmap v582: 129 pgs: 129 active+clean; 437 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 5.9 MiB/s wr, 368 op/s 2026-02-17T21:14:55.879 INFO:tasks.workunit.client.0.trial104.stdout: 10 20187001 5244.82 MB/sec execute 89 sec latency 28.833 ms 2026-02-17T21:14:55.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 50617 12.95 MB/sec execute 89 sec latency 48.860 ms 2026-02-17T21:14:56.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 20283816 5244.65 MB/sec execute 90 sec latency 2.506 ms 2026-02-17T21:14:56.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 50870 12.97 MB/sec execute 90 sec latency 46.967 ms 2026-02-17T21:14:57.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:56 trial153 ceph-mon[25357]: pgmap v583: 129 pgs: 129 active+clean; 441 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 6.0 MiB/s wr, 359 op/s 2026-02-17T21:14:57.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:56 trial104 ceph-mon[20612]: pgmap v583: 129 pgs: 129 active+clean; 441 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 6.0 MiB/s wr, 359 op/s 2026-02-17T21:14:57.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 20381184 5244.76 MB/sec execute 91 sec latency 3.526 ms 2026-02-17T21:14:57.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 51100 12.95 MB/sec execute 91 sec latency 48.658 ms 2026-02-17T21:14:58.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 20476841 5243.73 MB/sec execute 92 sec latency 2.675 ms 2026-02-17T21:14:58.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 51358 12.98 MB/sec execute 92 sec latency 38.979 ms 2026-02-17T21:14:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:58 trial153 ceph-mon[25357]: pgmap v584: 129 pgs: 129 active+clean; 442 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.4 MiB/s wr, 369 op/s 2026-02-17T21:14:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:58 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:14:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:58 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:14:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:58 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:14:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:14:58 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:14:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:58 trial104 ceph-mon[20612]: pgmap v584: 129 pgs: 129 active+clean; 442 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.4 MiB/s wr, 369 op/s 2026-02-17T21:14:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:58 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:14:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:58 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:14:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:58 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:14:59.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:14:58 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:14:59.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 20574418 5244.12 MB/sec execute 93 sec latency 3.347 ms 2026-02-17T21:14:59.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 51589 12.87 MB/sec execute 93 sec latency 40.406 ms 2026-02-17T21:15:00.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 20670786 5245.28 MB/sec execute 94 sec latency 2.563 ms 2026-02-17T21:15:00.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 51842 12.80 MB/sec execute 94 sec latency 40.190 ms 2026-02-17T21:15:01.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:00 trial153 ceph-mon[25357]: pgmap v585: 129 pgs: 129 active+clean; 427 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.3 KiB/s rd, 6.9 MiB/s wr, 402 op/s 2026-02-17T21:15:01.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:00 trial104 ceph-mon[20612]: pgmap v585: 129 pgs: 129 active+clean; 427 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.3 KiB/s rd, 6.9 MiB/s wr, 402 op/s 2026-02-17T21:15:01.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 20768616 5245.53 MB/sec execute 95 sec latency 2.267 ms 2026-02-17T21:15:01.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 52077 12.76 MB/sec execute 95 sec latency 38.438 ms 2026-02-17T21:15:02.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 20866644 5245.89 MB/sec execute 96 sec latency 1.896 ms 2026-02-17T21:15:02.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 52363 12.87 MB/sec execute 96 sec latency 38.650 ms 2026-02-17T21:15:03.249 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:02 trial104 ceph-mon[20612]: pgmap v586: 129 pgs: 129 active+clean; 425 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 277 op/s 2026-02-17T21:15:03.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:02 trial153 ceph-mon[25357]: pgmap v586: 129 pgs: 129 active+clean; 425 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 277 op/s 2026-02-17T21:15:03.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 20964313 5246.08 MB/sec execute 97 sec latency 3.087 ms 2026-02-17T21:15:03.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 52737 13.10 MB/sec execute 97 sec latency 37.869 ms 2026-02-17T21:15:04.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:15:04.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:15:04.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 21062059 5246.60 MB/sec execute 98 sec latency 2.289 ms 2026-02-17T21:15:04.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 53035 13.18 MB/sec execute 98 sec latency 35.745 ms 2026-02-17T21:15:05.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:04 trial153 ceph-mon[25357]: pgmap v587: 129 pgs: 129 active+clean; 430 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.5 MiB/s wr, 244 op/s 2026-02-17T21:15:05.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:04 trial104 ceph-mon[20612]: pgmap v587: 129 pgs: 129 active+clean; 430 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.5 MiB/s wr, 244 op/s 2026-02-17T21:15:05.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 21153740 5244.93 MB/sec execute 99 sec latency 28.475 ms 2026-02-17T21:15:05.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 53219 13.19 MB/sec execute 99 sec latency 45.070 ms 2026-02-17T21:15:06.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 21250842 5244.94 MB/sec execute 100 sec latency 8.015 ms 2026-02-17T21:15:06.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 53448 13.25 MB/sec execute 100 sec latency 56.975 ms 2026-02-17T21:15:07.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:06 trial153 ceph-mon[25357]: pgmap v588: 129 pgs: 129 active+clean; 443 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.7 MiB/s wr, 264 op/s 2026-02-17T21:15:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:06 trial104 ceph-mon[20612]: pgmap v588: 129 pgs: 129 active+clean; 443 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.7 MiB/s wr, 264 op/s 2026-02-17T21:15:07.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 21349024 5245.46 MB/sec execute 101 sec latency 2.737 ms 2026-02-17T21:15:07.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 53618 13.18 MB/sec execute 101 sec latency 60.573 ms 2026-02-17T21:15:08.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 21446873 5245.69 MB/sec execute 102 sec latency 2.907 ms 2026-02-17T21:15:08.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 53788 13.08 MB/sec execute 102 sec latency 47.449 ms 2026-02-17T21:15:09.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:08 trial153 ceph-mon[25357]: pgmap v589: 129 pgs: 129 active+clean; 452 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 290 op/s 2026-02-17T21:15:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:08 trial104 ceph-mon[20612]: pgmap v589: 129 pgs: 129 active+clean; 452 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 290 op/s 2026-02-17T21:15:09.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 21544216 5246.51 MB/sec execute 103 sec latency 5.663 ms 2026-02-17T21:15:09.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 53991 12.99 MB/sec execute 103 sec latency 41.383 ms 2026-02-17T21:15:10.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 21640824 5247.04 MB/sec execute 104 sec latency 2.887 ms 2026-02-17T21:15:10.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 54238 12.93 MB/sec execute 104 sec latency 39.840 ms 2026-02-17T21:15:11.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:11 trial153 ceph-mon[25357]: pgmap v590: 129 pgs: 129 active+clean; 459 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 6.9 MiB/s wr, 284 op/s 2026-02-17T21:15:11.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:11 trial104 ceph-mon[20612]: pgmap v590: 129 pgs: 129 active+clean; 459 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 6.9 MiB/s wr, 284 op/s 2026-02-17T21:15:11.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 21738941 5247.40 MB/sec execute 105 sec latency 1.534 ms 2026-02-17T21:15:11.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 54497 13.00 MB/sec execute 105 sec latency 45.494 ms 2026-02-17T21:15:12.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 21835666 5247.10 MB/sec execute 106 sec latency 3.533 ms 2026-02-17T21:15:12.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 54731 12.98 MB/sec execute 106 sec latency 45.992 ms 2026-02-17T21:15:13.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:13 trial153 ceph-mon[25357]: pgmap v591: 129 pgs: 129 active+clean; 452 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 198 op/s 2026-02-17T21:15:13.376 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:13 trial104 ceph-mon[20612]: pgmap v591: 129 pgs: 129 active+clean; 452 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 198 op/s 2026-02-17T21:15:13.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 21933548 5247.37 MB/sec execute 107 sec latency 2.514 ms 2026-02-17T21:15:13.906 INFO:tasks.workunit.client.1.trial153.stdout: 10 54972 12.95 MB/sec execute 107 sec latency 40.456 ms 2026-02-17T21:15:14.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 22029924 5248.27 MB/sec execute 108 sec latency 5.138 ms 2026-02-17T21:15:14.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 55197 12.85 MB/sec execute 108 sec latency 48.510 ms 2026-02-17T21:15:15.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:15 trial153 ceph-mon[25357]: pgmap v592: 129 pgs: 129 active+clean; 448 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 6.7 MiB/s wr, 248 op/s 2026-02-17T21:15:15.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:15 trial104 ceph-mon[20612]: pgmap v592: 129 pgs: 129 active+clean; 448 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 6.7 MiB/s wr, 248 op/s 2026-02-17T21:15:15.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 22126463 5248.06 MB/sec execute 109 sec latency 2.231 ms 2026-02-17T21:15:15.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 55430 12.80 MB/sec execute 109 sec latency 40.929 ms 2026-02-17T21:15:16.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 22220602 5246.49 MB/sec execute 110 sec latency 1.913 ms 2026-02-17T21:15:16.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 55678 12.82 MB/sec execute 110 sec latency 60.556 ms 2026-02-17T21:15:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:17 trial153 ceph-mon[25357]: pgmap v593: 129 pgs: 129 active+clean; 417 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 6.4 MiB/s wr, 276 op/s 2026-02-17T21:15:17.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:17 trial104 ceph-mon[20612]: pgmap v593: 129 pgs: 129 active+clean; 417 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 6.4 MiB/s wr, 276 op/s 2026-02-17T21:15:17.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 22317629 5246.33 MB/sec execute 111 sec latency 4.467 ms 2026-02-17T21:15:17.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 55987 12.92 MB/sec execute 111 sec latency 39.719 ms 2026-02-17T21:15:18.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 22416313 5247.18 MB/sec execute 112 sec latency 2.011 ms 2026-02-17T21:15:18.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 56321 13.07 MB/sec execute 112 sec latency 36.948 ms 2026-02-17T21:15:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:19 trial153 ceph-mon[25357]: pgmap v594: 129 pgs: 129 active+clean; 414 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 241 op/s 2026-02-17T21:15:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:15:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:19 trial104 ceph-mon[20612]: pgmap v594: 129 pgs: 129 active+clean; 414 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 241 op/s 2026-02-17T21:15:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:15:19.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 22512680 5248.06 MB/sec execute 113 sec latency 2.736 ms 2026-02-17T21:15:19.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 56615 13.15 MB/sec execute 113 sec latency 34.393 ms 2026-02-17T21:15:20.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 22608061 5247.08 MB/sec execute 114 sec latency 18.203 ms 2026-02-17T21:15:20.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 56796 13.14 MB/sec execute 114 sec latency 46.266 ms 2026-02-17T21:15:21.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:21 trial153 ceph-mon[25357]: pgmap v595: 129 pgs: 129 active+clean; 432 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.3 MiB/s wr, 277 op/s 2026-02-17T21:15:21.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:21 trial104 ceph-mon[20612]: pgmap v595: 129 pgs: 129 active+clean; 432 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.3 MiB/s wr, 277 op/s 2026-02-17T21:15:21.880 INFO:tasks.workunit.client.0.trial104.stdout: 10 22703656 5246.26 MB/sec execute 115 sec latency 29.664 ms 2026-02-17T21:15:21.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 57017 13.19 MB/sec execute 115 sec latency 59.735 ms 2026-02-17T21:15:22.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 22801992 5246.78 MB/sec execute 116 sec latency 2.421 ms 2026-02-17T21:15:22.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 57190 13.13 MB/sec execute 116 sec latency 49.080 ms 2026-02-17T21:15:23.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:23 trial153 ceph-mon[25357]: pgmap v596: 129 pgs: 129 active+clean; 434 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 240 op/s 2026-02-17T21:15:23.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:23 trial104 ceph-mon[20612]: pgmap v596: 129 pgs: 129 active+clean; 434 MiB data, 3.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 240 op/s 2026-02-17T21:15:23.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 22899891 5247.39 MB/sec execute 117 sec latency 1.995 ms 2026-02-17T21:15:23.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 57369 13.04 MB/sec execute 117 sec latency 42.386 ms 2026-02-17T21:15:24.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 22996362 5248.09 MB/sec execute 118 sec latency 1.883 ms 2026-02-17T21:15:24.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 57574 12.98 MB/sec execute 118 sec latency 42.411 ms 2026-02-17T21:15:25.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:25 trial153 ceph-mon[25357]: pgmap v597: 129 pgs: 129 active+clean; 440 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 6.0 MiB/s wr, 237 op/s 2026-02-17T21:15:25.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:25 trial104 ceph-mon[20612]: pgmap v597: 129 pgs: 129 active+clean; 440 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 6.0 MiB/s wr, 237 op/s 2026-02-17T21:15:25.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 23092431 5247.52 MB/sec execute 119 sec latency 2.742 ms 2026-02-17T21:15:25.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 57819 12.95 MB/sec execute 119 sec latency 45.955 ms 2026-02-17T21:15:26.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 23189173 5247.25 MB/sec execute 120 sec latency 2.563 ms 2026-02-17T21:15:26.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 58064 12.97 MB/sec execute 120 sec latency 41.377 ms 2026-02-17T21:15:27.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:27 trial153 ceph-mon[25357]: pgmap v598: 129 pgs: 129 active+clean; 449 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 6.3 MiB/s wr, 241 op/s 2026-02-17T21:15:27.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:27 trial104 ceph-mon[20612]: pgmap v598: 129 pgs: 129 active+clean; 449 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 6.3 KiB/s rd, 6.3 MiB/s wr, 241 op/s 2026-02-17T21:15:27.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 23286772 5247.42 MB/sec execute 121 sec latency 3.255 ms 2026-02-17T21:15:27.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 58315 12.98 MB/sec execute 121 sec latency 46.005 ms 2026-02-17T21:15:28.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 23383392 5247.95 MB/sec execute 122 sec latency 2.590 ms 2026-02-17T21:15:28.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 58546 12.93 MB/sec execute 122 sec latency 43.326 ms 2026-02-17T21:15:29.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:29 trial153 ceph-mon[25357]: pgmap v599: 129 pgs: 129 active+clean; 445 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 210 op/s 2026-02-17T21:15:29.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:29 trial104 ceph-mon[20612]: pgmap v599: 129 pgs: 129 active+clean; 445 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 210 op/s 2026-02-17T21:15:29.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 23481619 5248.86 MB/sec execute 123 sec latency 1.660 ms 2026-02-17T21:15:29.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 58780 12.86 MB/sec execute 123 sec latency 43.120 ms 2026-02-17T21:15:30.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 23579489 5249.02 MB/sec execute 124 sec latency 2.011 ms 2026-02-17T21:15:30.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 59012 12.80 MB/sec execute 124 sec latency 40.200 ms 2026-02-17T21:15:31.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:31 trial153 ceph-mon[25357]: pgmap v600: 129 pgs: 129 active+clean; 428 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.0 KiB/s rd, 7.0 MiB/s wr, 296 op/s 2026-02-17T21:15:31.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:31 trial104 ceph-mon[20612]: pgmap v600: 129 pgs: 129 active+clean; 428 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.0 KiB/s rd, 7.0 MiB/s wr, 296 op/s 2026-02-17T21:15:31.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 23675746 5248.57 MB/sec execute 125 sec latency 17.510 ms 2026-02-17T21:15:31.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 59295 12.86 MB/sec execute 125 sec latency 39.655 ms 2026-02-17T21:15:32.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 23773405 5248.70 MB/sec execute 126 sec latency 1.890 ms 2026-02-17T21:15:32.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 59598 12.93 MB/sec execute 126 sec latency 39.542 ms 2026-02-17T21:15:33.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:33 trial153 ceph-mon[25357]: pgmap v601: 129 pgs: 129 active+clean; 428 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 226 op/s 2026-02-17T21:15:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:33 trial104 ceph-mon[20612]: pgmap v601: 129 pgs: 129 active+clean; 428 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 226 op/s 2026-02-17T21:15:33.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 23869899 5249.57 MB/sec execute 127 sec latency 3.302 ms 2026-02-17T21:15:33.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 59916 13.05 MB/sec execute 127 sec latency 35.078 ms 2026-02-17T21:15:34.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:34 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:15:34.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:34 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:15:34.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 23966101 5249.18 MB/sec execute 128 sec latency 2.616 ms 2026-02-17T21:15:34.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 60205 13.13 MB/sec execute 128 sec latency 34.272 ms 2026-02-17T21:15:35.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:35 trial104 ceph-mon[20612]: pgmap v602: 129 pgs: 129 active+clean; 436 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.7 MiB/s wr, 249 op/s 2026-02-17T21:15:35.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:35 trial153 ceph-mon[25357]: pgmap v602: 129 pgs: 129 active+clean; 436 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.7 MiB/s wr, 249 op/s 2026-02-17T21:15:35.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 24057345 5246.63 MB/sec execute 129 sec latency 23.075 ms 2026-02-17T21:15:35.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 60397 13.15 MB/sec execute 129 sec latency 44.798 ms 2026-02-17T21:15:36.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 24148926 5244.27 MB/sec execute 130 sec latency 60.438 ms 2026-02-17T21:15:36.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 60614 13.16 MB/sec execute 130 sec latency 47.385 ms 2026-02-17T21:15:37.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:37 trial153 ceph-mon[25357]: pgmap v603: 129 pgs: 129 active+clean; 449 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.8 MiB/s wr, 271 op/s 2026-02-17T21:15:37.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:37 trial104 ceph-mon[20612]: pgmap v603: 129 pgs: 129 active+clean; 449 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.8 MiB/s wr, 271 op/s 2026-02-17T21:15:37.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 24246835 5244.61 MB/sec execute 131 sec latency 2.636 ms 2026-02-17T21:15:37.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 60785 13.09 MB/sec execute 131 sec latency 49.826 ms 2026-02-17T21:15:38.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 24341985 5244.91 MB/sec execute 132 sec latency 2.859 ms 2026-02-17T21:15:38.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 60974 13.01 MB/sec execute 132 sec latency 44.312 ms 2026-02-17T21:15:39.029 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:39 trial104 ceph-mon[20612]: pgmap v604: 129 pgs: 129 active+clean; 456 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 258 op/s 2026-02-17T21:15:39.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:39 trial153 ceph-mon[25357]: pgmap v604: 129 pgs: 129 active+clean; 456 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 258 op/s 2026-02-17T21:15:39.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 24439153 5244.90 MB/sec execute 133 sec latency 2.206 ms 2026-02-17T21:15:39.907 INFO:tasks.workunit.client.1.trial153.stdout: 10 61188 12.96 MB/sec execute 133 sec latency 45.954 ms 2026-02-17T21:15:40.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 24535890 5244.66 MB/sec execute 134 sec latency 2.816 ms 2026-02-17T21:15:40.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 61449 12.97 MB/sec execute 134 sec latency 45.857 ms 2026-02-17T21:15:41.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:41 trial104 ceph-mon[20612]: pgmap v605: 129 pgs: 129 active+clean; 448 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 6.7 MiB/s wr, 272 op/s 2026-02-17T21:15:41.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:41 trial153 ceph-mon[25357]: pgmap v605: 129 pgs: 129 active+clean; 448 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 6.7 MiB/s wr, 272 op/s 2026-02-17T21:15:41.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 24632666 5244.42 MB/sec execute 135 sec latency 2.998 ms 2026-02-17T21:15:41.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 61680 12.96 MB/sec execute 135 sec latency 45.781 ms 2026-02-17T21:15:42.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 24730748 5244.90 MB/sec execute 136 sec latency 3.680 ms 2026-02-17T21:15:42.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 61945 13.00 MB/sec execute 136 sec latency 42.889 ms 2026-02-17T21:15:43.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:43 trial104 ceph-mon[20612]: pgmap v606: 129 pgs: 129 active+clean; 437 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 5.9 MiB/s wr, 192 op/s 2026-02-17T21:15:43.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:43 trial153 ceph-mon[25357]: pgmap v606: 129 pgs: 129 active+clean; 437 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 5.9 MiB/s wr, 192 op/s 2026-02-17T21:15:43.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 24827405 5245.74 MB/sec execute 137 sec latency 1.854 ms 2026-02-17T21:15:43.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 62167 12.92 MB/sec execute 137 sec latency 37.409 ms 2026-02-17T21:15:44.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 24925575 5246.14 MB/sec execute 138 sec latency 2.016 ms 2026-02-17T21:15:44.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 62406 12.86 MB/sec execute 138 sec latency 41.939 ms 2026-02-17T21:15:45.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:45 trial104 ceph-mon[20612]: pgmap v607: 129 pgs: 129 active+clean; 424 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 6.4 MiB/s wr, 215 op/s 2026-02-17T21:15:45.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:45 trial153 ceph-mon[25357]: pgmap v607: 129 pgs: 129 active+clean; 424 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 6.4 MiB/s wr, 215 op/s 2026-02-17T21:15:45.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 25023316 5246.30 MB/sec execute 139 sec latency 2.062 ms 2026-02-17T21:15:45.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 62642 12.82 MB/sec execute 139 sec latency 39.280 ms 2026-02-17T21:15:46.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 25119150 5245.76 MB/sec execute 140 sec latency 18.013 ms 2026-02-17T21:15:46.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 62941 12.91 MB/sec execute 140 sec latency 39.380 ms 2026-02-17T21:15:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:47 trial153 ceph-mon[25357]: pgmap v608: 129 pgs: 129 active+clean; 416 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 6.2 MiB/s wr, 273 op/s 2026-02-17T21:15:47.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:47 trial104 ceph-mon[20612]: pgmap v608: 129 pgs: 129 active+clean; 416 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 6.2 MiB/s wr, 273 op/s 2026-02-17T21:15:47.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 25215607 5246.03 MB/sec execute 141 sec latency 9.812 ms 2026-02-17T21:15:47.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 63239 12.95 MB/sec execute 141 sec latency 40.664 ms 2026-02-17T21:15:48.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 25312292 5246.33 MB/sec execute 142 sec latency 3.625 ms 2026-02-17T21:15:48.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 63569 13.07 MB/sec execute 142 sec latency 35.167 ms 2026-02-17T21:15:49.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:49 trial104 ceph-mon[20612]: pgmap v609: 129 pgs: 129 active+clean; 417 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 255 op/s 2026-02-17T21:15:49.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:49 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:15:49.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:49 trial153 ceph-mon[25357]: pgmap v609: 129 pgs: 129 active+clean; 417 MiB data, 3.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 255 op/s 2026-02-17T21:15:49.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:49 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:15:49.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 25409912 5246.44 MB/sec execute 143 sec latency 2.101 ms 2026-02-17T21:15:49.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 63810 13.11 MB/sec execute 143 sec latency 43.687 ms 2026-02-17T21:15:50.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 25507805 5246.66 MB/sec execute 144 sec latency 2.299 ms 2026-02-17T21:15:50.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 64001 13.13 MB/sec execute 144 sec latency 39.707 ms 2026-02-17T21:15:51.325 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:51 trial153 ceph-mon[25357]: pgmap v610: 129 pgs: 129 active+clean; 437 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 6.4 MiB/s wr, 279 op/s 2026-02-17T21:15:51.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:51 trial104 ceph-mon[20612]: pgmap v610: 129 pgs: 129 active+clean; 437 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 6.4 MiB/s wr, 279 op/s 2026-02-17T21:15:51.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 25602518 5245.70 MB/sec execute 145 sec latency 34.686 ms 2026-02-17T21:15:51.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 64211 13.12 MB/sec execute 145 sec latency 49.249 ms 2026-02-17T21:15:52.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 25699810 5246.67 MB/sec execute 146 sec latency 2.753 ms 2026-02-17T21:15:52.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 64390 13.07 MB/sec execute 146 sec latency 46.171 ms 2026-02-17T21:15:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:53 trial104 ceph-mon[20612]: pgmap v611: 129 pgs: 129 active+clean; 440 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 255 op/s 2026-02-17T21:15:53.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:53 trial153 ceph-mon[25357]: pgmap v611: 129 pgs: 129 active+clean; 440 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 255 op/s 2026-02-17T21:15:53.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 25797119 5246.84 MB/sec execute 147 sec latency 1.920 ms 2026-02-17T21:15:53.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 64576 13.01 MB/sec execute 147 sec latency 47.194 ms 2026-02-17T21:15:54.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 25894082 5246.74 MB/sec execute 148 sec latency 3.001 ms 2026-02-17T21:15:54.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 64796 12.95 MB/sec execute 148 sec latency 57.907 ms 2026-02-17T21:15:55.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:55 trial104 ceph-mon[20612]: pgmap v612: 129 pgs: 129 active+clean; 443 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 6.1 MiB/s wr, 243 op/s 2026-02-17T21:15:55.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:55 trial153 ceph-mon[25357]: pgmap v612: 129 pgs: 129 active+clean; 443 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 6.1 MiB/s wr, 243 op/s 2026-02-17T21:15:55.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 25991647 5246.87 MB/sec execute 149 sec latency 3.071 ms 2026-02-17T21:15:55.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 65057 12.97 MB/sec execute 149 sec latency 46.901 ms 2026-02-17T21:15:56.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 26086505 5246.00 MB/sec execute 150 sec latency 21.800 ms 2026-02-17T21:15:56.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 65296 12.95 MB/sec execute 150 sec latency 39.911 ms 2026-02-17T21:15:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:57 trial153 ceph-mon[25357]: pgmap v613: 129 pgs: 129 active+clean; 447 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 6.4 MiB/s wr, 248 op/s 2026-02-17T21:15:57.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:57 trial104 ceph-mon[20612]: pgmap v613: 129 pgs: 129 active+clean; 447 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 6.4 MiB/s wr, 248 op/s 2026-02-17T21:15:57.881 INFO:tasks.workunit.client.0.trial104.stdout: 10 26183264 5246.83 MB/sec execute 151 sec latency 2.308 ms 2026-02-17T21:15:57.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 65549 12.98 MB/sec execute 151 sec latency 41.920 ms 2026-02-17T21:15:58.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 26281351 5247.09 MB/sec execute 152 sec latency 2.048 ms 2026-02-17T21:15:58.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 65784 12.91 MB/sec execute 152 sec latency 45.720 ms 2026-02-17T21:15:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:59 trial104 ceph-mon[20612]: pgmap v614: 129 pgs: 129 active+clean; 444 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 212 op/s 2026-02-17T21:15:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:59 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:15:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:59 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:15:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:59 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:15:59.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:15:59 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:15:59.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:59 trial153 ceph-mon[25357]: pgmap v614: 129 pgs: 129 active+clean; 444 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 212 op/s 2026-02-17T21:15:59.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:59 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:15:59.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:59 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:15:59.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:59 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:15:59.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:15:59 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:15:59.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 26379419 5247.40 MB/sec execute 153 sec latency 2.428 ms 2026-02-17T21:15:59.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 66016 12.87 MB/sec execute 153 sec latency 39.975 ms 2026-02-17T21:16:00.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 26477165 5247.54 MB/sec execute 154 sec latency 2.158 ms 2026-02-17T21:16:00.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 66267 12.86 MB/sec execute 154 sec latency 41.239 ms 2026-02-17T21:16:01.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:01 trial104 ceph-mon[20612]: pgmap v615: 129 pgs: 129 active+clean; 430 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 7.0 MiB/s wr, 300 op/s 2026-02-17T21:16:01.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:01 trial153 ceph-mon[25357]: pgmap v615: 129 pgs: 129 active+clean; 430 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 7.0 MiB/s wr, 300 op/s 2026-02-17T21:16:01.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 26574761 5247.91 MB/sec execute 155 sec latency 2.713 ms 2026-02-17T21:16:01.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 66585 12.93 MB/sec execute 155 sec latency 41.428 ms 2026-02-17T21:16:02.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 26672186 5248.67 MB/sec execute 156 sec latency 11.336 ms 2026-02-17T21:16:02.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 66858 13.01 MB/sec execute 156 sec latency 36.123 ms 2026-02-17T21:16:03.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:03 trial104 ceph-mon[20612]: pgmap v616: 129 pgs: 129 active+clean; 431 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.8 MiB/s wr, 232 op/s 2026-02-17T21:16:03.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:03 trial153 ceph-mon[25357]: pgmap v616: 129 pgs: 129 active+clean; 431 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.8 MiB/s wr, 232 op/s 2026-02-17T21:16:03.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 26770676 5249.13 MB/sec execute 157 sec latency 2.956 ms 2026-02-17T21:16:03.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 67215 13.10 MB/sec execute 157 sec latency 41.729 ms 2026-02-17T21:16:04.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:16:04.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:16:04.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 26868626 5249.31 MB/sec execute 158 sec latency 2.283 ms 2026-02-17T21:16:04.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 67408 13.11 MB/sec execute 158 sec latency 42.301 ms 2026-02-17T21:16:05.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:05 trial104 ceph-mon[20612]: pgmap v617: 129 pgs: 129 active+clean; 436 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.3 MiB/s wr, 250 op/s 2026-02-17T21:16:05.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:05 trial153 ceph-mon[25357]: pgmap v617: 129 pgs: 129 active+clean; 436 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.3 MiB/s wr, 250 op/s 2026-02-17T21:16:05.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 26966816 5249.58 MB/sec execute 159 sec latency 1.971 ms 2026-02-17T21:16:05.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 67613 13.14 MB/sec execute 159 sec latency 43.999 ms 2026-02-17T21:16:06.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 27063162 5250.09 MB/sec execute 160 sec latency 12.015 ms 2026-02-17T21:16:06.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 67809 13.10 MB/sec execute 160 sec latency 51.073 ms 2026-02-17T21:16:07.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:07 trial153 ceph-mon[25357]: pgmap v618: 129 pgs: 129 active+clean; 453 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.0 MiB/s wr, 284 op/s 2026-02-17T21:16:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:07 trial104 ceph-mon[20612]: pgmap v618: 129 pgs: 129 active+clean; 453 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.0 MiB/s wr, 284 op/s 2026-02-17T21:16:07.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 27158828 5249.68 MB/sec execute 161 sec latency 28.493 ms 2026-02-17T21:16:07.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 67990 13.04 MB/sec execute 161 sec latency 54.524 ms 2026-02-17T21:16:08.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 27256058 5249.70 MB/sec execute 162 sec latency 2.909 ms 2026-02-17T21:16:08.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 68178 12.99 MB/sec execute 162 sec latency 44.544 ms 2026-02-17T21:16:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:09 trial104 ceph-mon[20612]: pgmap v619: 129 pgs: 129 active+clean; 456 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 5.9 MiB/s wr, 258 op/s 2026-02-17T21:16:09.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:09 trial153 ceph-mon[25357]: pgmap v619: 129 pgs: 129 active+clean; 456 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 5.9 MiB/s wr, 258 op/s 2026-02-17T21:16:09.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 27353412 5249.71 MB/sec execute 163 sec latency 3.886 ms 2026-02-17T21:16:09.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 68420 12.98 MB/sec execute 163 sec latency 43.717 ms 2026-02-17T21:16:10.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 27449605 5249.40 MB/sec execute 164 sec latency 3.014 ms 2026-02-17T21:16:10.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 68677 12.98 MB/sec execute 164 sec latency 45.715 ms 2026-02-17T21:16:11.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:11 trial104 ceph-mon[20612]: pgmap v620: 129 pgs: 129 active+clean; 438 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.5 KiB/s rd, 7.0 MiB/s wr, 292 op/s 2026-02-17T21:16:11.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:11 trial153 ceph-mon[25357]: pgmap v620: 129 pgs: 129 active+clean; 438 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.5 KiB/s rd, 7.0 MiB/s wr, 292 op/s 2026-02-17T21:16:11.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 27545324 5249.67 MB/sec execute 165 sec latency 3.298 ms 2026-02-17T21:16:11.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 68912 12.94 MB/sec execute 165 sec latency 48.245 ms 2026-02-17T21:16:12.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 27643074 5249.90 MB/sec execute 166 sec latency 2.200 ms 2026-02-17T21:16:12.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 69173 12.96 MB/sec execute 166 sec latency 39.516 ms 2026-02-17T21:16:13.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:13 trial104 ceph-mon[20612]: pgmap v621: 129 pgs: 129 active+clean; 432 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 196 op/s 2026-02-17T21:16:13.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:13 trial153 ceph-mon[25357]: pgmap v621: 129 pgs: 129 active+clean; 432 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 196 op/s 2026-02-17T21:16:13.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 27739819 5249.71 MB/sec execute 167 sec latency 2.484 ms 2026-02-17T21:16:13.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 69413 12.91 MB/sec execute 167 sec latency 40.744 ms 2026-02-17T21:16:14.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 27837699 5249.86 MB/sec execute 168 sec latency 2.484 ms 2026-02-17T21:16:14.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 69636 12.87 MB/sec execute 168 sec latency 39.731 ms 2026-02-17T21:16:15.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:15 trial104 ceph-mon[20612]: pgmap v622: 129 pgs: 129 active+clean; 425 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 218 op/s 2026-02-17T21:16:15.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:15 trial153 ceph-mon[25357]: pgmap v622: 129 pgs: 129 active+clean; 425 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 218 op/s 2026-02-17T21:16:15.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 27933583 5249.59 MB/sec execute 169 sec latency 1.859 ms 2026-02-17T21:16:15.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 69911 12.90 MB/sec execute 169 sec latency 44.376 ms 2026-02-17T21:16:16.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 28022983 5247.83 MB/sec execute 170 sec latency 32.301 ms 2026-02-17T21:16:16.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 70225 12.96 MB/sec execute 170 sec latency 39.031 ms 2026-02-17T21:16:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:17 trial153 ceph-mon[25357]: pgmap v623: 129 pgs: 129 active+clean; 417 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.3 MiB/s wr, 276 op/s 2026-02-17T21:16:17.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:17 trial104 ceph-mon[20612]: pgmap v623: 129 pgs: 129 active+clean; 417 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 10 KiB/s rd, 6.3 MiB/s wr, 276 op/s 2026-02-17T21:16:17.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 28114095 5245.95 MB/sec execute 171 sec latency 51.085 ms 2026-02-17T21:16:17.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 70519 13.04 MB/sec execute 171 sec latency 35.901 ms 2026-02-17T21:16:18.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 28211485 5245.91 MB/sec execute 172 sec latency 4.136 ms 2026-02-17T21:16:18.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 70848 13.11 MB/sec execute 172 sec latency 46.628 ms 2026-02-17T21:16:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:19 trial104 ceph-mon[20612]: pgmap v624: 129 pgs: 129 active+clean; 421 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 264 op/s 2026-02-17T21:16:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:16:19.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:19 trial153 ceph-mon[25357]: pgmap v624: 129 pgs: 129 active+clean; 421 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 264 op/s 2026-02-17T21:16:19.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:16:19.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 28308863 5245.95 MB/sec execute 173 sec latency 2.256 ms 2026-02-17T21:16:19.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 71001 13.09 MB/sec execute 173 sec latency 36.007 ms 2026-02-17T21:16:20.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 28406369 5246.17 MB/sec execute 174 sec latency 1.819 ms 2026-02-17T21:16:20.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 71220 13.11 MB/sec execute 174 sec latency 41.670 ms 2026-02-17T21:16:21.324 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:21 trial153 ceph-mon[25357]: pgmap v625: 129 pgs: 129 active+clean; 439 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 6.7 MiB/s wr, 293 op/s 2026-02-17T21:16:21.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:21 trial104 ceph-mon[20612]: pgmap v625: 129 pgs: 129 active+clean; 439 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 6.7 MiB/s wr, 293 op/s 2026-02-17T21:16:21.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 28501959 5246.47 MB/sec execute 175 sec latency 3.360 ms 2026-02-17T21:16:21.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 71414 13.08 MB/sec execute 175 sec latency 47.909 ms 2026-02-17T21:16:22.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 28598515 5246.21 MB/sec execute 176 sec latency 3.018 ms 2026-02-17T21:16:22.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 71599 13.02 MB/sec execute 176 sec latency 49.291 ms 2026-02-17T21:16:23.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:23 trial104 ceph-mon[20612]: pgmap v626: 129 pgs: 129 active+clean; 443 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 14 KiB/s rd, 5.4 MiB/s wr, 230 op/s 2026-02-17T21:16:23.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:23 trial153 ceph-mon[25357]: pgmap v626: 129 pgs: 129 active+clean; 443 MiB data, 4.0 GiB used, 5.5 TiB / 5.5 TiB avail; 14 KiB/s rd, 5.4 MiB/s wr, 230 op/s 2026-02-17T21:16:23.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 28696352 5246.38 MB/sec execute 177 sec latency 1.274 ms 2026-02-17T21:16:23.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 71793 12.98 MB/sec execute 177 sec latency 45.358 ms 2026-02-17T21:16:24.882 INFO:tasks.workunit.client.0.trial104.stdout: 10 28794197 5246.54 MB/sec execute 178 sec latency 2.522 ms 2026-02-17T21:16:24.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 72047 12.98 MB/sec execute 178 sec latency 46.034 ms 2026-02-17T21:16:25.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:25 trial104 ceph-mon[20612]: pgmap v627: 129 pgs: 129 active+clean; 443 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 6.0 MiB/s wr, 235 op/s 2026-02-17T21:16:25.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:25 trial153 ceph-mon[25357]: pgmap v627: 129 pgs: 129 active+clean; 443 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 6.0 MiB/s wr, 235 op/s 2026-02-17T21:16:25.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 28891673 5247.07 MB/sec execute 179 sec latency 2.434 ms 2026-02-17T21:16:25.908 INFO:tasks.workunit.client.1.trial153.stdout: 10 72280 12.97 MB/sec execute 179 sec latency 43.729 ms 2026-02-17T21:16:26.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 28988203 5247.27 MB/sec execute 180 sec latency 3.367 ms 2026-02-17T21:16:26.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 72511 12.93 MB/sec execute 180 sec latency 48.388 ms 2026-02-17T21:16:27.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:27 trial153 ceph-mon[25357]: pgmap v628: 129 pgs: 129 active+clean; 448 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 6.8 MiB/s wr, 280 op/s 2026-02-17T21:16:27.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:27 trial104 ceph-mon[20612]: pgmap v628: 129 pgs: 129 active+clean; 448 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 6.8 MiB/s wr, 280 op/s 2026-02-17T21:16:27.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 29085958 5247.44 MB/sec execute 181 sec latency 3.438 ms 2026-02-17T21:16:27.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 72780 12.95 MB/sec execute 181 sec latency 39.409 ms 2026-02-17T21:16:28.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 29183471 5247.46 MB/sec execute 182 sec latency 3.638 ms 2026-02-17T21:16:28.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 73027 12.91 MB/sec execute 182 sec latency 39.365 ms 2026-02-17T21:16:29.373 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:29 trial104 ceph-mon[20612]: pgmap v629: 129 pgs: 129 active+clean; 442 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 218 op/s 2026-02-17T21:16:29.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:29 trial153 ceph-mon[25357]: pgmap v629: 129 pgs: 129 active+clean; 442 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 218 op/s 2026-02-17T21:16:29.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 29281673 5247.83 MB/sec execute 183 sec latency 3.069 ms 2026-02-17T21:16:29.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 73263 12.88 MB/sec execute 183 sec latency 43.518 ms 2026-02-17T21:16:30.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:30 trial104 ceph-mon[20612]: pgmap v630: 129 pgs: 129 active+clean; 433 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.8 KiB/s rd, 6.9 MiB/s wr, 278 op/s 2026-02-17T21:16:30.774 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:30 trial153 ceph-mon[25357]: pgmap v630: 129 pgs: 129 active+clean; 433 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.8 KiB/s rd, 6.9 MiB/s wr, 278 op/s 2026-02-17T21:16:30.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 29378403 5248.35 MB/sec execute 184 sec latency 2.674 ms 2026-02-17T21:16:30.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 73575 12.93 MB/sec execute 184 sec latency 42.514 ms 2026-02-17T21:16:31.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 29477060 5248.89 MB/sec execute 185 sec latency 2.791 ms 2026-02-17T21:16:31.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 73862 12.96 MB/sec execute 185 sec latency 38.165 ms 2026-02-17T21:16:32.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 29569815 5247.49 MB/sec execute 186 sec latency 30.548 ms 2026-02-17T21:16:32.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 74149 13.04 MB/sec execute 186 sec latency 37.197 ms 2026-02-17T21:16:33.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:32 trial104 ceph-mon[20612]: pgmap v631: 129 pgs: 129 active+clean; 433 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.6 MiB/s wr, 247 op/s 2026-02-17T21:16:33.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:32 trial153 ceph-mon[25357]: pgmap v631: 129 pgs: 129 active+clean; 433 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.6 MiB/s wr, 247 op/s 2026-02-17T21:16:33.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 29666966 5247.47 MB/sec execute 187 sec latency 9.636 ms 2026-02-17T21:16:33.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 74462 13.10 MB/sec execute 187 sec latency 44.016 ms 2026-02-17T21:16:34.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:16:34.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:16:34.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 29765022 5247.86 MB/sec execute 188 sec latency 2.922 ms 2026-02-17T21:16:34.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 74607 13.06 MB/sec execute 188 sec latency 39.308 ms 2026-02-17T21:16:35.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:34 trial104 ceph-mon[20612]: pgmap v632: 129 pgs: 129 active+clean; 442 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 8.0 KiB/s rd, 5.4 MiB/s wr, 244 op/s 2026-02-17T21:16:35.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:34 trial153 ceph-mon[25357]: pgmap v632: 129 pgs: 129 active+clean; 442 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 8.0 KiB/s rd, 5.4 MiB/s wr, 244 op/s 2026-02-17T21:16:35.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 29861474 5248.32 MB/sec execute 189 sec latency 4.088 ms 2026-02-17T21:16:35.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 74836 13.09 MB/sec execute 189 sec latency 59.184 ms 2026-02-17T21:16:36.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 29960310 5248.74 MB/sec execute 190 sec latency 1.826 ms 2026-02-17T21:16:36.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 75032 13.06 MB/sec execute 190 sec latency 48.532 ms 2026-02-17T21:16:37.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:36 trial104 ceph-mon[20612]: pgmap v633: 129 pgs: 129 active+clean; 457 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 8.0 KiB/s rd, 6.1 MiB/s wr, 287 op/s 2026-02-17T21:16:37.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:36 trial153 ceph-mon[25357]: pgmap v633: 129 pgs: 129 active+clean; 457 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 8.0 KiB/s rd, 6.1 MiB/s wr, 287 op/s 2026-02-17T21:16:37.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 30057431 5248.65 MB/sec execute 191 sec latency 2.771 ms 2026-02-17T21:16:37.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 75222 13.01 MB/sec execute 191 sec latency 38.015 ms 2026-02-17T21:16:38.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 30154233 5248.53 MB/sec execute 192 sec latency 3.328 ms 2026-02-17T21:16:38.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 75422 12.97 MB/sec execute 192 sec latency 53.058 ms 2026-02-17T21:16:39.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:38 trial104 ceph-mon[20612]: pgmap v634: 129 pgs: 129 active+clean; 461 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 227 op/s 2026-02-17T21:16:39.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:38 trial153 ceph-mon[25357]: pgmap v634: 129 pgs: 129 active+clean; 461 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 227 op/s 2026-02-17T21:16:39.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 30250474 5248.52 MB/sec execute 193 sec latency 3.511 ms 2026-02-17T21:16:39.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 75697 12.99 MB/sec execute 193 sec latency 41.255 ms 2026-02-17T21:16:40.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 30347249 5248.89 MB/sec execute 194 sec latency 2.184 ms 2026-02-17T21:16:40.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 75930 12.97 MB/sec execute 194 sec latency 41.673 ms 2026-02-17T21:16:41.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:40 trial104 ceph-mon[20612]: pgmap v635: 129 pgs: 129 active+clean; 435 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 5.5 KiB/s rd, 7.1 MiB/s wr, 295 op/s 2026-02-17T21:16:41.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:40 trial153 ceph-mon[25357]: pgmap v635: 129 pgs: 129 active+clean; 435 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 5.5 KiB/s rd, 7.1 MiB/s wr, 295 op/s 2026-02-17T21:16:41.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 30445885 5249.28 MB/sec execute 195 sec latency 3.554 ms 2026-02-17T21:16:41.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 76192 12.99 MB/sec execute 195 sec latency 44.057 ms 2026-02-17T21:16:42.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 30544552 5249.64 MB/sec execute 196 sec latency 1.842 ms 2026-02-17T21:16:42.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 76411 12.94 MB/sec execute 196 sec latency 39.100 ms 2026-02-17T21:16:43.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:42 trial104 ceph-mon[20612]: pgmap v636: 129 pgs: 129 active+clean; 430 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 206 op/s 2026-02-17T21:16:43.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:42 trial153 ceph-mon[25357]: pgmap v636: 129 pgs: 129 active+clean; 430 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 206 op/s 2026-02-17T21:16:43.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 30641606 5249.61 MB/sec execute 197 sec latency 8.290 ms 2026-02-17T21:16:43.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 76646 12.90 MB/sec execute 197 sec latency 41.871 ms 2026-02-17T21:16:44.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 30739082 5250.29 MB/sec execute 198 sec latency 2.045 ms 2026-02-17T21:16:44.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 76898 12.91 MB/sec execute 198 sec latency 42.385 ms 2026-02-17T21:16:45.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:44 trial153 ceph-mon[25357]: pgmap v637: 129 pgs: 129 active+clean; 419 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 6.5 MiB/s wr, 229 op/s 2026-02-17T21:16:45.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:44 trial104 ceph-mon[20612]: pgmap v637: 129 pgs: 129 active+clean; 419 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 6.5 MiB/s wr, 229 op/s 2026-02-17T21:16:45.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 30837591 5250.71 MB/sec execute 199 sec latency 1.513 ms 2026-02-17T21:16:45.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 77239 12.95 MB/sec execute 199 sec latency 43.012 ms 2026-02-17T21:16:46.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 30936411 5251.11 MB/sec execute 200 sec latency 2.013 ms 2026-02-17T21:16:46.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 77463 12.96 MB/sec execute 200 sec latency 43.445 ms 2026-02-17T21:16:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:46 trial153 ceph-mon[25357]: pgmap v638: 129 pgs: 129 active+clean; 417 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 6.1 MiB/s wr, 284 op/s 2026-02-17T21:16:47.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:46 trial104 ceph-mon[20612]: pgmap v638: 129 pgs: 129 active+clean; 417 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 6.1 MiB/s wr, 284 op/s 2026-02-17T21:16:47.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 31032355 5250.73 MB/sec execute 201 sec latency 28.701 ms 2026-02-17T21:16:47.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 77782 13.06 MB/sec execute 201 sec latency 42.497 ms 2026-02-17T21:16:48.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 31128204 5250.48 MB/sec execute 202 sec latency 27.131 ms 2026-02-17T21:16:48.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 78056 13.08 MB/sec execute 202 sec latency 47.553 ms 2026-02-17T21:16:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:48 trial153 ceph-mon[25357]: pgmap v639: 129 pgs: 129 active+clean; 422 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 242 op/s 2026-02-17T21:16:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:16:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:48 trial104 ceph-mon[20612]: pgmap v639: 129 pgs: 129 active+clean; 422 MiB data, 4.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 242 op/s 2026-02-17T21:16:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:16:49.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 31225067 5251.01 MB/sec execute 203 sec latency 2.193 ms 2026-02-17T21:16:49.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 78204 13.05 MB/sec execute 203 sec latency 40.795 ms 2026-02-17T21:16:50.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 31323367 5251.23 MB/sec execute 204 sec latency 1.798 ms 2026-02-17T21:16:50.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 78443 13.07 MB/sec execute 204 sec latency 57.874 ms 2026-02-17T21:16:51.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:50 trial153 ceph-mon[25357]: pgmap v640: 129 pgs: 129 active+clean; 442 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 6.8 MiB/s wr, 306 op/s 2026-02-17T21:16:51.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:50 trial104 ceph-mon[20612]: pgmap v640: 129 pgs: 129 active+clean; 442 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 6.8 MiB/s wr, 306 op/s 2026-02-17T21:16:51.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 31420328 5251.16 MB/sec execute 205 sec latency 3.087 ms 2026-02-17T21:16:51.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 78645 13.04 MB/sec execute 205 sec latency 47.060 ms 2026-02-17T21:16:52.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 31516805 5250.92 MB/sec execute 206 sec latency 3.792 ms 2026-02-17T21:16:52.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 78833 13.01 MB/sec execute 206 sec latency 44.999 ms 2026-02-17T21:16:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:52 trial153 ceph-mon[25357]: pgmap v641: 129 pgs: 129 active+clean; 442 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 219 op/s 2026-02-17T21:16:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:52 trial104 ceph-mon[20612]: pgmap v641: 129 pgs: 129 active+clean; 442 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 219 op/s 2026-02-17T21:16:53.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 31614571 5251.15 MB/sec execute 207 sec latency 1.495 ms 2026-02-17T21:16:53.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 79050 12.97 MB/sec execute 207 sec latency 42.838 ms 2026-02-17T21:16:54.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 31709056 5251.06 MB/sec execute 208 sec latency 2.339 ms 2026-02-17T21:16:54.909 INFO:tasks.workunit.client.1.trial153.stdout: 10 79313 12.98 MB/sec execute 208 sec latency 40.053 ms 2026-02-17T21:16:55.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:54 trial104 ceph-mon[20612]: pgmap v642: 129 pgs: 129 active+clean; 445 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 6.4 MiB/s wr, 251 op/s 2026-02-17T21:16:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:54 trial153 ceph-mon[25357]: pgmap v642: 129 pgs: 129 active+clean; 445 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 6.4 MiB/s wr, 251 op/s 2026-02-17T21:16:55.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 31805713 5250.85 MB/sec execute 209 sec latency 3.467 ms 2026-02-17T21:16:55.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 79558 12.96 MB/sec execute 209 sec latency 45.928 ms 2026-02-17T21:16:56.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 31903552 5250.96 MB/sec execute 210 sec latency 3.023 ms 2026-02-17T21:16:56.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 79815 12.98 MB/sec execute 210 sec latency 38.867 ms 2026-02-17T21:16:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:56 trial153 ceph-mon[25357]: pgmap v643: 129 pgs: 129 active+clean; 443 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 6.6 MiB/s wr, 252 op/s 2026-02-17T21:16:57.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:56 trial104 ceph-mon[20612]: pgmap v643: 129 pgs: 129 active+clean; 443 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 5.7 KiB/s rd, 6.6 MiB/s wr, 252 op/s 2026-02-17T21:16:57.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 31999967 5250.79 MB/sec execute 211 sec latency 1.790 ms 2026-02-17T21:16:57.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 80046 12.94 MB/sec execute 211 sec latency 42.206 ms 2026-02-17T21:16:58.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 32093759 5250.23 MB/sec execute 212 sec latency 40.749 ms 2026-02-17T21:16:58.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 80269 12.91 MB/sec execute 212 sec latency 42.445 ms 2026-02-17T21:16:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:58 trial153 ceph-mon[25357]: pgmap v644: 129 pgs: 129 active+clean; 441 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 247 op/s 2026-02-17T21:16:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:16:58 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:16:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:58 trial104 ceph-mon[20612]: pgmap v644: 129 pgs: 129 active+clean; 441 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 247 op/s 2026-02-17T21:16:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:16:58 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:16:59.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 32187105 5249.59 MB/sec execute 213 sec latency 12.661 ms 2026-02-17T21:16:59.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 80567 12.93 MB/sec execute 213 sec latency 39.342 ms 2026-02-17T21:17:00.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:00 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:17:00.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:00 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:17:00.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:00 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:17:00.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:00 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:17:00.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:00 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:17:00.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:00 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:17:00.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:00 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:17:00.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:00 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:17:00.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:00 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:17:00.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:00 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:17:00.883 INFO:tasks.workunit.client.0.trial104.stdout: 10 32284064 5249.47 MB/sec execute 214 sec latency 3.077 ms 2026-02-17T21:17:00.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 80875 12.97 MB/sec execute 214 sec latency 38.283 ms 2026-02-17T21:17:01.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:01 trial104 ceph-mon[20612]: pgmap v645: 129 pgs: 129 active+clean; 431 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.8 KiB/s rd, 6.6 MiB/s wr, 281 op/s 2026-02-17T21:17:01.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:01 trial153 ceph-mon[25357]: pgmap v645: 129 pgs: 129 active+clean; 431 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.8 KiB/s rd, 6.6 MiB/s wr, 281 op/s 2026-02-17T21:17:01.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 32381247 5249.43 MB/sec execute 215 sec latency 2.945 ms 2026-02-17T21:17:01.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 81122 13.01 MB/sec execute 215 sec latency 36.714 ms 2026-02-17T21:17:02.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 32478814 5249.53 MB/sec execute 216 sec latency 2.164 ms 2026-02-17T21:17:02.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 81472 13.08 MB/sec execute 216 sec latency 47.771 ms 2026-02-17T21:17:03.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:03 trial104 ceph-mon[20612]: pgmap v646: 129 pgs: 129 active+clean; 436 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 244 op/s 2026-02-17T21:17:03.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:03 trial153 ceph-mon[25357]: pgmap v646: 129 pgs: 129 active+clean; 436 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 244 op/s 2026-02-17T21:17:03.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 32575556 5250.00 MB/sec execute 217 sec latency 4.531 ms 2026-02-17T21:17:03.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 81654 13.08 MB/sec execute 217 sec latency 41.562 ms 2026-02-17T21:17:04.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:17:04.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:17:04.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 32674028 5250.35 MB/sec execute 218 sec latency 4.313 ms 2026-02-17T21:17:04.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 81836 13.08 MB/sec execute 218 sec latency 48.488 ms 2026-02-17T21:17:05.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:05 trial104 ceph-mon[20612]: pgmap v647: 129 pgs: 129 active+clean; 448 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 6.0 MiB/s wr, 263 op/s 2026-02-17T21:17:05.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:05 trial153 ceph-mon[25357]: pgmap v647: 129 pgs: 129 active+clean; 448 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 6.0 MiB/s wr, 263 op/s 2026-02-17T21:17:05.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 32772436 5250.63 MB/sec execute 219 sec latency 2.343 ms 2026-02-17T21:17:05.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 82050 13.06 MB/sec execute 219 sec latency 46.001 ms 2026-02-17T21:17:06.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 32870190 5250.70 MB/sec execute 220 sec latency 2.671 ms 2026-02-17T21:17:06.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 82246 13.03 MB/sec execute 220 sec latency 41.314 ms 2026-02-17T21:17:07.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:07 trial153 ceph-mon[25357]: pgmap v648: 129 pgs: 129 active+clean; 457 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 6.0 MiB/s wr, 259 op/s 2026-02-17T21:17:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:07 trial104 ceph-mon[20612]: pgmap v648: 129 pgs: 129 active+clean; 457 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 6.0 MiB/s wr, 259 op/s 2026-02-17T21:17:07.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 32967186 5250.75 MB/sec execute 221 sec latency 8.008 ms 2026-02-17T21:17:07.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 82439 13.00 MB/sec execute 221 sec latency 40.893 ms 2026-02-17T21:17:08.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 33062979 5251.01 MB/sec execute 222 sec latency 17.311 ms 2026-02-17T21:17:08.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 82680 13.00 MB/sec execute 222 sec latency 58.373 ms 2026-02-17T21:17:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:09 trial104 ceph-mon[20612]: pgmap v649: 129 pgs: 129 active+clean; 455 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 244 op/s 2026-02-17T21:17:09.526 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:09 trial153 ceph-mon[25357]: pgmap v649: 129 pgs: 129 active+clean; 455 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 244 op/s 2026-02-17T21:17:09.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 33158905 5250.62 MB/sec execute 223 sec latency 2.807 ms 2026-02-17T21:17:09.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 82914 12.98 MB/sec execute 223 sec latency 40.064 ms 2026-02-17T21:17:10.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 33255342 5250.41 MB/sec execute 224 sec latency 3.268 ms 2026-02-17T21:17:10.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 83152 12.95 MB/sec execute 224 sec latency 43.530 ms 2026-02-17T21:17:11.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:11 trial104 ceph-mon[20612]: pgmap v650: 129 pgs: 129 active+clean; 431 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.8 MiB/s wr, 253 op/s 2026-02-17T21:17:11.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:11 trial153 ceph-mon[25357]: pgmap v650: 129 pgs: 129 active+clean; 431 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.8 MiB/s wr, 253 op/s 2026-02-17T21:17:11.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 33353821 5250.63 MB/sec execute 225 sec latency 1.984 ms 2026-02-17T21:17:11.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 83410 12.96 MB/sec execute 225 sec latency 40.891 ms 2026-02-17T21:17:12.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 33451192 5250.82 MB/sec execute 226 sec latency 1.549 ms 2026-02-17T21:17:12.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 83645 12.94 MB/sec execute 226 sec latency 39.852 ms 2026-02-17T21:17:13.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:13 trial104 ceph-mon[20612]: pgmap v651: 129 pgs: 129 active+clean; 431 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 246 op/s 2026-02-17T21:17:13.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:13 trial153 ceph-mon[25357]: pgmap v651: 129 pgs: 129 active+clean; 431 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 246 op/s 2026-02-17T21:17:13.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 33544627 5250.45 MB/sec execute 227 sec latency 30.487 ms 2026-02-17T21:17:13.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 83887 12.92 MB/sec execute 227 sec latency 40.152 ms 2026-02-17T21:17:14.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 33640298 5250.05 MB/sec execute 228 sec latency 20.719 ms 2026-02-17T21:17:14.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 84203 12.95 MB/sec execute 228 sec latency 43.114 ms 2026-02-17T21:17:15.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:15 trial104 ceph-mon[20612]: pgmap v652: 129 pgs: 129 active+clean; 422 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 6.4 MiB/s wr, 236 op/s 2026-02-17T21:17:15.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:15 trial153 ceph-mon[25357]: pgmap v652: 129 pgs: 129 active+clean; 422 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 6.4 MiB/s wr, 236 op/s 2026-02-17T21:17:15.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 33738294 5250.19 MB/sec execute 229 sec latency 2.506 ms 2026-02-17T21:17:15.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 84480 12.97 MB/sec execute 229 sec latency 38.356 ms 2026-02-17T21:17:16.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 33835814 5250.28 MB/sec execute 230 sec latency 2.040 ms 2026-02-17T21:17:16.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 84736 13.02 MB/sec execute 230 sec latency 61.643 ms 2026-02-17T21:17:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:17 trial153 ceph-mon[25357]: pgmap v653: 129 pgs: 129 active+clean; 420 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 5.5 MiB/s wr, 259 op/s 2026-02-17T21:17:17.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:17 trial104 ceph-mon[20612]: pgmap v653: 129 pgs: 129 active+clean; 420 MiB data, 4.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.9 KiB/s rd, 5.5 MiB/s wr, 259 op/s 2026-02-17T21:17:17.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 33932178 5250.36 MB/sec execute 231 sec latency 2.095 ms 2026-02-17T21:17:17.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 85092 13.08 MB/sec execute 231 sec latency 56.765 ms 2026-02-17T21:17:18.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 34027368 5250.22 MB/sec execute 232 sec latency 14.663 ms 2026-02-17T21:17:18.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 85247 13.06 MB/sec execute 232 sec latency 50.977 ms 2026-02-17T21:17:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:19 trial104 ceph-mon[20612]: pgmap v654: 129 pgs: 129 active+clean; 427 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.1 MiB/s wr, 248 op/s 2026-02-17T21:17:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:17:19.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:19 trial153 ceph-mon[25357]: pgmap v654: 129 pgs: 129 active+clean; 427 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.1 MiB/s wr, 248 op/s 2026-02-17T21:17:19.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:17:19.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 34124275 5250.11 MB/sec execute 233 sec latency 3.139 ms 2026-02-17T21:17:19.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 85450 13.08 MB/sec execute 233 sec latency 51.860 ms 2026-02-17T21:17:20.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 34222034 5250.19 MB/sec execute 234 sec latency 2.622 ms 2026-02-17T21:17:20.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 85669 13.05 MB/sec execute 234 sec latency 38.534 ms 2026-02-17T21:17:21.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:21 trial104 ceph-mon[20612]: pgmap v655: 129 pgs: 129 active+clean; 443 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 6.7 MiB/s wr, 292 op/s 2026-02-17T21:17:21.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:21 trial153 ceph-mon[25357]: pgmap v655: 129 pgs: 129 active+clean; 443 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 6.7 MiB/s wr, 292 op/s 2026-02-17T21:17:21.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 34318930 5250.16 MB/sec execute 235 sec latency 2.573 ms 2026-02-17T21:17:21.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 85856 13.02 MB/sec execute 235 sec latency 45.116 ms 2026-02-17T21:17:22.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 34414368 5250.28 MB/sec execute 236 sec latency 3.168 ms 2026-02-17T21:17:22.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 86050 12.98 MB/sec execute 236 sec latency 45.970 ms 2026-02-17T21:17:23.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:23 trial104 ceph-mon[20612]: pgmap v656: 129 pgs: 129 active+clean; 444 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 217 op/s 2026-02-17T21:17:23.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:23 trial153 ceph-mon[25357]: pgmap v656: 129 pgs: 129 active+clean; 444 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 217 op/s 2026-02-17T21:17:23.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 34508148 5249.53 MB/sec execute 237 sec latency 24.401 ms 2026-02-17T21:17:23.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 86316 12.99 MB/sec execute 237 sec latency 54.661 ms 2026-02-17T21:17:24.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 34603697 5249.09 MB/sec execute 238 sec latency 21.005 ms 2026-02-17T21:17:24.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 86562 12.98 MB/sec execute 238 sec latency 48.569 ms 2026-02-17T21:17:25.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:25 trial104 ceph-mon[20612]: pgmap v657: 129 pgs: 129 active+clean; 449 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.2 MiB/s wr, 219 op/s 2026-02-17T21:17:25.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:25 trial153 ceph-mon[25357]: pgmap v657: 129 pgs: 129 active+clean; 449 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.2 MiB/s wr, 219 op/s 2026-02-17T21:17:25.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 34701099 5249.16 MB/sec execute 239 sec latency 2.623 ms 2026-02-17T21:17:25.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 86782 12.95 MB/sec execute 239 sec latency 54.684 ms 2026-02-17T21:17:26.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:26 trial153 ceph-mon[25357]: pgmap v658: 129 pgs: 129 active+clean; 446 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.6 MiB/s wr, 264 op/s 2026-02-17T21:17:26.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:26 trial104 ceph-mon[20612]: pgmap v658: 129 pgs: 129 active+clean; 446 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.6 MiB/s wr, 264 op/s 2026-02-17T21:17:26.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 34798193 5249.20 MB/sec execute 240 sec latency 2.419 ms 2026-02-17T21:17:26.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 87045 12.96 MB/sec execute 240 sec latency 37.983 ms 2026-02-17T21:17:27.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 34894833 5249.60 MB/sec execute 241 sec latency 2.099 ms 2026-02-17T21:17:27.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 87280 12.93 MB/sec execute 241 sec latency 41.644 ms 2026-02-17T21:17:28.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 34991035 5249.36 MB/sec execute 242 sec latency 16.282 ms 2026-02-17T21:17:28.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 87537 12.93 MB/sec execute 242 sec latency 40.887 ms 2026-02-17T21:17:29.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:28 trial153 ceph-mon[25357]: pgmap v659: 129 pgs: 129 active+clean; 438 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 242 op/s 2026-02-17T21:17:29.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:28 trial104 ceph-mon[20612]: pgmap v659: 129 pgs: 129 active+clean; 438 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 242 op/s 2026-02-17T21:17:29.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 35085936 5248.77 MB/sec execute 243 sec latency 33.111 ms 2026-02-17T21:17:29.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 87862 12.98 MB/sec execute 243 sec latency 37.703 ms 2026-02-17T21:17:30.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 35182759 5248.68 MB/sec execute 244 sec latency 2.598 ms 2026-02-17T21:17:30.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 88114 12.99 MB/sec execute 244 sec latency 37.688 ms 2026-02-17T21:17:31.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:30 trial153 ceph-mon[25357]: pgmap v660: 129 pgs: 129 active+clean; 438 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.8 MiB/s wr, 300 op/s 2026-02-17T21:17:31.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:30 trial104 ceph-mon[20612]: pgmap v660: 129 pgs: 129 active+clean; 438 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.8 MiB/s wr, 300 op/s 2026-02-17T21:17:31.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 35279845 5248.75 MB/sec execute 245 sec latency 3.769 ms 2026-02-17T21:17:31.910 INFO:tasks.workunit.client.1.trial153.stdout: 10 88440 13.08 MB/sec execute 245 sec latency 43.370 ms 2026-02-17T21:17:32.884 INFO:tasks.workunit.client.0.trial104.stdout: 10 35375444 5248.93 MB/sec execute 246 sec latency 2.367 ms 2026-02-17T21:17:32.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 88709 13.09 MB/sec execute 246 sec latency 43.836 ms 2026-02-17T21:17:33.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:32 trial153 ceph-mon[25357]: pgmap v661: 129 pgs: 129 active+clean; 441 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 265 op/s 2026-02-17T21:17:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:32 trial104 ceph-mon[20612]: pgmap v661: 129 pgs: 129 active+clean; 441 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 265 op/s 2026-02-17T21:17:33.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 35472850 5248.92 MB/sec execute 247 sec latency 3.367 ms 2026-02-17T21:17:33.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 88848 13.06 MB/sec execute 247 sec latency 37.867 ms 2026-02-17T21:17:34.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:17:34.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:17:34.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 35569457 5248.78 MB/sec execute 248 sec latency 3.048 ms 2026-02-17T21:17:34.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 89079 13.06 MB/sec execute 248 sec latency 42.118 ms 2026-02-17T21:17:35.236 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:34 trial104 ceph-mon[20612]: pgmap v662: 129 pgs: 129 active+clean; 446 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.0 MiB/s wr, 278 op/s 2026-02-17T21:17:35.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:34 trial153 ceph-mon[25357]: pgmap v662: 129 pgs: 129 active+clean; 446 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.0 MiB/s wr, 278 op/s 2026-02-17T21:17:35.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 35665699 5248.59 MB/sec execute 249 sec latency 2.432 ms 2026-02-17T21:17:35.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 89285 13.04 MB/sec execute 249 sec latency 42.544 ms 2026-02-17T21:17:36.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 35762150 5248.66 MB/sec execute 250 sec latency 1.925 ms 2026-02-17T21:17:36.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 89480 13.02 MB/sec execute 250 sec latency 39.922 ms 2026-02-17T21:17:37.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:36 trial153 ceph-mon[25357]: pgmap v663: 129 pgs: 129 active+clean; 438 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.0 MiB/s wr, 251 op/s 2026-02-17T21:17:37.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:36 trial104 ceph-mon[20612]: pgmap v663: 129 pgs: 129 active+clean; 438 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.0 MiB/s wr, 251 op/s 2026-02-17T21:17:37.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 35857233 5248.52 MB/sec execute 251 sec latency 2.865 ms 2026-02-17T21:17:37.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 89682 13.00 MB/sec execute 251 sec latency 50.081 ms 2026-02-17T21:17:38.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 35951313 5247.81 MB/sec execute 252 sec latency 16.224 ms 2026-02-17T21:17:38.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 89946 13.00 MB/sec execute 252 sec latency 56.785 ms 2026-02-17T21:17:39.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:38 trial153 ceph-mon[25357]: pgmap v664: 129 pgs: 129 active+clean; 437 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 241 op/s 2026-02-17T21:17:39.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:38 trial104 ceph-mon[20612]: pgmap v664: 129 pgs: 129 active+clean; 437 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 241 op/s 2026-02-17T21:17:39.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 36045139 5247.07 MB/sec execute 253 sec latency 25.699 ms 2026-02-17T21:17:39.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 90183 12.97 MB/sec execute 253 sec latency 48.890 ms 2026-02-17T21:17:40.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 36141428 5246.94 MB/sec execute 254 sec latency 15.433 ms 2026-02-17T21:17:40.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 90435 12.97 MB/sec execute 254 sec latency 42.975 ms 2026-02-17T21:17:41.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:40 trial153 ceph-mon[25357]: pgmap v665: 129 pgs: 129 active+clean; 429 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 7.1 MiB/s wr, 293 op/s 2026-02-17T21:17:41.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:40 trial104 ceph-mon[20612]: pgmap v665: 129 pgs: 129 active+clean; 429 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 7.1 MiB/s wr, 293 op/s 2026-02-17T21:17:41.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 36238345 5247.21 MB/sec execute 255 sec latency 3.753 ms 2026-02-17T21:17:41.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 90671 12.95 MB/sec execute 255 sec latency 41.026 ms 2026-02-17T21:17:42.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 36335433 5247.36 MB/sec execute 256 sec latency 3.285 ms 2026-02-17T21:17:42.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 90903 12.93 MB/sec execute 256 sec latency 40.545 ms 2026-02-17T21:17:43.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:42 trial153 ceph-mon[25357]: pgmap v666: 129 pgs: 129 active+clean; 429 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 230 op/s 2026-02-17T21:17:43.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:42 trial104 ceph-mon[20612]: pgmap v666: 129 pgs: 129 active+clean; 429 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 230 op/s 2026-02-17T21:17:43.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 36433255 5247.53 MB/sec execute 257 sec latency 2.681 ms 2026-02-17T21:17:43.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 91178 12.96 MB/sec execute 257 sec latency 40.692 ms 2026-02-17T21:17:44.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 36531544 5247.68 MB/sec execute 258 sec latency 10.878 ms 2026-02-17T21:17:44.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 91501 12.98 MB/sec execute 258 sec latency 39.741 ms 2026-02-17T21:17:45.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:44 trial153 ceph-mon[25357]: pgmap v667: 129 pgs: 129 active+clean; 424 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 9.8 KiB/s rd, 6.3 MiB/s wr, 237 op/s 2026-02-17T21:17:45.374 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:44 trial104 ceph-mon[20612]: pgmap v667: 129 pgs: 129 active+clean; 424 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 9.8 KiB/s rd, 6.3 MiB/s wr, 237 op/s 2026-02-17T21:17:45.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 36628461 5247.70 MB/sec execute 259 sec latency 2.002 ms 2026-02-17T21:17:45.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 91720 12.98 MB/sec execute 259 sec latency 42.842 ms 2026-02-17T21:17:46.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 36725468 5248.11 MB/sec execute 260 sec latency 3.031 ms 2026-02-17T21:17:46.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 92042 13.06 MB/sec execute 260 sec latency 40.232 ms 2026-02-17T21:17:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:46 trial153 ceph-mon[25357]: pgmap v668: 129 pgs: 129 active+clean; 424 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 9.8 KiB/s rd, 5.5 MiB/s wr, 253 op/s 2026-02-17T21:17:47.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:46 trial104 ceph-mon[20612]: pgmap v668: 129 pgs: 129 active+clean; 424 MiB data, 4.3 GiB used, 5.5 TiB / 5.5 TiB avail; 9.8 KiB/s rd, 5.5 MiB/s wr, 253 op/s 2026-02-17T21:17:47.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 36823075 5248.25 MB/sec execute 261 sec latency 3.294 ms 2026-02-17T21:17:47.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 92292 13.07 MB/sec execute 261 sec latency 50.751 ms 2026-02-17T21:17:48.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 36921369 5248.43 MB/sec execute 262 sec latency 2.013 ms 2026-02-17T21:17:48.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 92439 13.04 MB/sec execute 262 sec latency 39.894 ms 2026-02-17T21:17:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:48 trial153 ceph-mon[25357]: pgmap v669: 129 pgs: 129 active+clean; 432 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 272 op/s 2026-02-17T21:17:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:17:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:48 trial104 ceph-mon[20612]: pgmap v669: 129 pgs: 129 active+clean; 432 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 272 op/s 2026-02-17T21:17:49.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:17:49.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 37019307 5248.55 MB/sec execute 263 sec latency 2.621 ms 2026-02-17T21:17:49.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 92677 13.05 MB/sec execute 263 sec latency 40.678 ms 2026-02-17T21:17:50.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:50 trial104 ceph-mon[20612]: pgmap v670: 129 pgs: 129 active+clean; 449 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 6.6 MiB/s wr, 280 op/s 2026-02-17T21:17:50.774 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:50 trial153 ceph-mon[25357]: pgmap v670: 129 pgs: 129 active+clean; 449 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 6.6 MiB/s wr, 280 op/s 2026-02-17T21:17:50.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 37114698 5248.28 MB/sec execute 264 sec latency 3.584 ms 2026-02-17T21:17:50.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 92885 13.03 MB/sec execute 264 sec latency 53.496 ms 2026-02-17T21:17:51.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 37211348 5248.68 MB/sec execute 265 sec latency 1.772 ms 2026-02-17T21:17:51.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 93082 13.00 MB/sec execute 265 sec latency 41.927 ms 2026-02-17T21:17:52.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 37308444 5248.58 MB/sec execute 266 sec latency 2.698 ms 2026-02-17T21:17:52.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 93323 13.01 MB/sec execute 266 sec latency 50.749 ms 2026-02-17T21:17:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:52 trial153 ceph-mon[25357]: pgmap v671: 129 pgs: 129 active+clean; 449 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 211 op/s 2026-02-17T21:17:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:52 trial104 ceph-mon[20612]: pgmap v671: 129 pgs: 129 active+clean; 449 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 211 op/s 2026-02-17T21:17:53.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 37405196 5248.47 MB/sec execute 267 sec latency 2.573 ms 2026-02-17T21:17:53.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 93564 12.99 MB/sec execute 267 sec latency 46.926 ms 2026-02-17T21:17:54.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 37497227 5247.45 MB/sec execute 268 sec latency 28.370 ms 2026-02-17T21:17:54.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 93800 12.97 MB/sec execute 268 sec latency 50.157 ms 2026-02-17T21:17:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:54 trial153 ceph-mon[25357]: pgmap v672: 129 pgs: 129 active+clean; 446 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 6.1 MiB/s wr, 211 op/s 2026-02-17T21:17:55.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:54 trial104 ceph-mon[20612]: pgmap v672: 129 pgs: 129 active+clean; 446 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 6.1 MiB/s wr, 211 op/s 2026-02-17T21:17:55.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 37591890 5247.19 MB/sec execute 269 sec latency 27.000 ms 2026-02-17T21:17:55.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 94046 12.98 MB/sec execute 269 sec latency 45.315 ms 2026-02-17T21:17:56.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 37689644 5247.58 MB/sec execute 270 sec latency 2.321 ms 2026-02-17T21:17:56.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 94273 12.95 MB/sec execute 270 sec latency 40.306 ms 2026-02-17T21:17:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:56 trial153 ceph-mon[25357]: pgmap v673: 129 pgs: 129 active+clean; 442 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 6.6 MiB/s wr, 263 op/s 2026-02-17T21:17:57.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:56 trial104 ceph-mon[20612]: pgmap v673: 129 pgs: 129 active+clean; 442 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 6.6 MiB/s wr, 263 op/s 2026-02-17T21:17:57.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 37787234 5247.65 MB/sec execute 271 sec latency 3.200 ms 2026-02-17T21:17:57.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 94514 12.95 MB/sec execute 271 sec latency 40.320 ms 2026-02-17T21:17:58.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 37885950 5247.92 MB/sec execute 272 sec latency 2.469 ms 2026-02-17T21:17:58.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 94826 12.96 MB/sec execute 272 sec latency 42.654 ms 2026-02-17T21:17:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:58 trial153 ceph-mon[25357]: pgmap v674: 129 pgs: 129 active+clean; 438 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 249 op/s 2026-02-17T21:17:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:58 trial104 ceph-mon[20612]: pgmap v674: 129 pgs: 129 active+clean; 438 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 249 op/s 2026-02-17T21:17:59.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 37981977 5247.69 MB/sec execute 273 sec latency 11.463 ms 2026-02-17T21:17:59.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 95096 12.98 MB/sec execute 273 sec latency 45.968 ms 2026-02-17T21:18:00.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:59 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:18:00.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:59 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:18:00.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:59 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:18:00.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:59 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:18:00.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:59 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:18:00.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:17:59 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:18:00.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:59 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:18:00.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:59 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:18:00.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:59 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:18:00.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:59 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:18:00.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:59 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:18:00.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:17:59 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:18:00.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 38077980 5247.95 MB/sec execute 274 sec latency 2.636 ms 2026-02-17T21:18:00.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 95330 13.00 MB/sec execute 274 sec latency 40.993 ms 2026-02-17T21:18:01.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:00 trial153 ceph-mon[25357]: pgmap v675: 129 pgs: 129 active+clean; 436 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.8 MiB/s wr, 293 op/s 2026-02-17T21:18:01.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:00 trial104 ceph-mon[20612]: pgmap v675: 129 pgs: 129 active+clean; 436 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.8 MiB/s wr, 293 op/s 2026-02-17T21:18:01.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 38174805 5247.91 MB/sec execute 275 sec latency 3.967 ms 2026-02-17T21:18:01.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 95640 13.05 MB/sec execute 275 sec latency 44.814 ms 2026-02-17T21:18:02.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 38273370 5248.18 MB/sec execute 276 sec latency 2.192 ms 2026-02-17T21:18:02.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 95866 13.06 MB/sec execute 276 sec latency 45.499 ms 2026-02-17T21:18:03.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:02 trial153 ceph-mon[25357]: pgmap v676: 129 pgs: 129 active+clean; 426 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 228 op/s 2026-02-17T21:18:03.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:02 trial104 ceph-mon[20612]: pgmap v676: 129 pgs: 129 active+clean; 426 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.7 MiB/s wr, 228 op/s 2026-02-17T21:18:03.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 38370525 5248.10 MB/sec execute 277 sec latency 2.419 ms 2026-02-17T21:18:03.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 96029 13.04 MB/sec execute 277 sec latency 41.051 ms 2026-02-17T21:18:04.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:18:04.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:18:04.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 38467934 5248.26 MB/sec execute 278 sec latency 3.598 ms 2026-02-17T21:18:04.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 96269 13.04 MB/sec execute 278 sec latency 40.824 ms 2026-02-17T21:18:05.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:04 trial153 ceph-mon[25357]: pgmap v677: 129 pgs: 129 active+clean; 435 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 5.9 MiB/s wr, 257 op/s 2026-02-17T21:18:05.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:04 trial104 ceph-mon[20612]: pgmap v677: 129 pgs: 129 active+clean; 435 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 5.9 MiB/s wr, 257 op/s 2026-02-17T21:18:05.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 38564188 5248.51 MB/sec execute 279 sec latency 3.598 ms 2026-02-17T21:18:05.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 96467 13.02 MB/sec execute 279 sec latency 47.355 ms 2026-02-17T21:18:06.885 INFO:tasks.workunit.client.0.trial104.stdout: 10 38661716 5248.55 MB/sec execute 280 sec latency 2.226 ms 2026-02-17T21:18:06.911 INFO:tasks.workunit.client.1.trial153.stdout: 10 96659 13.00 MB/sec execute 280 sec latency 49.861 ms 2026-02-17T21:18:07.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:06 trial153 ceph-mon[25357]: pgmap v678: 129 pgs: 129 active+clean; 437 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 6.4 MiB/s wr, 278 op/s 2026-02-17T21:18:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:06 trial104 ceph-mon[20612]: pgmap v678: 129 pgs: 129 active+clean; 437 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 6.4 MiB/s wr, 278 op/s 2026-02-17T21:18:07.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 38759195 5248.56 MB/sec execute 281 sec latency 3.107 ms 2026-02-17T21:18:07.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 96884 12.98 MB/sec execute 281 sec latency 46.946 ms 2026-02-17T21:18:08.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 38856039 5248.53 MB/sec execute 282 sec latency 2.056 ms 2026-02-17T21:18:08.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 97148 12.98 MB/sec execute 282 sec latency 40.266 ms 2026-02-17T21:18:09.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:08 trial153 ceph-mon[25357]: pgmap v679: 129 pgs: 129 active+clean; 435 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 204 op/s 2026-02-17T21:18:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:08 trial104 ceph-mon[20612]: pgmap v679: 129 pgs: 129 active+clean; 435 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 204 op/s 2026-02-17T21:18:09.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 38950236 5248.04 MB/sec execute 283 sec latency 13.487 ms 2026-02-17T21:18:09.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 97379 12.96 MB/sec execute 283 sec latency 79.770 ms 2026-02-17T21:18:10.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 39044737 5247.92 MB/sec execute 284 sec latency 18.985 ms 2026-02-17T21:18:10.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 97635 12.97 MB/sec execute 284 sec latency 44.674 ms 2026-02-17T21:18:11.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:10 trial104 ceph-mon[20612]: pgmap v680: 129 pgs: 129 active+clean; 433 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 7.0 MiB/s wr, 294 op/s 2026-02-17T21:18:11.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:10 trial153 ceph-mon[25357]: pgmap v680: 129 pgs: 129 active+clean; 433 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 7.0 MiB/s wr, 294 op/s 2026-02-17T21:18:11.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 39141732 5247.86 MB/sec execute 285 sec latency 3.643 ms 2026-02-17T21:18:11.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 97854 12.95 MB/sec execute 285 sec latency 40.721 ms 2026-02-17T21:18:12.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 39238762 5247.80 MB/sec execute 286 sec latency 2.415 ms 2026-02-17T21:18:12.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 98119 12.94 MB/sec execute 286 sec latency 42.351 ms 2026-02-17T21:18:13.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:12 trial153 ceph-mon[25357]: pgmap v681: 129 pgs: 129 active+clean; 431 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 221 op/s 2026-02-17T21:18:13.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:12 trial104 ceph-mon[20612]: pgmap v681: 129 pgs: 129 active+clean; 431 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 221 op/s 2026-02-17T21:18:13.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 39336634 5247.95 MB/sec execute 287 sec latency 2.323 ms 2026-02-17T21:18:13.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 98431 12.96 MB/sec execute 287 sec latency 37.897 ms 2026-02-17T21:18:14.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 39434385 5248.29 MB/sec execute 288 sec latency 2.606 ms 2026-02-17T21:18:14.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 98693 12.97 MB/sec execute 288 sec latency 38.279 ms 2026-02-17T21:18:15.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:14 trial153 ceph-mon[25357]: pgmap v682: 129 pgs: 129 active+clean; 428 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.0 MiB/s wr, 244 op/s 2026-02-17T21:18:15.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:14 trial104 ceph-mon[20612]: pgmap v682: 129 pgs: 129 active+clean; 428 MiB data, 4.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.0 MiB/s wr, 244 op/s 2026-02-17T21:18:15.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 39529213 5248.10 MB/sec execute 289 sec latency 13.712 ms 2026-02-17T21:18:15.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 98979 13.03 MB/sec execute 289 sec latency 38.431 ms 2026-02-17T21:18:16.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 39626280 5248.04 MB/sec execute 290 sec latency 2.084 ms 2026-02-17T21:18:16.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 99297 13.06 MB/sec execute 290 sec latency 50.889 ms 2026-02-17T21:18:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:16 trial153 ceph-mon[25357]: pgmap v683: 129 pgs: 129 active+clean; 432 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.7 MiB/s wr, 275 op/s 2026-02-17T21:18:17.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:16 trial104 ceph-mon[20612]: pgmap v683: 129 pgs: 129 active+clean; 432 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.7 MiB/s wr, 275 op/s 2026-02-17T21:18:17.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 39725034 5248.29 MB/sec execute 291 sec latency 2.873 ms 2026-02-17T21:18:17.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 99454 13.05 MB/sec execute 291 sec latency 46.069 ms 2026-02-17T21:18:18.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 39822201 5248.32 MB/sec execute 292 sec latency 3.618 ms 2026-02-17T21:18:18.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 99654 13.06 MB/sec execute 292 sec latency 45.415 ms 2026-02-17T21:18:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:18 trial153 ceph-mon[25357]: pgmap v684: 129 pgs: 129 active+clean; 437 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 246 op/s 2026-02-17T21:18:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:18:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:18 trial104 ceph-mon[20612]: pgmap v684: 129 pgs: 129 active+clean; 437 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 246 op/s 2026-02-17T21:18:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:18:19.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 39917686 5248.42 MB/sec execute 293 sec latency 3.159 ms 2026-02-17T21:18:19.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 99866 13.04 MB/sec execute 293 sec latency 46.811 ms 2026-02-17T21:18:20.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 40013032 5248.15 MB/sec execute 294 sec latency 14.653 ms 2026-02-17T21:18:20.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 100065 13.01 MB/sec execute 294 sec latency 42.796 ms 2026-02-17T21:18:21.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:20 trial104 ceph-mon[20612]: pgmap v685: 129 pgs: 129 active+clean; 450 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 6.7 MiB/s wr, 287 op/s 2026-02-17T21:18:21.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:20 trial153 ceph-mon[25357]: pgmap v685: 129 pgs: 129 active+clean; 450 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 6.7 MiB/s wr, 287 op/s 2026-02-17T21:18:21.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 40109997 5248.08 MB/sec execute 295 sec latency 2.242 ms 2026-02-17T21:18:21.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 100267 13.00 MB/sec execute 295 sec latency 41.663 ms 2026-02-17T21:18:22.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 40207686 5248.15 MB/sec execute 296 sec latency 2.440 ms 2026-02-17T21:18:22.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 100503 12.99 MB/sec execute 296 sec latency 45.033 ms 2026-02-17T21:18:23.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:22 trial153 ceph-mon[25357]: pgmap v686: 129 pgs: 129 active+clean; 454 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 5.7 MiB/s wr, 215 op/s 2026-02-17T21:18:23.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:22 trial104 ceph-mon[20612]: pgmap v686: 129 pgs: 129 active+clean; 454 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 5.7 MiB/s wr, 215 op/s 2026-02-17T21:18:23.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 40303677 5248.01 MB/sec execute 297 sec latency 3.858 ms 2026-02-17T21:18:23.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 100745 12.97 MB/sec execute 297 sec latency 45.741 ms 2026-02-17T21:18:24.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 40398716 5248.01 MB/sec execute 298 sec latency 12.844 ms 2026-02-17T21:18:24.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 100985 12.96 MB/sec execute 298 sec latency 39.051 ms 2026-02-17T21:18:25.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:24 trial153 ceph-mon[25357]: pgmap v687: 129 pgs: 129 active+clean; 450 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 6.3 MiB/s wr, 226 op/s 2026-02-17T21:18:25.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:24 trial104 ceph-mon[20612]: pgmap v687: 129 pgs: 129 active+clean; 450 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 6.3 MiB/s wr, 226 op/s 2026-02-17T21:18:25.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 40496223 5248.07 MB/sec execute 299 sec latency 3.581 ms 2026-02-17T21:18:25.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 101232 12.96 MB/sec execute 299 sec latency 40.440 ms 2026-02-17T21:18:26.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 40590631 5247.55 MB/sec execute 300 sec latency 13.789 ms 2026-02-17T21:18:26.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 101474 12.94 MB/sec execute 300 sec latency 38.926 ms 2026-02-17T21:18:27.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:26 trial153 ceph-mon[25357]: pgmap v688: 129 pgs: 129 active+clean; 439 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 6.5 MiB/s wr, 267 op/s 2026-02-17T21:18:27.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:26 trial104 ceph-mon[20612]: pgmap v688: 129 pgs: 129 active+clean; 439 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 7.8 KiB/s rd, 6.5 MiB/s wr, 267 op/s 2026-02-17T21:18:27.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 40687616 5247.53 MB/sec execute 301 sec latency 2.518 ms 2026-02-17T21:18:27.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 101733 12.94 MB/sec execute 301 sec latency 38.351 ms 2026-02-17T21:18:28.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 40784763 5247.68 MB/sec execute 302 sec latency 4.183 ms 2026-02-17T21:18:28.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 102045 12.97 MB/sec execute 302 sec latency 40.212 ms 2026-02-17T21:18:29.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:28 trial153 ceph-mon[25357]: pgmap v689: 129 pgs: 129 active+clean; 417 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 253 op/s 2026-02-17T21:18:29.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:28 trial104 ceph-mon[20612]: pgmap v689: 129 pgs: 129 active+clean; 417 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 253 op/s 2026-02-17T21:18:29.886 INFO:tasks.workunit.client.0.trial104.stdout: 10 40881017 5247.81 MB/sec execute 303 sec latency 2.623 ms 2026-02-17T21:18:29.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 102291 12.98 MB/sec execute 303 sec latency 39.414 ms 2026-02-17T21:18:30.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:30 trial104 ceph-mon[20612]: pgmap v690: 129 pgs: 129 active+clean; 416 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.4 MiB/s wr, 288 op/s 2026-02-17T21:18:30.774 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:30 trial153 ceph-mon[25357]: pgmap v690: 129 pgs: 129 active+clean; 416 MiB data, 4.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.4 MiB/s wr, 288 op/s 2026-02-17T21:18:30.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 40975019 5247.22 MB/sec execute 304 sec latency 33.341 ms 2026-02-17T21:18:30.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 102576 13.03 MB/sec execute 304 sec latency 44.170 ms 2026-02-17T21:18:31.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 41071688 5247.11 MB/sec execute 305 sec latency 3.071 ms 2026-02-17T21:18:31.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 102880 13.06 MB/sec execute 305 sec latency 46.485 ms 2026-02-17T21:18:32.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 41169875 5247.32 MB/sec execute 306 sec latency 2.492 ms 2026-02-17T21:18:32.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 103030 13.04 MB/sec execute 306 sec latency 48.199 ms 2026-02-17T21:18:33.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:32 trial153 ceph-mon[25357]: pgmap v691: 129 pgs: 129 active+clean; 421 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 255 op/s 2026-02-17T21:18:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:32 trial104 ceph-mon[20612]: pgmap v691: 129 pgs: 129 active+clean; 421 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 255 op/s 2026-02-17T21:18:33.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 41266787 5247.41 MB/sec execute 307 sec latency 3.272 ms 2026-02-17T21:18:33.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 103242 13.04 MB/sec execute 307 sec latency 43.258 ms 2026-02-17T21:18:34.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:18:34.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:18:34.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 41363305 5247.60 MB/sec execute 308 sec latency 2.210 ms 2026-02-17T21:18:34.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 103452 13.03 MB/sec execute 308 sec latency 46.416 ms 2026-02-17T21:18:35.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:34 trial153 ceph-mon[25357]: pgmap v692: 129 pgs: 129 active+clean; 430 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 5.8 MiB/s wr, 234 op/s 2026-02-17T21:18:35.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:34 trial104 ceph-mon[20612]: pgmap v692: 129 pgs: 129 active+clean; 430 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 5.8 MiB/s wr, 234 op/s 2026-02-17T21:18:35.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 41458561 5247.22 MB/sec execute 309 sec latency 14.251 ms 2026-02-17T21:18:35.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 103649 13.00 MB/sec execute 309 sec latency 45.343 ms 2026-02-17T21:18:36.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 41554508 5246.98 MB/sec execute 310 sec latency 2.997 ms 2026-02-17T21:18:36.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 103868 12.99 MB/sec execute 310 sec latency 42.586 ms 2026-02-17T21:18:37.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:36 trial153 ceph-mon[25357]: pgmap v693: 129 pgs: 129 active+clean; 438 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 6.2 MiB/s wr, 260 op/s 2026-02-17T21:18:37.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:36 trial104 ceph-mon[20612]: pgmap v693: 129 pgs: 129 active+clean; 438 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.8 KiB/s rd, 6.2 MiB/s wr, 260 op/s 2026-02-17T21:18:37.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 41651437 5247.00 MB/sec execute 311 sec latency 4.037 ms 2026-02-17T21:18:37.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 104120 12.99 MB/sec execute 311 sec latency 53.512 ms 2026-02-17T21:18:38.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 41746684 5246.89 MB/sec execute 312 sec latency 3.761 ms 2026-02-17T21:18:38.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 104344 12.97 MB/sec execute 312 sec latency 41.674 ms 2026-02-17T21:18:39.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:38 trial153 ceph-mon[25357]: pgmap v694: 129 pgs: 129 active+clean; 439 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 234 op/s 2026-02-17T21:18:39.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:38 trial104 ceph-mon[20612]: pgmap v694: 129 pgs: 129 active+clean; 439 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.2 MiB/s wr, 234 op/s 2026-02-17T21:18:39.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 41843686 5247.06 MB/sec execute 313 sec latency 2.694 ms 2026-02-17T21:18:39.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 104582 12.96 MB/sec execute 313 sec latency 60.777 ms 2026-02-17T21:18:40.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 41940159 5246.91 MB/sec execute 314 sec latency 17.908 ms 2026-02-17T21:18:40.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 104828 12.96 MB/sec execute 314 sec latency 42.394 ms 2026-02-17T21:18:41.205 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:40 trial104 ceph-mon[20612]: pgmap v695: 129 pgs: 129 active+clean; 429 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 6.9 MiB/s wr, 274 op/s 2026-02-17T21:18:41.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:40 trial153 ceph-mon[25357]: pgmap v695: 129 pgs: 129 active+clean; 429 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 6.9 MiB/s wr, 274 op/s 2026-02-17T21:18:41.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 42036339 5246.69 MB/sec execute 315 sec latency 17.011 ms 2026-02-17T21:18:41.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 105057 12.94 MB/sec execute 315 sec latency 41.849 ms 2026-02-17T21:18:42.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 42133702 5246.82 MB/sec execute 316 sec latency 2.574 ms 2026-02-17T21:18:42.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 105328 12.94 MB/sec execute 316 sec latency 39.407 ms 2026-02-17T21:18:43.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:42 trial153 ceph-mon[25357]: pgmap v696: 129 pgs: 129 active+clean; 426 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 232 op/s 2026-02-17T21:18:43.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:42 trial104 ceph-mon[20612]: pgmap v696: 129 pgs: 129 active+clean; 426 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 232 op/s 2026-02-17T21:18:43.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 42230573 5247.17 MB/sec execute 317 sec latency 4.555 ms 2026-02-17T21:18:43.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 105633 12.97 MB/sec execute 317 sec latency 42.849 ms 2026-02-17T21:18:44.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 42327905 5247.15 MB/sec execute 318 sec latency 2.313 ms 2026-02-17T21:18:44.912 INFO:tasks.workunit.client.1.trial153.stdout: 10 105890 12.98 MB/sec execute 318 sec latency 39.685 ms 2026-02-17T21:18:45.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:44 trial153 ceph-mon[25357]: pgmap v697: 129 pgs: 129 active+clean; 423 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.9 MiB/s wr, 242 op/s 2026-02-17T21:18:45.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:44 trial104 ceph-mon[20612]: pgmap v697: 129 pgs: 129 active+clean; 423 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.9 MiB/s wr, 242 op/s 2026-02-17T21:18:45.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 42422892 5246.76 MB/sec execute 319 sec latency 18.345 ms 2026-02-17T21:18:45.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 106211 13.04 MB/sec execute 319 sec latency 42.807 ms 2026-02-17T21:18:46.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 42520131 5246.82 MB/sec execute 320 sec latency 4.184 ms 2026-02-17T21:18:46.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 106475 13.05 MB/sec execute 320 sec latency 45.436 ms 2026-02-17T21:18:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:46 trial153 ceph-mon[25357]: pgmap v698: 129 pgs: 129 active+clean; 434 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.6 MiB/s wr, 285 op/s 2026-02-17T21:18:47.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:46 trial104 ceph-mon[20612]: pgmap v698: 129 pgs: 129 active+clean; 434 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 5.6 MiB/s wr, 285 op/s 2026-02-17T21:18:47.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 42617541 5246.97 MB/sec execute 321 sec latency 2.688 ms 2026-02-17T21:18:47.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 106620 13.03 MB/sec execute 321 sec latency 41.950 ms 2026-02-17T21:18:48.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 42713695 5247.12 MB/sec execute 322 sec latency 3.028 ms 2026-02-17T21:18:48.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 106845 13.03 MB/sec execute 322 sec latency 44.517 ms 2026-02-17T21:18:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:48 trial153 ceph-mon[25357]: pgmap v699: 129 pgs: 129 active+clean; 442 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.5 MiB/s wr, 273 op/s 2026-02-17T21:18:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:18:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:48 trial104 ceph-mon[20612]: pgmap v699: 129 pgs: 129 active+clean; 442 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.5 MiB/s wr, 273 op/s 2026-02-17T21:18:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:18:49.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 42811035 5247.12 MB/sec execute 323 sec latency 2.409 ms 2026-02-17T21:18:49.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 107060 13.02 MB/sec execute 323 sec latency 48.692 ms 2026-02-17T21:18:50.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 42907329 5246.94 MB/sec execute 324 sec latency 3.194 ms 2026-02-17T21:18:50.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 107251 13.00 MB/sec execute 324 sec latency 43.612 ms 2026-02-17T21:18:51.215 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:50 trial104 ceph-mon[20612]: pgmap v700: 129 pgs: 129 active+clean; 453 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 6.5 MiB/s wr, 259 op/s 2026-02-17T21:18:51.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:50 trial153 ceph-mon[25357]: pgmap v700: 129 pgs: 129 active+clean; 453 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.5 KiB/s rd, 6.5 MiB/s wr, 259 op/s 2026-02-17T21:18:51.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 43004275 5246.95 MB/sec execute 325 sec latency 3.944 ms 2026-02-17T21:18:51.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 107472 12.98 MB/sec execute 325 sec latency 40.988 ms 2026-02-17T21:18:52.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 43101329 5247.08 MB/sec execute 326 sec latency 2.434 ms 2026-02-17T21:18:52.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 107737 12.98 MB/sec execute 326 sec latency 53.955 ms 2026-02-17T21:18:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:52 trial153 ceph-mon[25357]: pgmap v701: 129 pgs: 129 active+clean; 457 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 219 op/s 2026-02-17T21:18:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:52 trial104 ceph-mon[20612]: pgmap v701: 129 pgs: 129 active+clean; 457 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 219 op/s 2026-02-17T21:18:53.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 43196866 5247.05 MB/sec execute 327 sec latency 3.108 ms 2026-02-17T21:18:53.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 107984 12.97 MB/sec execute 327 sec latency 48.063 ms 2026-02-17T21:18:54.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 43294432 5247.11 MB/sec execute 328 sec latency 2.179 ms 2026-02-17T21:18:54.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 108232 12.96 MB/sec execute 328 sec latency 44.308 ms 2026-02-17T21:18:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:54 trial153 ceph-mon[25357]: pgmap v702: 129 pgs: 129 active+clean; 451 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 6.8 MiB/s wr, 265 op/s 2026-02-17T21:18:55.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:54 trial104 ceph-mon[20612]: pgmap v702: 129 pgs: 129 active+clean; 451 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 6.8 MiB/s wr, 265 op/s 2026-02-17T21:18:55.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 43391516 5247.04 MB/sec execute 329 sec latency 2.672 ms 2026-02-17T21:18:55.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 108465 12.96 MB/sec execute 329 sec latency 44.899 ms 2026-02-17T21:18:56.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 43486632 5246.80 MB/sec execute 330 sec latency 21.879 ms 2026-02-17T21:18:56.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 108714 12.95 MB/sec execute 330 sec latency 38.733 ms 2026-02-17T21:18:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:56 trial153 ceph-mon[25357]: pgmap v703: 129 pgs: 129 active+clean; 418 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 6.7 MiB/s wr, 277 op/s 2026-02-17T21:18:57.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:56 trial104 ceph-mon[20612]: pgmap v703: 129 pgs: 129 active+clean; 418 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 6.7 MiB/s wr, 277 op/s 2026-02-17T21:18:57.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 43583013 5246.85 MB/sec execute 331 sec latency 11.964 ms 2026-02-17T21:18:57.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 109034 12.97 MB/sec execute 331 sec latency 41.412 ms 2026-02-17T21:18:58.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 43680789 5247.12 MB/sec execute 332 sec latency 2.841 ms 2026-02-17T21:18:58.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 109307 12.98 MB/sec execute 332 sec latency 41.169 ms 2026-02-17T21:18:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:58 trial153 ceph-mon[25357]: pgmap v704: 129 pgs: 129 active+clean; 411 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 240 op/s 2026-02-17T21:18:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:58 trial104 ceph-mon[20612]: pgmap v704: 129 pgs: 129 active+clean; 411 MiB data, 4.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 240 op/s 2026-02-17T21:18:59.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 43778506 5247.20 MB/sec execute 333 sec latency 3.654 ms 2026-02-17T21:18:59.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 109560 13.01 MB/sec execute 333 sec latency 34.306 ms 2026-02-17T21:19:00.226 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:18:59 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:19:00.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:18:59 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:19:00.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 43870293 5246.34 MB/sec execute 334 sec latency 12.872 ms 2026-02-17T21:19:00.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 109875 13.05 MB/sec execute 334 sec latency 50.649 ms 2026-02-17T21:19:01.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:00 trial104 ceph-mon[20612]: pgmap v705: 129 pgs: 129 active+clean; 424 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.7 MiB/s wr, 288 op/s 2026-02-17T21:19:01.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:00 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:19:01.155 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:00 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:19:01.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:00 trial153 ceph-mon[25357]: pgmap v705: 129 pgs: 129 active+clean; 424 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.7 MiB/s wr, 288 op/s 2026-02-17T21:19:01.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:00 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:19:01.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:00 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:19:01.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 43964097 5245.83 MB/sec execute 335 sec latency 13.103 ms 2026-02-17T21:19:01.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 110078 13.05 MB/sec execute 335 sec latency 48.827 ms 2026-02-17T21:19:02.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:02 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:19:02.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:02 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:19:02.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:02 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:19:02.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:02 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:19:02.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:02 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:19:02.525 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:02 trial153 ceph-mon[25357]: pgmap v706: 129 pgs: 129 active+clean; 427 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 263 op/s 2026-02-17T21:19:02.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:02 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:19:02.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:02 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:19:02.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:02 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:19:02.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:02 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:19:02.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:02 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:19:02.655 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:02 trial104 ceph-mon[20612]: pgmap v706: 129 pgs: 129 active+clean; 427 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 263 op/s 2026-02-17T21:19:02.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 44060626 5246.08 MB/sec execute 336 sec latency 2.670 ms 2026-02-17T21:19:02.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 110254 13.04 MB/sec execute 336 sec latency 45.819 ms 2026-02-17T21:19:03.887 INFO:tasks.workunit.client.0.trial104.stdout: 10 44156840 5245.94 MB/sec execute 337 sec latency 4.422 ms 2026-02-17T21:19:03.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 110479 13.03 MB/sec execute 337 sec latency 51.897 ms 2026-02-17T21:19:04.024 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:19:04.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:19:04.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 44253697 5245.88 MB/sec execute 338 sec latency 2.618 ms 2026-02-17T21:19:04.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 110682 13.01 MB/sec execute 338 sec latency 55.628 ms 2026-02-17T21:19:05.023 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:04 trial153 ceph-mon[25357]: pgmap v707: 129 pgs: 129 active+clean; 433 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 5.8 MiB/s wr, 227 op/s 2026-02-17T21:19:05.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:04 trial104 ceph-mon[20612]: pgmap v707: 129 pgs: 129 active+clean; 433 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 5.8 MiB/s wr, 227 op/s 2026-02-17T21:19:05.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 44351405 5245.99 MB/sec execute 339 sec latency 1.610 ms 2026-02-17T21:19:05.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 110891 13.01 MB/sec execute 339 sec latency 43.754 ms 2026-02-17T21:19:06.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 44447682 5245.90 MB/sec execute 340 sec latency 3.385 ms 2026-02-17T21:19:06.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 111117 13.00 MB/sec execute 340 sec latency 46.661 ms 2026-02-17T21:19:07.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:06 trial153 ceph-mon[25357]: pgmap v708: 129 pgs: 129 active+clean; 443 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 6.1 MiB/s wr, 232 op/s 2026-02-17T21:19:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:06 trial104 ceph-mon[20612]: pgmap v708: 129 pgs: 129 active+clean; 443 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.2 KiB/s rd, 6.1 MiB/s wr, 232 op/s 2026-02-17T21:19:07.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 44542307 5245.85 MB/sec execute 341 sec latency 2.985 ms 2026-02-17T21:19:07.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 111353 12.98 MB/sec execute 341 sec latency 42.962 ms 2026-02-17T21:19:08.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 44639486 5245.83 MB/sec execute 342 sec latency 4.549 ms 2026-02-17T21:19:08.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 111596 12.97 MB/sec execute 342 sec latency 39.102 ms 2026-02-17T21:19:09.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:08 trial153 ceph-mon[25357]: pgmap v709: 129 pgs: 129 active+clean; 445 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 239 op/s 2026-02-17T21:19:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:08 trial104 ceph-mon[20612]: pgmap v709: 129 pgs: 129 active+clean; 445 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 239 op/s 2026-02-17T21:19:09.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 44737852 5245.97 MB/sec execute 343 sec latency 2.519 ms 2026-02-17T21:19:09.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 111855 12.97 MB/sec execute 343 sec latency 42.049 ms 2026-02-17T21:19:10.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 44832568 5245.62 MB/sec execute 344 sec latency 16.350 ms 2026-02-17T21:19:10.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 112089 12.95 MB/sec execute 344 sec latency 42.398 ms 2026-02-17T21:19:11.205 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:10 trial104 ceph-mon[20612]: pgmap v710: 129 pgs: 129 active+clean; 431 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 7.1 MiB/s wr, 298 op/s 2026-02-17T21:19:11.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:10 trial153 ceph-mon[25357]: pgmap v710: 129 pgs: 129 active+clean; 431 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 7.1 MiB/s wr, 298 op/s 2026-02-17T21:19:11.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 44925389 5245.06 MB/sec execute 345 sec latency 48.320 ms 2026-02-17T21:19:11.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 112349 12.96 MB/sec execute 345 sec latency 40.335 ms 2026-02-17T21:19:12.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 45021134 5245.15 MB/sec execute 346 sec latency 17.053 ms 2026-02-17T21:19:12.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 112652 12.98 MB/sec execute 346 sec latency 44.883 ms 2026-02-17T21:19:13.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:12 trial153 ceph-mon[25357]: pgmap v711: 129 pgs: 129 active+clean; 430 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 224 op/s 2026-02-17T21:19:13.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:12 trial104 ceph-mon[20612]: pgmap v711: 129 pgs: 129 active+clean; 430 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 224 op/s 2026-02-17T21:19:13.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 45119777 5245.34 MB/sec execute 347 sec latency 2.424 ms 2026-02-17T21:19:13.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 112916 12.99 MB/sec execute 347 sec latency 40.557 ms 2026-02-17T21:19:14.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 45218431 5245.57 MB/sec execute 348 sec latency 1.680 ms 2026-02-17T21:19:14.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 113180 13.02 MB/sec execute 348 sec latency 41.202 ms 2026-02-17T21:19:15.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:14 trial153 ceph-mon[25357]: pgmap v712: 129 pgs: 129 active+clean; 430 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 5.8 MiB/s wr, 245 op/s 2026-02-17T21:19:15.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:14 trial104 ceph-mon[20612]: pgmap v712: 129 pgs: 129 active+clean; 430 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 5.8 MiB/s wr, 245 op/s 2026-02-17T21:19:15.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 45314734 5245.45 MB/sec execute 349 sec latency 3.527 ms 2026-02-17T21:19:15.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 113490 13.05 MB/sec execute 349 sec latency 45.324 ms 2026-02-17T21:19:16.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 45411715 5245.65 MB/sec execute 350 sec latency 3.553 ms 2026-02-17T21:19:16.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 113655 13.04 MB/sec execute 350 sec latency 47.279 ms 2026-02-17T21:19:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:16 trial153 ceph-mon[25357]: pgmap v713: 129 pgs: 129 active+clean; 441 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 5.9 MiB/s wr, 292 op/s 2026-02-17T21:19:17.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:16 trial104 ceph-mon[20612]: pgmap v713: 129 pgs: 129 active+clean; 441 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 5.9 MiB/s wr, 292 op/s 2026-02-17T21:19:17.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 45509347 5245.88 MB/sec execute 351 sec latency 1.647 ms 2026-02-17T21:19:17.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 113841 13.03 MB/sec execute 351 sec latency 42.596 ms 2026-02-17T21:19:18.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 45606029 5245.78 MB/sec execute 352 sec latency 2.191 ms 2026-02-17T21:19:18.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 114068 13.03 MB/sec execute 352 sec latency 51.133 ms 2026-02-17T21:19:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:18 trial153 ceph-mon[25357]: pgmap v714: 129 pgs: 129 active+clean; 447 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 247 op/s 2026-02-17T21:19:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:19:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:18 trial104 ceph-mon[20612]: pgmap v714: 129 pgs: 129 active+clean; 447 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 247 op/s 2026-02-17T21:19:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:19:19.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 45703449 5245.85 MB/sec execute 353 sec latency 3.418 ms 2026-02-17T21:19:19.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 114267 13.00 MB/sec execute 353 sec latency 43.385 ms 2026-02-17T21:19:20.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 45801988 5246.10 MB/sec execute 354 sec latency 2.916 ms 2026-02-17T21:19:20.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 114484 13.00 MB/sec execute 354 sec latency 47.035 ms 2026-02-17T21:19:21.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:20 trial153 ceph-mon[25357]: pgmap v715: 129 pgs: 129 active+clean; 461 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.8 MiB/s wr, 281 op/s 2026-02-17T21:19:21.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:20 trial104 ceph-mon[20612]: pgmap v715: 129 pgs: 129 active+clean; 461 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.8 MiB/s wr, 281 op/s 2026-02-17T21:19:21.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 45898553 5246.37 MB/sec execute 355 sec latency 2.751 ms 2026-02-17T21:19:21.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 114732 13.00 MB/sec execute 355 sec latency 40.567 ms 2026-02-17T21:19:22.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 45994986 5246.22 MB/sec execute 356 sec latency 2.328 ms 2026-02-17T21:19:22.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 114967 12.98 MB/sec execute 356 sec latency 42.105 ms 2026-02-17T21:19:23.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:22 trial153 ceph-mon[25357]: pgmap v716: 129 pgs: 129 active+clean; 458 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 205 op/s 2026-02-17T21:19:23.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:22 trial104 ceph-mon[20612]: pgmap v716: 129 pgs: 129 active+clean; 458 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 205 op/s 2026-02-17T21:19:23.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 46090779 5246.00 MB/sec execute 357 sec latency 4.250 ms 2026-02-17T21:19:23.913 INFO:tasks.workunit.client.1.trial153.stdout: 10 115198 12.96 MB/sec execute 357 sec latency 46.535 ms 2026-02-17T21:19:24.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 46187292 5245.93 MB/sec execute 358 sec latency 4.370 ms 2026-02-17T21:19:24.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 115454 12.96 MB/sec execute 358 sec latency 43.642 ms 2026-02-17T21:19:25.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:24 trial153 ceph-mon[25357]: pgmap v717: 129 pgs: 129 active+clean; 448 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 6.3 MiB/s wr, 219 op/s 2026-02-17T21:19:25.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:24 trial104 ceph-mon[20612]: pgmap v717: 129 pgs: 129 active+clean; 448 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 6.3 MiB/s wr, 219 op/s 2026-02-17T21:19:25.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 46284775 5246.05 MB/sec execute 359 sec latency 2.373 ms 2026-02-17T21:19:25.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 115677 12.95 MB/sec execute 359 sec latency 62.898 ms 2026-02-17T21:19:26.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 46376876 5245.60 MB/sec execute 360 sec latency 25.691 ms 2026-02-17T21:19:26.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 115942 12.95 MB/sec execute 360 sec latency 45.543 ms 2026-02-17T21:19:27.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:26 trial153 ceph-mon[25357]: pgmap v718: 129 pgs: 129 active+clean; 419 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 6.4 MiB/s wr, 277 op/s 2026-02-17T21:19:27.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:26 trial104 ceph-mon[20612]: pgmap v718: 129 pgs: 129 active+clean; 419 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 6.4 MiB/s wr, 277 op/s 2026-02-17T21:19:27.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 46471977 5245.26 MB/sec execute 361 sec latency 16.923 ms 2026-02-17T21:19:27.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 116255 12.98 MB/sec execute 361 sec latency 39.010 ms 2026-02-17T21:19:28.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 46569374 5245.30 MB/sec execute 362 sec latency 2.848 ms 2026-02-17T21:19:28.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 116508 12.98 MB/sec execute 362 sec latency 35.956 ms 2026-02-17T21:19:29.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:28 trial153 ceph-mon[25357]: pgmap v719: 129 pgs: 129 active+clean; 411 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 233 op/s 2026-02-17T21:19:29.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:28 trial104 ceph-mon[20612]: pgmap v719: 129 pgs: 129 active+clean; 411 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 233 op/s 2026-02-17T21:19:29.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 46666480 5245.30 MB/sec execute 363 sec latency 2.146 ms 2026-02-17T21:19:29.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 116809 13.04 MB/sec execute 363 sec latency 39.959 ms 2026-02-17T21:19:30.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 46763154 5245.40 MB/sec execute 364 sec latency 3.502 ms 2026-02-17T21:19:30.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 117097 13.05 MB/sec execute 364 sec latency 46.048 ms 2026-02-17T21:19:31.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:30 trial153 ceph-mon[25357]: pgmap v720: 129 pgs: 129 active+clean; 423 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 6.3 MiB/s wr, 300 op/s 2026-02-17T21:19:31.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:30 trial104 ceph-mon[20612]: pgmap v720: 129 pgs: 129 active+clean; 423 MiB data, 4.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 6.3 MiB/s wr, 300 op/s 2026-02-17T21:19:31.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 46860526 5245.65 MB/sec execute 365 sec latency 2.979 ms 2026-02-17T21:19:31.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 117243 13.03 MB/sec execute 365 sec latency 38.454 ms 2026-02-17T21:19:32.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 46957741 5245.62 MB/sec execute 366 sec latency 3.394 ms 2026-02-17T21:19:32.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 117460 13.03 MB/sec execute 366 sec latency 47.174 ms 2026-02-17T21:19:33.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:32 trial153 ceph-mon[25357]: pgmap v721: 129 pgs: 129 active+clean; 426 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.6 MiB/s wr, 226 op/s 2026-02-17T21:19:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:32 trial104 ceph-mon[20612]: pgmap v721: 129 pgs: 129 active+clean; 426 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.6 MiB/s wr, 226 op/s 2026-02-17T21:19:33.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 47053958 5245.48 MB/sec execute 367 sec latency 3.232 ms 2026-02-17T21:19:33.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 117672 13.02 MB/sec execute 367 sec latency 60.662 ms 2026-02-17T21:19:34.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:19:34.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:19:34.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 47150189 5245.39 MB/sec execute 368 sec latency 4.206 ms 2026-02-17T21:19:34.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 117873 13.00 MB/sec execute 368 sec latency 41.160 ms 2026-02-17T21:19:35.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:34 trial153 ceph-mon[25357]: pgmap v722: 129 pgs: 129 active+clean; 433 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 5.8 MiB/s wr, 235 op/s 2026-02-17T21:19:35.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:34 trial104 ceph-mon[20612]: pgmap v722: 129 pgs: 129 active+clean; 433 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 5.8 MiB/s wr, 235 op/s 2026-02-17T21:19:35.888 INFO:tasks.workunit.client.0.trial104.stdout: 10 47247212 5245.55 MB/sec execute 369 sec latency 3.564 ms 2026-02-17T21:19:35.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 118077 12.99 MB/sec execute 369 sec latency 42.170 ms 2026-02-17T21:19:36.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 47343909 5245.66 MB/sec execute 370 sec latency 3.995 ms 2026-02-17T21:19:36.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 118326 12.99 MB/sec execute 370 sec latency 42.770 ms 2026-02-17T21:19:37.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:36 trial104 ceph-mon[20612]: pgmap v723: 129 pgs: 129 active+clean; 440 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 6.6 MiB/s wr, 284 op/s 2026-02-17T21:19:37.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:36 trial153 ceph-mon[25357]: pgmap v723: 129 pgs: 129 active+clean; 440 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 6.6 MiB/s wr, 284 op/s 2026-02-17T21:19:37.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 47440341 5245.50 MB/sec execute 371 sec latency 3.522 ms 2026-02-17T21:19:37.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 118563 12.97 MB/sec execute 371 sec latency 46.321 ms 2026-02-17T21:19:38.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 47537637 5245.56 MB/sec execute 372 sec latency 3.777 ms 2026-02-17T21:19:38.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 118802 12.96 MB/sec execute 372 sec latency 41.224 ms 2026-02-17T21:19:39.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:38 trial153 ceph-mon[25357]: pgmap v724: 129 pgs: 129 active+clean; 435 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 217 op/s 2026-02-17T21:19:39.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:38 trial104 ceph-mon[20612]: pgmap v724: 129 pgs: 129 active+clean; 435 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 217 op/s 2026-02-17T21:19:39.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 47633753 5245.44 MB/sec execute 373 sec latency 3.829 ms 2026-02-17T21:19:39.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 119046 12.96 MB/sec execute 373 sec latency 41.709 ms 2026-02-17T21:19:40.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 47729791 5245.58 MB/sec execute 374 sec latency 3.249 ms 2026-02-17T21:19:40.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 119282 12.94 MB/sec execute 374 sec latency 40.633 ms 2026-02-17T21:19:41.206 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:40 trial104 ceph-mon[20612]: pgmap v725: 129 pgs: 129 active+clean; 426 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 6.9 MiB/s wr, 291 op/s 2026-02-17T21:19:41.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:40 trial153 ceph-mon[25357]: pgmap v725: 129 pgs: 129 active+clean; 426 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 6.9 MiB/s wr, 291 op/s 2026-02-17T21:19:41.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 47824994 5245.32 MB/sec execute 375 sec latency 12.581 ms 2026-02-17T21:19:41.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 119560 12.96 MB/sec execute 375 sec latency 38.811 ms 2026-02-17T21:19:42.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 47918607 5244.79 MB/sec execute 376 sec latency 41.350 ms 2026-02-17T21:19:42.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 119885 12.98 MB/sec execute 376 sec latency 37.133 ms 2026-02-17T21:19:43.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:42 trial153 ceph-mon[25357]: pgmap v726: 129 pgs: 129 active+clean; 425 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 221 op/s 2026-02-17T21:19:43.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:42 trial104 ceph-mon[20612]: pgmap v726: 129 pgs: 129 active+clean; 425 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 221 op/s 2026-02-17T21:19:43.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 48014030 5244.57 MB/sec execute 377 sec latency 17.619 ms 2026-02-17T21:19:43.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 120128 12.99 MB/sec execute 377 sec latency 35.140 ms 2026-02-17T21:19:44.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 48111449 5244.68 MB/sec execute 378 sec latency 2.383 ms 2026-02-17T21:19:44.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 120445 13.04 MB/sec execute 378 sec latency 43.430 ms 2026-02-17T21:19:45.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:44 trial153 ceph-mon[25357]: pgmap v727: 129 pgs: 129 active+clean; 432 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 6.1 MiB/s wr, 268 op/s 2026-02-17T21:19:45.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:44 trial104 ceph-mon[20612]: pgmap v727: 129 pgs: 129 active+clean; 432 MiB data, 4.8 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 6.1 MiB/s wr, 268 op/s 2026-02-17T21:19:45.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 48208335 5244.94 MB/sec execute 379 sec latency 2.123 ms 2026-02-17T21:19:45.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 120688 13.05 MB/sec execute 379 sec latency 55.449 ms 2026-02-17T21:19:46.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 48306068 5245.02 MB/sec execute 380 sec latency 2.724 ms 2026-02-17T21:19:46.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 120829 13.02 MB/sec execute 380 sec latency 43.635 ms 2026-02-17T21:19:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:46 trial153 ceph-mon[25357]: pgmap v728: 129 pgs: 129 active+clean; 441 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.9 MiB/s wr, 286 op/s 2026-02-17T21:19:47.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:46 trial104 ceph-mon[20612]: pgmap v728: 129 pgs: 129 active+clean; 441 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.9 MiB/s wr, 286 op/s 2026-02-17T21:19:47.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 48404067 5245.13 MB/sec execute 381 sec latency 2.205 ms 2026-02-17T21:19:47.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 121056 13.03 MB/sec execute 381 sec latency 46.286 ms 2026-02-17T21:19:48.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 48500534 5245.02 MB/sec execute 382 sec latency 3.994 ms 2026-02-17T21:19:48.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 121265 13.01 MB/sec execute 382 sec latency 59.125 ms 2026-02-17T21:19:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:48 trial153 ceph-mon[25357]: pgmap v729: 129 pgs: 129 active+clean; 445 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 237 op/s 2026-02-17T21:19:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:19:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:48 trial104 ceph-mon[20612]: pgmap v729: 129 pgs: 129 active+clean; 445 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 237 op/s 2026-02-17T21:19:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:19:49.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 48596584 5245.04 MB/sec execute 383 sec latency 4.034 ms 2026-02-17T21:19:49.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 121462 13.00 MB/sec execute 383 sec latency 43.952 ms 2026-02-17T21:19:50.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 48692702 5245.08 MB/sec execute 384 sec latency 4.376 ms 2026-02-17T21:19:50.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 121674 12.98 MB/sec execute 384 sec latency 50.820 ms 2026-02-17T21:19:51.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:50 trial153 ceph-mon[25357]: pgmap v730: 129 pgs: 129 active+clean; 457 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 7.0 MiB/s wr, 300 op/s 2026-02-17T21:19:51.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:50 trial104 ceph-mon[20612]: pgmap v730: 129 pgs: 129 active+clean; 457 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 7.0 MiB/s wr, 300 op/s 2026-02-17T21:19:51.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 48790611 5245.16 MB/sec execute 385 sec latency 1.396 ms 2026-02-17T21:19:51.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 121929 12.98 MB/sec execute 385 sec latency 41.310 ms 2026-02-17T21:19:52.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 48887137 5245.05 MB/sec execute 386 sec latency 3.206 ms 2026-02-17T21:19:52.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 122170 12.97 MB/sec execute 386 sec latency 46.802 ms 2026-02-17T21:19:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:52 trial153 ceph-mon[25357]: pgmap v731: 129 pgs: 129 active+clean; 452 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 214 op/s 2026-02-17T21:19:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:52 trial104 ceph-mon[20612]: pgmap v731: 129 pgs: 129 active+clean; 452 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 214 op/s 2026-02-17T21:19:53.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 48983536 5245.03 MB/sec execute 387 sec latency 4.727 ms 2026-02-17T21:19:53.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 122418 12.96 MB/sec execute 387 sec latency 40.480 ms 2026-02-17T21:19:54.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 49080296 5245.18 MB/sec execute 388 sec latency 5.191 ms 2026-02-17T21:19:54.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 122651 12.96 MB/sec execute 388 sec latency 37.585 ms 2026-02-17T21:19:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:54 trial153 ceph-mon[25357]: pgmap v732: 129 pgs: 129 active+clean; 442 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 6.5 MiB/s wr, 232 op/s 2026-02-17T21:19:55.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:54 trial104 ceph-mon[20612]: pgmap v732: 129 pgs: 129 active+clean; 442 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 6.5 MiB/s wr, 232 op/s 2026-02-17T21:19:55.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 49176955 5245.23 MB/sec execute 389 sec latency 4.654 ms 2026-02-17T21:19:55.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 122898 12.95 MB/sec execute 389 sec latency 39.486 ms 2026-02-17T21:19:56.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 49271501 5244.85 MB/sec execute 390 sec latency 19.934 ms 2026-02-17T21:19:56.914 INFO:tasks.workunit.client.1.trial153.stdout: 10 123203 12.97 MB/sec execute 390 sec latency 42.743 ms 2026-02-17T21:19:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:56 trial153 ceph-mon[25357]: pgmap v733: 129 pgs: 129 active+clean; 413 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 6.2 MiB/s wr, 264 op/s 2026-02-17T21:19:57.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:56 trial104 ceph-mon[20612]: pgmap v733: 129 pgs: 129 active+clean; 413 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 6.2 MiB/s wr, 264 op/s 2026-02-17T21:19:57.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 49365276 5244.41 MB/sec execute 391 sec latency 32.287 ms 2026-02-17T21:19:57.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 123500 12.98 MB/sec execute 391 sec latency 37.029 ms 2026-02-17T21:19:58.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 49462518 5244.43 MB/sec execute 392 sec latency 8.889 ms 2026-02-17T21:19:58.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 123737 13.00 MB/sec execute 392 sec latency 43.352 ms 2026-02-17T21:19:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:19:58 trial153 ceph-mon[25357]: pgmap v734: 129 pgs: 129 active+clean; 414 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 251 op/s 2026-02-17T21:19:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:19:58 trial104 ceph-mon[20612]: pgmap v734: 129 pgs: 129 active+clean; 414 MiB data, 4.9 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 251 op/s 2026-02-17T21:19:59.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 49559859 5244.66 MB/sec execute 393 sec latency 4.044 ms 2026-02-17T21:19:59.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 124038 13.04 MB/sec execute 393 sec latency 45.242 ms 2026-02-17T21:20:00.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 49657334 5244.83 MB/sec execute 394 sec latency 2.557 ms 2026-02-17T21:20:00.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 124259 13.04 MB/sec execute 394 sec latency 45.404 ms 2026-02-17T21:20:01.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:00 trial153 ceph-mon[25357]: pgmap v735: 129 pgs: 129 active+clean; 430 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 6.8 MiB/s wr, 305 op/s 2026-02-17T21:20:01.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:00 trial153 ceph-mon[25357]: overall HEALTH_OK 2026-02-17T21:20:01.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:00 trial104 ceph-mon[20612]: pgmap v735: 129 pgs: 129 active+clean; 430 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 6.8 MiB/s wr, 305 op/s 2026-02-17T21:20:01.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:00 trial104 ceph-mon[20612]: overall HEALTH_OK 2026-02-17T21:20:01.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 49754026 5244.74 MB/sec execute 395 sec latency 2.776 ms 2026-02-17T21:20:01.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 124420 13.03 MB/sec execute 395 sec latency 47.259 ms 2026-02-17T21:20:02.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:01 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:20:02.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:01 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:20:02.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:01 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:20:02.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:01 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:20:02.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:01 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:20:02.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:01 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:20:02.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:01 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:20:02.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:01 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:20:02.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 49850529 5244.69 MB/sec execute 396 sec latency 2.616 ms 2026-02-17T21:20:02.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 124644 13.02 MB/sec execute 396 sec latency 56.816 ms 2026-02-17T21:20:03.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:02 trial153 ceph-mon[25357]: pgmap v736: 129 pgs: 129 active+clean; 432 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 5.0 MiB/s wr, 228 op/s 2026-02-17T21:20:03.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:02 trial104 ceph-mon[20612]: pgmap v736: 129 pgs: 129 active+clean; 432 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 13 KiB/s rd, 5.0 MiB/s wr, 228 op/s 2026-02-17T21:20:03.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 49946159 5244.54 MB/sec execute 397 sec latency 4.038 ms 2026-02-17T21:20:03.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 124848 13.00 MB/sec execute 397 sec latency 54.898 ms 2026-02-17T21:20:04.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:20:04.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:20:04.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 50042047 5244.65 MB/sec execute 398 sec latency 3.724 ms 2026-02-17T21:20:04.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 125054 13.00 MB/sec execute 398 sec latency 48.883 ms 2026-02-17T21:20:05.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:04 trial153 ceph-mon[25357]: pgmap v737: 129 pgs: 129 active+clean; 438 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 6.0 MiB/s wr, 244 op/s 2026-02-17T21:20:05.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:04 trial104 ceph-mon[20612]: pgmap v737: 129 pgs: 129 active+clean; 438 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 6.0 MiB/s wr, 244 op/s 2026-02-17T21:20:05.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 50139882 5244.73 MB/sec execute 399 sec latency 1.711 ms 2026-02-17T21:20:05.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 125254 12.98 MB/sec execute 399 sec latency 52.453 ms 2026-02-17T21:20:06.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 50236887 5244.69 MB/sec execute 400 sec latency 4.232 ms 2026-02-17T21:20:06.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 125507 12.97 MB/sec execute 400 sec latency 42.707 ms 2026-02-17T21:20:07.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:06 trial153 ceph-mon[25357]: pgmap v738: 129 pgs: 129 active+clean; 443 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 6.6 MiB/s wr, 269 op/s 2026-02-17T21:20:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:06 trial104 ceph-mon[20612]: pgmap v738: 129 pgs: 129 active+clean; 443 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 6.6 MiB/s wr, 269 op/s 2026-02-17T21:20:07.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 50332420 5244.48 MB/sec execute 401 sec latency 4.176 ms 2026-02-17T21:20:07.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 125750 12.96 MB/sec execute 401 sec latency 39.654 ms 2026-02-17T21:20:08.889 INFO:tasks.workunit.client.0.trial104.stdout: 10 50429358 5244.58 MB/sec execute 402 sec latency 2.474 ms 2026-02-17T21:20:08.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 126004 12.96 MB/sec execute 402 sec latency 42.152 ms 2026-02-17T21:20:09.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:08 trial153 ceph-mon[25357]: pgmap v739: 129 pgs: 129 active+clean; 438 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 201 op/s 2026-02-17T21:20:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:08 trial104 ceph-mon[20612]: pgmap v739: 129 pgs: 129 active+clean; 438 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 201 op/s 2026-02-17T21:20:09.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 50525441 5244.68 MB/sec execute 403 sec latency 2.215 ms 2026-02-17T21:20:09.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 126236 12.95 MB/sec execute 403 sec latency 40.266 ms 2026-02-17T21:20:10.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 50622239 5244.62 MB/sec execute 404 sec latency 3.675 ms 2026-02-17T21:20:10.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 126496 12.95 MB/sec execute 404 sec latency 45.691 ms 2026-02-17T21:20:11.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:10 trial153 ceph-mon[25357]: pgmap v740: 129 pgs: 129 active+clean; 429 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.3 KiB/s rd, 6.9 MiB/s wr, 290 op/s 2026-02-17T21:20:11.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:10 trial104 ceph-mon[20612]: pgmap v740: 129 pgs: 129 active+clean; 429 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.3 KiB/s rd, 6.9 MiB/s wr, 290 op/s 2026-02-17T21:20:11.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 50719796 5244.63 MB/sec execute 405 sec latency 3.011 ms 2026-02-17T21:20:11.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 126788 12.96 MB/sec execute 405 sec latency 38.010 ms 2026-02-17T21:20:12.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 50812381 5244.12 MB/sec execute 406 sec latency 18.258 ms 2026-02-17T21:20:12.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 127088 12.98 MB/sec execute 406 sec latency 42.208 ms 2026-02-17T21:20:13.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:12 trial153 ceph-mon[25357]: pgmap v741: 129 pgs: 129 active+clean; 429 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 223 op/s 2026-02-17T21:20:13.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:12 trial104 ceph-mon[20612]: pgmap v741: 129 pgs: 129 active+clean; 429 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 223 op/s 2026-02-17T21:20:13.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 50908549 5244.12 MB/sec execute 407 sec latency 12.154 ms 2026-02-17T21:20:13.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 127329 13.00 MB/sec execute 407 sec latency 44.993 ms 2026-02-17T21:20:14.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 51005893 5244.30 MB/sec execute 408 sec latency 2.471 ms 2026-02-17T21:20:14.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 127625 13.03 MB/sec execute 408 sec latency 45.847 ms 2026-02-17T21:20:15.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:14 trial153 ceph-mon[25357]: pgmap v742: 129 pgs: 129 active+clean; 433 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 5.6 MiB/s wr, 238 op/s 2026-02-17T21:20:15.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:14 trial104 ceph-mon[20612]: pgmap v742: 129 pgs: 129 active+clean; 433 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 5.6 MiB/s wr, 238 op/s 2026-02-17T21:20:15.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 51103586 5244.33 MB/sec execute 409 sec latency 2.639 ms 2026-02-17T21:20:15.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 127830 13.03 MB/sec execute 409 sec latency 63.906 ms 2026-02-17T21:20:16.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 51201072 5244.42 MB/sec execute 410 sec latency 2.767 ms 2026-02-17T21:20:16.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 128002 13.02 MB/sec execute 410 sec latency 43.620 ms 2026-02-17T21:20:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:16 trial153 ceph-mon[25357]: pgmap v743: 129 pgs: 129 active+clean; 447 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 6.0 MiB/s wr, 279 op/s 2026-02-17T21:20:17.353 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:16 trial104 ceph-mon[20612]: pgmap v743: 129 pgs: 129 active+clean; 447 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 6.0 MiB/s wr, 279 op/s 2026-02-17T21:20:17.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 51298066 5244.43 MB/sec execute 411 sec latency 3.390 ms 2026-02-17T21:20:17.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 128224 13.01 MB/sec execute 411 sec latency 49.420 ms 2026-02-17T21:20:18.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 51393432 5244.39 MB/sec execute 412 sec latency 4.485 ms 2026-02-17T21:20:18.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 128434 13.00 MB/sec execute 412 sec latency 44.741 ms 2026-02-17T21:20:19.250 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:18 trial153 ceph-mon[25357]: pgmap v744: 129 pgs: 129 active+clean; 440 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 240 op/s 2026-02-17T21:20:19.250 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:20:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:18 trial104 ceph-mon[20612]: pgmap v744: 129 pgs: 129 active+clean; 440 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 240 op/s 2026-02-17T21:20:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:20:19.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 51490021 5244.42 MB/sec execute 413 sec latency 3.564 ms 2026-02-17T21:20:19.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 128640 12.99 MB/sec execute 413 sec latency 43.718 ms 2026-02-17T21:20:20.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 51585919 5244.23 MB/sec execute 414 sec latency 3.463 ms 2026-02-17T21:20:20.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 128868 12.98 MB/sec execute 414 sec latency 42.131 ms 2026-02-17T21:20:21.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:20 trial153 ceph-mon[25357]: pgmap v745: 129 pgs: 129 active+clean; 432 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 7.1 MiB/s wr, 307 op/s 2026-02-17T21:20:21.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:20 trial104 ceph-mon[20612]: pgmap v745: 129 pgs: 129 active+clean; 432 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 7.1 MiB/s wr, 307 op/s 2026-02-17T21:20:21.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 51682157 5244.14 MB/sec execute 415 sec latency 2.868 ms 2026-02-17T21:20:21.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 129125 12.98 MB/sec execute 415 sec latency 53.101 ms 2026-02-17T21:20:22.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 51778499 5244.12 MB/sec execute 416 sec latency 5.694 ms 2026-02-17T21:20:22.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 129354 12.96 MB/sec execute 416 sec latency 49.229 ms 2026-02-17T21:20:23.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:22 trial153 ceph-mon[25357]: pgmap v746: 129 pgs: 129 active+clean; 431 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 206 op/s 2026-02-17T21:20:23.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:22 trial104 ceph-mon[20612]: pgmap v746: 129 pgs: 129 active+clean; 431 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 206 op/s 2026-02-17T21:20:23.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 51873112 5244.00 MB/sec execute 417 sec latency 10.003 ms 2026-02-17T21:20:23.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 129607 12.96 MB/sec execute 417 sec latency 43.311 ms 2026-02-17T21:20:24.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 51970275 5244.01 MB/sec execute 418 sec latency 2.298 ms 2026-02-17T21:20:24.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 129847 12.95 MB/sec execute 418 sec latency 41.505 ms 2026-02-17T21:20:25.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:24 trial153 ceph-mon[25357]: pgmap v747: 129 pgs: 129 active+clean; 421 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 6.3 MiB/s wr, 222 op/s 2026-02-17T21:20:25.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:24 trial104 ceph-mon[20612]: pgmap v747: 129 pgs: 129 active+clean; 421 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 6.3 MiB/s wr, 222 op/s 2026-02-17T21:20:25.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 52066771 5243.93 MB/sec execute 419 sec latency 5.203 ms 2026-02-17T21:20:25.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 130096 12.95 MB/sec execute 419 sec latency 73.168 ms 2026-02-17T21:20:26.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 52163974 5243.96 MB/sec execute 420 sec latency 2.158 ms 2026-02-17T21:20:26.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 130408 12.97 MB/sec execute 420 sec latency 40.602 ms 2026-02-17T21:20:27.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:26 trial153 ceph-mon[25357]: pgmap v748: 129 pgs: 129 active+clean; 416 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 6.2 MiB/s wr, 285 op/s 2026-02-17T21:20:27.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:26 trial104 ceph-mon[20612]: pgmap v748: 129 pgs: 129 active+clean; 416 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 6.2 MiB/s wr, 285 op/s 2026-02-17T21:20:27.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 52259042 5243.80 MB/sec execute 421 sec latency 13.094 ms 2026-02-17T21:20:27.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 130675 12.98 MB/sec execute 421 sec latency 42.901 ms 2026-02-17T21:20:28.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 52355128 5243.91 MB/sec execute 422 sec latency 12.328 ms 2026-02-17T21:20:28.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 130939 13.00 MB/sec execute 422 sec latency 41.302 ms 2026-02-17T21:20:29.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:28 trial153 ceph-mon[25357]: pgmap v749: 129 pgs: 129 active+clean; 417 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 242 op/s 2026-02-17T21:20:29.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:28 trial104 ceph-mon[20612]: pgmap v749: 129 pgs: 129 active+clean; 417 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 242 op/s 2026-02-17T21:20:29.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 52451395 5243.78 MB/sec execute 423 sec latency 18.091 ms 2026-02-17T21:20:29.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 131236 13.03 MB/sec execute 423 sec latency 39.237 ms 2026-02-17T21:20:30.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:30 trial104 ceph-mon[20612]: pgmap v750: 129 pgs: 129 active+clean; 431 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 6.2 MiB/s wr, 284 op/s 2026-02-17T21:20:30.773 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:30 trial153 ceph-mon[25357]: pgmap v750: 129 pgs: 129 active+clean; 431 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 6.2 MiB/s wr, 284 op/s 2026-02-17T21:20:30.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 52548601 5243.80 MB/sec execute 424 sec latency 2.663 ms 2026-02-17T21:20:30.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 131417 13.02 MB/sec execute 424 sec latency 54.802 ms 2026-02-17T21:20:31.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 52646219 5243.87 MB/sec execute 425 sec latency 2.362 ms 2026-02-17T21:20:31.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 131617 13.02 MB/sec execute 425 sec latency 44.345 ms 2026-02-17T21:20:32.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 52742949 5243.96 MB/sec execute 426 sec latency 5.145 ms 2026-02-17T21:20:32.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 131823 13.01 MB/sec execute 426 sec latency 71.332 ms 2026-02-17T21:20:33.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:32 trial153 ceph-mon[25357]: pgmap v751: 129 pgs: 129 active+clean; 437 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.1 MiB/s wr, 240 op/s 2026-02-17T21:20:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:32 trial104 ceph-mon[20612]: pgmap v751: 129 pgs: 129 active+clean; 437 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.1 MiB/s wr, 240 op/s 2026-02-17T21:20:33.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 52838084 5243.85 MB/sec execute 427 sec latency 16.066 ms 2026-02-17T21:20:33.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 132029 12.99 MB/sec execute 427 sec latency 45.844 ms 2026-02-17T21:20:34.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:33 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:20:34.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:33 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:20:34.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 52936589 5244.03 MB/sec execute 428 sec latency 2.471 ms 2026-02-17T21:20:34.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 132240 12.98 MB/sec execute 428 sec latency 44.963 ms 2026-02-17T21:20:35.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:34 trial153 ceph-mon[25357]: pgmap v752: 129 pgs: 129 active+clean; 441 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 6.1 MiB/s wr, 248 op/s 2026-02-17T21:20:35.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:34 trial104 ceph-mon[20612]: pgmap v752: 129 pgs: 129 active+clean; 441 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 6.1 MiB/s wr, 248 op/s 2026-02-17T21:20:35.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 53034985 5244.20 MB/sec execute 429 sec latency 2.441 ms 2026-02-17T21:20:35.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 132488 12.98 MB/sec execute 429 sec latency 47.983 ms 2026-02-17T21:20:36.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 53132372 5244.26 MB/sec execute 430 sec latency 2.517 ms 2026-02-17T21:20:36.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 132729 12.97 MB/sec execute 430 sec latency 41.532 ms 2026-02-17T21:20:37.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:36 trial153 ceph-mon[25357]: pgmap v753: 129 pgs: 129 active+clean; 444 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 6.7 MiB/s wr, 278 op/s 2026-02-17T21:20:37.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:36 trial104 ceph-mon[20612]: pgmap v753: 129 pgs: 129 active+clean; 444 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 5.9 KiB/s rd, 6.7 MiB/s wr, 278 op/s 2026-02-17T21:20:37.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 53229033 5244.36 MB/sec execute 431 sec latency 2.850 ms 2026-02-17T21:20:37.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 132966 12.96 MB/sec execute 431 sec latency 45.621 ms 2026-02-17T21:20:38.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 53326225 5244.48 MB/sec execute 432 sec latency 8.856 ms 2026-02-17T21:20:38.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 133216 12.96 MB/sec execute 432 sec latency 42.027 ms 2026-02-17T21:20:39.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:38 trial153 ceph-mon[25357]: pgmap v754: 129 pgs: 129 active+clean; 437 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 219 op/s 2026-02-17T21:20:39.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:38 trial104 ceph-mon[20612]: pgmap v754: 129 pgs: 129 active+clean; 437 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 219 op/s 2026-02-17T21:20:39.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 53423696 5244.48 MB/sec execute 433 sec latency 2.825 ms 2026-02-17T21:20:39.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 133455 12.95 MB/sec execute 433 sec latency 41.532 ms 2026-02-17T21:20:40.890 INFO:tasks.workunit.client.0.trial104.stdout: 10 53520846 5244.53 MB/sec execute 434 sec latency 3.725 ms 2026-02-17T21:20:40.915 INFO:tasks.workunit.client.1.trial153.stdout: 10 133727 12.95 MB/sec execute 434 sec latency 46.841 ms 2026-02-17T21:20:41.205 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:40 trial104 ceph-mon[20612]: pgmap v755: 129 pgs: 129 active+clean; 429 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 6.6 MiB/s wr, 283 op/s 2026-02-17T21:20:41.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:40 trial153 ceph-mon[25357]: pgmap v755: 129 pgs: 129 active+clean; 429 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 6.6 MiB/s wr, 283 op/s 2026-02-17T21:20:41.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 53618500 5244.67 MB/sec execute 435 sec latency 3.761 ms 2026-02-17T21:20:41.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 134049 12.98 MB/sec execute 435 sec latency 36.169 ms 2026-02-17T21:20:42.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 53714166 5244.70 MB/sec execute 436 sec latency 2.497 ms 2026-02-17T21:20:42.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 134313 12.99 MB/sec execute 436 sec latency 39.861 ms 2026-02-17T21:20:43.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:42 trial153 ceph-mon[25357]: pgmap v756: 129 pgs: 129 active+clean; 428 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 260 op/s 2026-02-17T21:20:43.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:42 trial104 ceph-mon[20612]: pgmap v756: 129 pgs: 129 active+clean; 428 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 260 op/s 2026-02-17T21:20:43.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 53811359 5244.70 MB/sec execute 437 sec latency 11.669 ms 2026-02-17T21:20:43.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 134582 13.02 MB/sec execute 437 sec latency 49.527 ms 2026-02-17T21:20:44.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 53907879 5244.62 MB/sec execute 438 sec latency 14.003 ms 2026-02-17T21:20:44.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 134866 13.04 MB/sec execute 438 sec latency 47.920 ms 2026-02-17T21:20:45.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:44 trial153 ceph-mon[25357]: pgmap v757: 129 pgs: 129 active+clean; 430 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.7 MiB/s wr, 245 op/s 2026-02-17T21:20:45.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:44 trial104 ceph-mon[20612]: pgmap v757: 129 pgs: 129 active+clean; 430 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.7 MiB/s wr, 245 op/s 2026-02-17T21:20:45.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 54005417 5244.68 MB/sec execute 439 sec latency 2.472 ms 2026-02-17T21:20:45.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 135010 13.01 MB/sec execute 439 sec latency 53.708 ms 2026-02-17T21:20:46.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 54103000 5244.86 MB/sec execute 440 sec latency 2.349 ms 2026-02-17T21:20:46.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 135230 13.02 MB/sec execute 440 sec latency 44.645 ms 2026-02-17T21:20:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:46 trial153 ceph-mon[25357]: pgmap v758: 129 pgs: 129 active+clean; 421 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.9 MiB/s wr, 268 op/s 2026-02-17T21:20:47.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:46 trial104 ceph-mon[20612]: pgmap v758: 129 pgs: 129 active+clean; 421 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 5.9 MiB/s wr, 268 op/s 2026-02-17T21:20:47.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 54198810 5244.88 MB/sec execute 441 sec latency 2.578 ms 2026-02-17T21:20:47.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 135445 13.01 MB/sec execute 441 sec latency 47.393 ms 2026-02-17T21:20:48.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 54293490 5244.56 MB/sec execute 442 sec latency 21.224 ms 2026-02-17T21:20:48.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 135647 12.99 MB/sec execute 442 sec latency 44.010 ms 2026-02-17T21:20:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:48 trial153 ceph-mon[25357]: pgmap v759: 129 pgs: 129 active+clean; 427 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 234 op/s 2026-02-17T21:20:49.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:48 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:20:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:48 trial104 ceph-mon[20612]: pgmap v759: 129 pgs: 129 active+clean; 427 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 234 op/s 2026-02-17T21:20:49.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:48 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:20:49.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 54390450 5244.57 MB/sec execute 443 sec latency 2.874 ms 2026-02-17T21:20:49.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 135856 12.98 MB/sec execute 443 sec latency 48.782 ms 2026-02-17T21:20:50.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 54485066 5244.29 MB/sec execute 444 sec latency 4.442 ms 2026-02-17T21:20:50.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 136105 12.98 MB/sec execute 444 sec latency 59.137 ms 2026-02-17T21:20:51.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:50 trial153 ceph-mon[25357]: pgmap v760: 129 pgs: 129 active+clean; 428 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.0 KiB/s rd, 7.1 MiB/s wr, 296 op/s 2026-02-17T21:20:51.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:50 trial104 ceph-mon[20612]: pgmap v760: 129 pgs: 129 active+clean; 428 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.0 KiB/s rd, 7.1 MiB/s wr, 296 op/s 2026-02-17T21:20:51.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 54582140 5244.40 MB/sec execute 445 sec latency 6.241 ms 2026-02-17T21:20:51.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 136346 12.97 MB/sec execute 445 sec latency 40.943 ms 2026-02-17T21:20:52.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 54678536 5244.46 MB/sec execute 446 sec latency 4.245 ms 2026-02-17T21:20:52.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 136599 12.96 MB/sec execute 446 sec latency 50.461 ms 2026-02-17T21:20:53.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:52 trial104 ceph-mon[20612]: pgmap v761: 129 pgs: 129 active+clean; 428 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 241 op/s 2026-02-17T21:20:53.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:52 trial153 ceph-mon[25357]: pgmap v761: 129 pgs: 129 active+clean; 428 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 241 op/s 2026-02-17T21:20:53.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 54772439 5244.06 MB/sec execute 447 sec latency 19.102 ms 2026-02-17T21:20:53.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 136835 12.96 MB/sec execute 447 sec latency 48.725 ms 2026-02-17T21:20:54.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 54870085 5244.13 MB/sec execute 448 sec latency 2.922 ms 2026-02-17T21:20:54.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 137092 12.96 MB/sec execute 448 sec latency 39.947 ms 2026-02-17T21:20:55.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:54 trial153 ceph-mon[25357]: pgmap v762: 129 pgs: 129 active+clean; 418 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 6.5 MiB/s wr, 237 op/s 2026-02-17T21:20:55.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:54 trial104 ceph-mon[20612]: pgmap v762: 129 pgs: 129 active+clean; 418 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 6.5 MiB/s wr, 237 op/s 2026-02-17T21:20:55.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 54965898 5244.02 MB/sec execute 449 sec latency 2.011 ms 2026-02-17T21:20:55.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 137379 12.96 MB/sec execute 449 sec latency 42.011 ms 2026-02-17T21:20:56.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 55059254 5243.72 MB/sec execute 450 sec latency 2.793 ms 2026-02-17T21:20:56.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 137691 12.98 MB/sec execute 450 sec latency 37.473 ms 2026-02-17T21:20:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:56 trial153 ceph-mon[25357]: pgmap v763: 129 pgs: 129 active+clean; 415 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 5.8 MiB/s wr, 252 op/s 2026-02-17T21:20:57.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:56 trial104 ceph-mon[20612]: pgmap v763: 129 pgs: 129 active+clean; 415 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 5.8 MiB/s wr, 252 op/s 2026-02-17T21:20:57.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 55155042 5243.65 MB/sec execute 451 sec latency 3.849 ms 2026-02-17T21:20:57.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 137931 13.00 MB/sec execute 451 sec latency 42.619 ms 2026-02-17T21:20:58.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 55251484 5243.56 MB/sec execute 452 sec latency 4.361 ms 2026-02-17T21:20:58.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 138229 13.03 MB/sec execute 452 sec latency 48.768 ms 2026-02-17T21:20:59.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:20:58 trial153 ceph-mon[25357]: pgmap v764: 129 pgs: 129 active+clean; 421 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.4 MiB/s wr, 248 op/s 2026-02-17T21:20:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:20:58 trial104 ceph-mon[20612]: pgmap v764: 129 pgs: 129 active+clean; 421 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 5.4 MiB/s wr, 248 op/s 2026-02-17T21:20:59.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 55346326 5243.30 MB/sec execute 453 sec latency 12.764 ms 2026-02-17T21:20:59.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 138454 13.03 MB/sec execute 453 sec latency 49.424 ms 2026-02-17T21:21:00.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 55444713 5243.51 MB/sec execute 454 sec latency 3.483 ms 2026-02-17T21:21:00.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 138620 13.02 MB/sec execute 454 sec latency 42.646 ms 2026-02-17T21:21:01.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:00 trial153 ceph-mon[25357]: pgmap v765: 129 pgs: 129 active+clean; 440 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 6.8 MiB/s wr, 302 op/s 2026-02-17T21:21:01.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:00 trial104 ceph-mon[20612]: pgmap v765: 129 pgs: 129 active+clean; 440 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.2 KiB/s rd, 6.8 MiB/s wr, 302 op/s 2026-02-17T21:21:01.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 55540077 5243.51 MB/sec execute 455 sec latency 4.716 ms 2026-02-17T21:21:01.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 138834 13.01 MB/sec execute 455 sec latency 45.399 ms 2026-02-17T21:21:02.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:01 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:21:02.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:01 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:21:02.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 55635676 5243.35 MB/sec execute 456 sec latency 2.776 ms 2026-02-17T21:21:02.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 139044 13.00 MB/sec execute 456 sec latency 46.715 ms 2026-02-17T21:21:03.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:02 trial153 ceph-mon[25357]: pgmap v766: 129 pgs: 129 active+clean; 441 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 221 op/s 2026-02-17T21:21:03.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:02 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:21:03.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:02 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:21:03.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:02 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:21:03.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:02 trial104 ceph-mon[20612]: pgmap v766: 129 pgs: 129 active+clean; 441 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 221 op/s 2026-02-17T21:21:03.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:02 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:21:03.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:02 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:21:03.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:02 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:21:03.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 55730926 5243.10 MB/sec execute 457 sec latency 14.101 ms 2026-02-17T21:21:03.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 139256 13.00 MB/sec execute 457 sec latency 49.069 ms 2026-02-17T21:21:04.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:21:04.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:21:04.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 55825542 5242.83 MB/sec execute 458 sec latency 22.745 ms 2026-02-17T21:21:04.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 139472 12.98 MB/sec execute 458 sec latency 46.975 ms 2026-02-17T21:21:05.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:04 trial153 ceph-mon[25357]: pgmap v767: 129 pgs: 129 active+clean; 443 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 5.9 MiB/s wr, 206 op/s 2026-02-17T21:21:05.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:04 trial104 ceph-mon[20612]: pgmap v767: 129 pgs: 129 active+clean; 443 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 5.9 MiB/s wr, 206 op/s 2026-02-17T21:21:05.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 55920138 5242.65 MB/sec execute 459 sec latency 4.716 ms 2026-02-17T21:21:05.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 139721 12.98 MB/sec execute 459 sec latency 44.514 ms 2026-02-17T21:21:06.891 INFO:tasks.workunit.client.0.trial104.stdout: 10 56016933 5242.80 MB/sec execute 460 sec latency 1.681 ms 2026-02-17T21:21:06.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 139958 12.96 MB/sec execute 460 sec latency 41.022 ms 2026-02-17T21:21:07.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:06 trial153 ceph-mon[25357]: pgmap v768: 129 pgs: 129 active+clean; 444 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 6.5 MiB/s wr, 250 op/s 2026-02-17T21:21:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:06 trial104 ceph-mon[20612]: pgmap v768: 129 pgs: 129 active+clean; 444 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 6.5 MiB/s wr, 250 op/s 2026-02-17T21:21:07.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 56113768 5242.76 MB/sec execute 461 sec latency 2.782 ms 2026-02-17T21:21:07.916 INFO:tasks.workunit.client.1.trial153.stdout: 10 140208 12.96 MB/sec execute 461 sec latency 40.231 ms 2026-02-17T21:21:08.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 56210308 5242.71 MB/sec execute 462 sec latency 2.821 ms 2026-02-17T21:21:08.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 140447 12.95 MB/sec execute 462 sec latency 40.455 ms 2026-02-17T21:21:09.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:08 trial153 ceph-mon[25357]: pgmap v769: 129 pgs: 129 active+clean; 438 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 231 op/s 2026-02-17T21:21:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:08 trial104 ceph-mon[20612]: pgmap v769: 129 pgs: 129 active+clean; 438 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 231 op/s 2026-02-17T21:21:09.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 56306451 5242.58 MB/sec execute 463 sec latency 11.660 ms 2026-02-17T21:21:09.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 140710 12.96 MB/sec execute 463 sec latency 38.657 ms 2026-02-17T21:21:10.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 56400726 5242.43 MB/sec execute 464 sec latency 14.694 ms 2026-02-17T21:21:10.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 141012 12.97 MB/sec execute 464 sec latency 37.700 ms 2026-02-17T21:21:11.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:10 trial153 ceph-mon[25357]: pgmap v770: 129 pgs: 129 active+clean; 417 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 6.8 MiB/s wr, 294 op/s 2026-02-17T21:21:11.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:10 trial104 ceph-mon[20612]: pgmap v770: 129 pgs: 129 active+clean; 417 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 6.8 MiB/s wr, 294 op/s 2026-02-17T21:21:11.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 56496583 5242.41 MB/sec execute 465 sec latency 3.006 ms 2026-02-17T21:21:11.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 141291 12.98 MB/sec execute 465 sec latency 36.982 ms 2026-02-17T21:21:12.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 56593042 5242.32 MB/sec execute 466 sec latency 2.969 ms 2026-02-17T21:21:12.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 141545 13.00 MB/sec execute 466 sec latency 40.244 ms 2026-02-17T21:21:13.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:12 trial153 ceph-mon[25357]: pgmap v771: 129 pgs: 129 active+clean; 405 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.6 MiB/s wr, 229 op/s 2026-02-17T21:21:13.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:12 trial104 ceph-mon[20612]: pgmap v771: 129 pgs: 129 active+clean; 405 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.6 MiB/s wr, 229 op/s 2026-02-17T21:21:13.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 56688178 5242.11 MB/sec execute 467 sec latency 20.692 ms 2026-02-17T21:21:13.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 141850 13.03 MB/sec execute 467 sec latency 40.075 ms 2026-02-17T21:21:14.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 56784575 5242.06 MB/sec execute 468 sec latency 3.852 ms 2026-02-17T21:21:14.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 142040 13.02 MB/sec execute 468 sec latency 54.873 ms 2026-02-17T21:21:15.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:14 trial153 ceph-mon[25357]: pgmap v772: 129 pgs: 129 active+clean; 413 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 5.6 MiB/s wr, 263 op/s 2026-02-17T21:21:15.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:14 trial104 ceph-mon[20612]: pgmap v772: 129 pgs: 129 active+clean; 413 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 5.6 MiB/s wr, 263 op/s 2026-02-17T21:21:15.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 56880236 5242.07 MB/sec execute 469 sec latency 2.721 ms 2026-02-17T21:21:15.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 142219 13.01 MB/sec execute 469 sec latency 47.791 ms 2026-02-17T21:21:16.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 56977163 5242.12 MB/sec execute 470 sec latency 2.748 ms 2026-02-17T21:21:16.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 142438 13.01 MB/sec execute 470 sec latency 61.055 ms 2026-02-17T21:21:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:16 trial153 ceph-mon[25357]: pgmap v773: 129 pgs: 129 active+clean; 426 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 6.0 MiB/s wr, 272 op/s 2026-02-17T21:21:17.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:16 trial104 ceph-mon[20612]: pgmap v773: 129 pgs: 129 active+clean; 426 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 8.9 KiB/s rd, 6.0 MiB/s wr, 272 op/s 2026-02-17T21:21:17.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 57073357 5242.02 MB/sec execute 471 sec latency 4.214 ms 2026-02-17T21:21:17.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 142656 12.99 MB/sec execute 471 sec latency 44.158 ms 2026-02-17T21:21:18.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 57170310 5242.01 MB/sec execute 472 sec latency 3.182 ms 2026-02-17T21:21:18.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 142865 12.99 MB/sec execute 472 sec latency 43.524 ms 2026-02-17T21:21:19.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:18 trial153 ceph-mon[25357]: pgmap v774: 129 pgs: 129 active+clean; 431 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 231 op/s 2026-02-17T21:21:19.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:18 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:21:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:18 trial104 ceph-mon[20612]: pgmap v774: 129 pgs: 129 active+clean; 431 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 231 op/s 2026-02-17T21:21:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:18 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:21:19.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 57263646 5241.62 MB/sec execute 473 sec latency 37.852 ms 2026-02-17T21:21:19.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 143114 12.99 MB/sec execute 473 sec latency 49.478 ms 2026-02-17T21:21:20.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 57357833 5241.43 MB/sec execute 474 sec latency 16.042 ms 2026-02-17T21:21:20.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 143359 12.98 MB/sec execute 474 sec latency 38.348 ms 2026-02-17T21:21:21.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:20 trial153 ceph-mon[25357]: pgmap v775: 129 pgs: 129 active+clean; 426 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 7.0 MiB/s wr, 283 op/s 2026-02-17T21:21:21.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:20 trial104 ceph-mon[20612]: pgmap v775: 129 pgs: 129 active+clean; 426 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.1 KiB/s rd, 7.0 MiB/s wr, 283 op/s 2026-02-17T21:21:21.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 57454073 5241.44 MB/sec execute 475 sec latency 4.759 ms 2026-02-17T21:21:21.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 143603 12.97 MB/sec execute 475 sec latency 38.137 ms 2026-02-17T21:21:22.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 57551517 5241.46 MB/sec execute 476 sec latency 3.818 ms 2026-02-17T21:21:22.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 143844 12.97 MB/sec execute 476 sec latency 41.003 ms 2026-02-17T21:21:23.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:22 trial153 ceph-mon[25357]: pgmap v776: 129 pgs: 129 active+clean; 428 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 230 op/s 2026-02-17T21:21:23.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:22 trial104 ceph-mon[20612]: pgmap v776: 129 pgs: 129 active+clean; 428 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 230 op/s 2026-02-17T21:21:23.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 57648265 5241.44 MB/sec execute 477 sec latency 2.912 ms 2026-02-17T21:21:23.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 144097 12.96 MB/sec execute 477 sec latency 38.969 ms 2026-02-17T21:21:24.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 57745039 5241.51 MB/sec execute 478 sec latency 2.858 ms 2026-02-17T21:21:24.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 144374 12.96 MB/sec execute 478 sec latency 39.085 ms 2026-02-17T21:21:25.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:24 trial153 ceph-mon[25357]: pgmap v777: 129 pgs: 129 active+clean; 423 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 6.6 MiB/s wr, 246 op/s 2026-02-17T21:21:25.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:24 trial104 ceph-mon[20612]: pgmap v777: 129 pgs: 129 active+clean; 423 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 6.6 MiB/s wr, 246 op/s 2026-02-17T21:21:25.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 57842401 5241.68 MB/sec execute 479 sec latency 2.849 ms 2026-02-17T21:21:25.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 144674 12.98 MB/sec execute 479 sec latency 37.409 ms 2026-02-17T21:21:26.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 57937914 5241.54 MB/sec execute 480 sec latency 5.128 ms 2026-02-17T21:21:26.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 144944 12.99 MB/sec execute 480 sec latency 40.828 ms 2026-02-17T21:21:27.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:27 trial153 ceph-mon[25357]: pgmap v778: 129 pgs: 129 active+clean; 421 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 6.1 MiB/s wr, 268 op/s 2026-02-17T21:21:27.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:27 trial104 ceph-mon[20612]: pgmap v778: 129 pgs: 129 active+clean; 421 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.5 KiB/s rd, 6.1 MiB/s wr, 268 op/s 2026-02-17T21:21:27.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 58031639 5241.17 MB/sec execute 481 sec latency 2.913 ms 2026-02-17T21:21:27.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 145192 13.02 MB/sec execute 481 sec latency 49.722 ms 2026-02-17T21:21:28.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 58127307 5241.00 MB/sec execute 482 sec latency 4.010 ms 2026-02-17T21:21:28.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 145489 13.03 MB/sec execute 482 sec latency 46.864 ms 2026-02-17T21:21:29.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:29 trial153 ceph-mon[25357]: pgmap v779: 129 pgs: 129 active+clean; 426 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 262 op/s 2026-02-17T21:21:29.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:29 trial104 ceph-mon[20612]: pgmap v779: 129 pgs: 129 active+clean; 426 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.4 MiB/s wr, 262 op/s 2026-02-17T21:21:29.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 58223203 5240.99 MB/sec execute 483 sec latency 20.117 ms 2026-02-17T21:21:29.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 145643 13.02 MB/sec execute 483 sec latency 42.293 ms 2026-02-17T21:21:30.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 58319959 5241.12 MB/sec execute 484 sec latency 8.946 ms 2026-02-17T21:21:30.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 145866 13.02 MB/sec execute 484 sec latency 48.309 ms 2026-02-17T21:21:31.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:31 trial153 ceph-mon[25357]: pgmap v780: 129 pgs: 129 active+clean; 441 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 6.6 MiB/s wr, 278 op/s 2026-02-17T21:21:31.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:31 trial104 ceph-mon[20612]: pgmap v780: 129 pgs: 129 active+clean; 441 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 8.7 KiB/s rd, 6.6 MiB/s wr, 278 op/s 2026-02-17T21:21:31.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 58416241 5241.00 MB/sec execute 485 sec latency 2.377 ms 2026-02-17T21:21:31.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 146083 13.01 MB/sec execute 485 sec latency 42.564 ms 2026-02-17T21:21:32.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 58508046 5240.44 MB/sec execute 486 sec latency 4.960 ms 2026-02-17T21:21:32.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 146300 13.00 MB/sec execute 486 sec latency 44.708 ms 2026-02-17T21:21:33.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:33 trial153 ceph-mon[25357]: pgmap v781: 129 pgs: 129 active+clean; 445 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 240 op/s 2026-02-17T21:21:33.364 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:33 trial104 ceph-mon[20612]: pgmap v781: 129 pgs: 129 active+clean; 445 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 240 op/s 2026-02-17T21:21:33.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 58601800 5240.07 MB/sec execute 487 sec latency 4.447 ms 2026-02-17T21:21:33.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 146494 12.99 MB/sec execute 487 sec latency 45.569 ms 2026-02-17T21:21:34.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:34 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:21:34.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:34 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:21:34.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 58690918 5239.32 MB/sec execute 488 sec latency 73.672 ms 2026-02-17T21:21:34.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 146751 12.98 MB/sec execute 488 sec latency 38.578 ms 2026-02-17T21:21:35.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:35 trial153 ceph-mon[25357]: pgmap v782: 129 pgs: 129 active+clean; 442 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.0 MiB/s wr, 212 op/s 2026-02-17T21:21:35.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:35 trial104 ceph-mon[20612]: pgmap v782: 129 pgs: 129 active+clean; 442 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.0 MiB/s wr, 212 op/s 2026-02-17T21:21:35.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 58785795 5239.23 MB/sec execute 489 sec latency 10.853 ms 2026-02-17T21:21:35.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 146996 12.97 MB/sec execute 489 sec latency 50.233 ms 2026-02-17T21:21:36.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 58881628 5239.08 MB/sec execute 490 sec latency 3.235 ms 2026-02-17T21:21:36.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 147243 12.97 MB/sec execute 490 sec latency 46.938 ms 2026-02-17T21:21:37.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:37 trial153 ceph-mon[25357]: pgmap v783: 129 pgs: 129 active+clean; 442 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.5 MiB/s wr, 251 op/s 2026-02-17T21:21:37.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:37 trial104 ceph-mon[20612]: pgmap v783: 129 pgs: 129 active+clean; 442 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.5 MiB/s wr, 251 op/s 2026-02-17T21:21:37.892 INFO:tasks.workunit.client.0.trial104.stdout: 10 58979309 5239.18 MB/sec execute 491 sec latency 3.069 ms 2026-02-17T21:21:37.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 147478 12.97 MB/sec execute 491 sec latency 46.447 ms 2026-02-17T21:21:38.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 59075591 5239.10 MB/sec execute 492 sec latency 4.710 ms 2026-02-17T21:21:38.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 147746 12.97 MB/sec execute 492 sec latency 47.843 ms 2026-02-17T21:21:39.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:39 trial153 ceph-mon[25357]: pgmap v784: 129 pgs: 129 active+clean; 440 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 248 op/s 2026-02-17T21:21:39.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:39 trial104 ceph-mon[20612]: pgmap v784: 129 pgs: 129 active+clean; 440 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 248 op/s 2026-02-17T21:21:39.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 59172849 5239.29 MB/sec execute 493 sec latency 2.349 ms 2026-02-17T21:21:39.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 148030 12.97 MB/sec execute 493 sec latency 37.155 ms 2026-02-17T21:21:40.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 59270103 5239.40 MB/sec execute 494 sec latency 2.892 ms 2026-02-17T21:21:40.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 148340 12.99 MB/sec execute 494 sec latency 37.228 ms 2026-02-17T21:21:41.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:41 trial153 ceph-mon[25357]: pgmap v785: 129 pgs: 129 active+clean; 413 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 6.8 MiB/s wr, 301 op/s 2026-02-17T21:21:41.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:41 trial104 ceph-mon[20612]: pgmap v785: 129 pgs: 129 active+clean; 413 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 9.6 KiB/s rd, 6.8 MiB/s wr, 301 op/s 2026-02-17T21:21:41.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 59368177 5239.52 MB/sec execute 495 sec latency 2.666 ms 2026-02-17T21:21:41.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 148578 13.00 MB/sec execute 495 sec latency 40.769 ms 2026-02-17T21:21:42.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 59466041 5239.61 MB/sec execute 496 sec latency 4.174 ms 2026-02-17T21:21:42.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 148877 13.03 MB/sec execute 496 sec latency 39.941 ms 2026-02-17T21:21:43.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:43 trial153 ceph-mon[25357]: pgmap v786: 129 pgs: 129 active+clean; 412 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 261 op/s 2026-02-17T21:21:43.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:43 trial104 ceph-mon[20612]: pgmap v786: 129 pgs: 129 active+clean; 412 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 261 op/s 2026-02-17T21:21:43.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 59563006 5239.64 MB/sec execute 497 sec latency 2.518 ms 2026-02-17T21:21:43.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 149100 13.03 MB/sec execute 497 sec latency 46.096 ms 2026-02-17T21:21:44.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 59656941 5239.50 MB/sec execute 498 sec latency 21.639 ms 2026-02-17T21:21:44.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 149276 13.02 MB/sec execute 498 sec latency 42.345 ms 2026-02-17T21:21:45.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:45 trial153 ceph-mon[25357]: pgmap v787: 129 pgs: 129 active+clean; 419 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 5.7 MiB/s wr, 246 op/s 2026-02-17T21:21:45.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:45 trial104 ceph-mon[20612]: pgmap v787: 129 pgs: 129 active+clean; 419 MiB data, 5.2 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 5.7 MiB/s wr, 246 op/s 2026-02-17T21:21:45.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 59752894 5239.40 MB/sec execute 499 sec latency 2.880 ms 2026-02-17T21:21:45.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 149494 13.02 MB/sec execute 499 sec latency 48.210 ms 2026-02-17T21:21:46.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 59849023 5239.29 MB/sec execute 500 sec latency 3.410 ms 2026-02-17T21:21:46.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 149702 13.00 MB/sec execute 500 sec latency 58.035 ms 2026-02-17T21:21:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:47 trial153 ceph-mon[25357]: pgmap v788: 129 pgs: 129 active+clean; 433 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 6.5 MiB/s wr, 289 op/s 2026-02-17T21:21:47.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:47 trial104 ceph-mon[20612]: pgmap v788: 129 pgs: 129 active+clean; 433 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 8.2 KiB/s rd, 6.5 MiB/s wr, 289 op/s 2026-02-17T21:21:47.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 59944777 5239.17 MB/sec execute 501 sec latency 3.537 ms 2026-02-17T21:21:47.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 149918 13.00 MB/sec execute 501 sec latency 44.940 ms 2026-02-17T21:21:48.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 60040279 5239.09 MB/sec execute 502 sec latency 3.076 ms 2026-02-17T21:21:48.917 INFO:tasks.workunit.client.1.trial153.stdout: 10 150147 12.99 MB/sec execute 502 sec latency 47.863 ms 2026-02-17T21:21:49.362 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:49 trial104 ceph-mon[20612]: pgmap v789: 129 pgs: 129 active+clean; 431 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 254 op/s 2026-02-17T21:21:49.363 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:49 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:21:49.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:49 trial153 ceph-mon[25357]: pgmap v789: 129 pgs: 129 active+clean; 431 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 254 op/s 2026-02-17T21:21:49.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:49 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:21:49.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 60135390 5239.04 MB/sec execute 503 sec latency 2.636 ms 2026-02-17T21:21:49.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 150393 12.99 MB/sec execute 503 sec latency 39.660 ms 2026-02-17T21:21:50.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 60227505 5238.52 MB/sec execute 504 sec latency 43.588 ms 2026-02-17T21:21:50.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 150628 12.97 MB/sec execute 504 sec latency 43.553 ms 2026-02-17T21:21:51.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:51 trial104 ceph-mon[20612]: pgmap v790: 129 pgs: 129 active+clean; 425 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 6.8 MiB/s wr, 259 op/s 2026-02-17T21:21:51.500 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:51 trial153 ceph-mon[25357]: pgmap v790: 129 pgs: 129 active+clean; 425 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 6.4 KiB/s rd, 6.8 MiB/s wr, 259 op/s 2026-02-17T21:21:51.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 60323413 5238.43 MB/sec execute 505 sec latency 10.430 ms 2026-02-17T21:21:51.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 150875 12.97 MB/sec execute 505 sec latency 48.136 ms 2026-02-17T21:21:52.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 60420602 5238.42 MB/sec execute 506 sec latency 2.968 ms 2026-02-17T21:21:52.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 151127 12.97 MB/sec execute 506 sec latency 42.996 ms 2026-02-17T21:21:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:53 trial104 ceph-mon[20612]: pgmap v791: 129 pgs: 129 active+clean; 425 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 211 op/s 2026-02-17T21:21:53.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:53 trial153 ceph-mon[25357]: pgmap v791: 129 pgs: 129 active+clean; 425 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 211 op/s 2026-02-17T21:21:53.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 60517661 5238.55 MB/sec execute 507 sec latency 4.476 ms 2026-02-17T21:21:53.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 151397 12.97 MB/sec execute 507 sec latency 37.904 ms 2026-02-17T21:21:54.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 60614622 5238.70 MB/sec execute 508 sec latency 2.794 ms 2026-02-17T21:21:54.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 151692 12.98 MB/sec execute 508 sec latency 41.318 ms 2026-02-17T21:21:55.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:55 trial104 ceph-mon[20612]: pgmap v792: 129 pgs: 129 active+clean; 421 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.2 MiB/s wr, 229 op/s 2026-02-17T21:21:55.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:55 trial153 ceph-mon[25357]: pgmap v792: 129 pgs: 129 active+clean; 421 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.2 MiB/s wr, 229 op/s 2026-02-17T21:21:55.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 60711391 5238.66 MB/sec execute 509 sec latency 2.659 ms 2026-02-17T21:21:55.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 151982 13.00 MB/sec execute 509 sec latency 37.408 ms 2026-02-17T21:21:56.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 60808789 5238.72 MB/sec execute 510 sec latency 2.776 ms 2026-02-17T21:21:56.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 152227 13.01 MB/sec execute 510 sec latency 41.209 ms 2026-02-17T21:21:57.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:57 trial153 ceph-mon[25357]: pgmap v793: 129 pgs: 129 active+clean; 422 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.0 MiB/s wr, 287 op/s 2026-02-17T21:21:57.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:57 trial104 ceph-mon[20612]: pgmap v793: 129 pgs: 129 active+clean; 422 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.0 MiB/s wr, 287 op/s 2026-02-17T21:21:57.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 60906144 5238.77 MB/sec execute 511 sec latency 3.790 ms 2026-02-17T21:21:57.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 152525 13.03 MB/sec execute 511 sec latency 52.504 ms 2026-02-17T21:21:58.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 61003003 5238.90 MB/sec execute 512 sec latency 2.939 ms 2026-02-17T21:21:58.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 152703 13.02 MB/sec execute 512 sec latency 41.918 ms 2026-02-17T21:21:59.037 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:21:59 trial104 ceph-mon[20612]: pgmap v794: 129 pgs: 129 active+clean; 428 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 244 op/s 2026-02-17T21:21:59.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:21:59 trial153 ceph-mon[25357]: pgmap v794: 129 pgs: 129 active+clean; 428 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.2 MiB/s wr, 244 op/s 2026-02-17T21:21:59.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 61096675 5238.63 MB/sec execute 513 sec latency 24.135 ms 2026-02-17T21:21:59.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 152906 13.02 MB/sec execute 513 sec latency 43.363 ms 2026-02-17T21:22:00.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 61192291 5238.45 MB/sec execute 514 sec latency 2.719 ms 2026-02-17T21:22:00.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 153124 13.02 MB/sec execute 514 sec latency 44.799 ms 2026-02-17T21:22:01.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:01 trial104 ceph-mon[20612]: pgmap v795: 129 pgs: 129 active+clean; 443 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.0 KiB/s rd, 6.5 MiB/s wr, 270 op/s 2026-02-17T21:22:01.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:01 trial153 ceph-mon[25357]: pgmap v795: 129 pgs: 129 active+clean; 443 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.0 KiB/s rd, 6.5 MiB/s wr, 270 op/s 2026-02-17T21:22:01.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 61286890 5238.23 MB/sec execute 515 sec latency 5.118 ms 2026-02-17T21:22:01.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 153337 13.00 MB/sec execute 515 sec latency 47.760 ms 2026-02-17T21:22:02.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 61382366 5238.13 MB/sec execute 516 sec latency 2.751 ms 2026-02-17T21:22:02.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 153539 13.00 MB/sec execute 516 sec latency 50.992 ms 2026-02-17T21:22:03.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:03 trial104 ceph-mon[20612]: pgmap v796: 129 pgs: 129 active+clean; 448 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 257 op/s 2026-02-17T21:22:03.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:22:03.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:22:03.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:22:03.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:22:03.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:03 trial153 ceph-mon[25357]: pgmap v796: 129 pgs: 129 active+clean; 448 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.9 MiB/s wr, 257 op/s 2026-02-17T21:22:03.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:22:03.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:22:03.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:22:03.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:22:03.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 61476972 5237.99 MB/sec execute 517 sec latency 3.112 ms 2026-02-17T21:22:03.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 153792 12.99 MB/sec execute 517 sec latency 42.907 ms 2026-02-17T21:22:04.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:22:04.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:22:04.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 61572221 5237.88 MB/sec execute 518 sec latency 2.424 ms 2026-02-17T21:22:04.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 154033 12.98 MB/sec execute 518 sec latency 42.518 ms 2026-02-17T21:22:05.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:05 trial104 ceph-mon[20612]: pgmap v797: 129 pgs: 129 active+clean; 443 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.4 MiB/s wr, 249 op/s 2026-02-17T21:22:05.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:05 trial153 ceph-mon[25357]: pgmap v797: 129 pgs: 129 active+clean; 443 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.4 MiB/s wr, 249 op/s 2026-02-17T21:22:05.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 61663616 5237.29 MB/sec execute 519 sec latency 29.511 ms 2026-02-17T21:22:05.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 154282 12.98 MB/sec execute 519 sec latency 52.214 ms 2026-02-17T21:22:06.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 61758822 5237.12 MB/sec execute 520 sec latency 15.191 ms 2026-02-17T21:22:06.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 154513 12.97 MB/sec execute 520 sec latency 59.025 ms 2026-02-17T21:22:07.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:07 trial153 ceph-mon[25357]: pgmap v798: 129 pgs: 129 active+clean; 435 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.5 MiB/s wr, 268 op/s 2026-02-17T21:22:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:07 trial104 ceph-mon[20612]: pgmap v798: 129 pgs: 129 active+clean; 435 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 6.7 KiB/s rd, 6.5 MiB/s wr, 268 op/s 2026-02-17T21:22:07.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 61856039 5237.20 MB/sec execute 521 sec latency 2.590 ms 2026-02-17T21:22:07.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 154785 12.98 MB/sec execute 521 sec latency 45.793 ms 2026-02-17T21:22:08.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 61952132 5237.27 MB/sec execute 522 sec latency 3.561 ms 2026-02-17T21:22:08.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 155053 12.98 MB/sec execute 522 sec latency 36.943 ms 2026-02-17T21:22:09.154 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:09 trial104 ceph-mon[20612]: pgmap v799: 129 pgs: 129 active+clean; 418 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 234 op/s 2026-02-17T21:22:09.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:09 trial153 ceph-mon[25357]: pgmap v799: 129 pgs: 129 active+clean; 418 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 234 op/s 2026-02-17T21:22:09.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 62049350 5237.33 MB/sec execute 523 sec latency 3.417 ms 2026-02-17T21:22:09.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 155346 12.99 MB/sec execute 523 sec latency 38.210 ms 2026-02-17T21:22:10.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 62146313 5237.33 MB/sec execute 524 sec latency 2.850 ms 2026-02-17T21:22:10.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 155609 13.00 MB/sec execute 524 sec latency 44.642 ms 2026-02-17T21:22:11.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:11 trial104 ceph-mon[20612]: pgmap v800: 129 pgs: 129 active+clean; 410 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.6 MiB/s wr, 298 op/s 2026-02-17T21:22:11.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:11 trial153 ceph-mon[25357]: pgmap v800: 129 pgs: 129 active+clean; 410 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.6 MiB/s wr, 298 op/s 2026-02-17T21:22:11.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 62243206 5237.30 MB/sec execute 525 sec latency 3.878 ms 2026-02-17T21:22:11.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 155900 13.03 MB/sec execute 525 sec latency 43.360 ms 2026-02-17T21:22:12.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 62339771 5237.34 MB/sec execute 526 sec latency 6.056 ms 2026-02-17T21:22:12.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 156149 13.03 MB/sec execute 526 sec latency 46.173 ms 2026-02-17T21:22:13.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:13 trial104 ceph-mon[20612]: pgmap v801: 129 pgs: 129 active+clean; 414 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 269 op/s 2026-02-17T21:22:13.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:13 trial153 ceph-mon[25357]: pgmap v801: 129 pgs: 129 active+clean; 414 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 269 op/s 2026-02-17T21:22:13.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 62437015 5237.52 MB/sec execute 527 sec latency 4.661 ms 2026-02-17T21:22:13.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 156302 13.02 MB/sec execute 527 sec latency 42.333 ms 2026-02-17T21:22:14.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 62533391 5237.47 MB/sec execute 528 sec latency 2.828 ms 2026-02-17T21:22:14.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 156517 13.02 MB/sec execute 528 sec latency 56.965 ms 2026-02-17T21:22:15.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:15 trial104 ceph-mon[20612]: pgmap v802: 129 pgs: 129 active+clean; 424 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 5.8 MiB/s wr, 238 op/s 2026-02-17T21:22:15.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:15 trial153 ceph-mon[25357]: pgmap v802: 129 pgs: 129 active+clean; 424 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 5.8 MiB/s wr, 238 op/s 2026-02-17T21:22:15.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 62628524 5237.29 MB/sec execute 529 sec latency 19.720 ms 2026-02-17T21:22:15.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 156737 13.01 MB/sec execute 529 sec latency 50.138 ms 2026-02-17T21:22:16.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 62726483 5237.38 MB/sec execute 530 sec latency 2.499 ms 2026-02-17T21:22:16.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 156946 13.01 MB/sec execute 530 sec latency 44.689 ms 2026-02-17T21:22:17.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:17 trial153 ceph-mon[25357]: pgmap v803: 129 pgs: 129 active+clean; 430 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 6.0 MiB/s wr, 251 op/s 2026-02-17T21:22:17.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:17 trial104 ceph-mon[20612]: pgmap v803: 129 pgs: 129 active+clean; 430 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.7 KiB/s rd, 6.0 MiB/s wr, 251 op/s 2026-02-17T21:22:17.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 62821661 5237.29 MB/sec execute 531 sec latency 3.143 ms 2026-02-17T21:22:17.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 157149 12.99 MB/sec execute 531 sec latency 54.107 ms 2026-02-17T21:22:18.893 INFO:tasks.workunit.client.0.trial104.stdout: 10 62917563 5237.34 MB/sec execute 532 sec latency 4.323 ms 2026-02-17T21:22:18.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 157407 12.99 MB/sec execute 532 sec latency 50.169 ms 2026-02-17T21:22:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:19 trial104 ceph-mon[20612]: pgmap v804: 129 pgs: 129 active+clean; 431 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 238 op/s 2026-02-17T21:22:19.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:22:19.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:19 trial153 ceph-mon[25357]: pgmap v804: 129 pgs: 129 active+clean; 431 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 238 op/s 2026-02-17T21:22:19.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:22:19.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 63014548 5237.31 MB/sec execute 533 sec latency 2.948 ms 2026-02-17T21:22:19.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 157646 12.98 MB/sec execute 533 sec latency 44.457 ms 2026-02-17T21:22:20.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 63108883 5237.08 MB/sec execute 534 sec latency 33.492 ms 2026-02-17T21:22:20.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 157885 12.98 MB/sec execute 534 sec latency 46.434 ms 2026-02-17T21:22:21.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:21 trial104 ceph-mon[20612]: pgmap v805: 129 pgs: 129 active+clean; 426 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 7.1 MiB/s wr, 293 op/s 2026-02-17T21:22:21.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:21 trial153 ceph-mon[25357]: pgmap v805: 129 pgs: 129 active+clean; 426 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 7.0 KiB/s rd, 7.1 MiB/s wr, 293 op/s 2026-02-17T21:22:21.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 63204913 5237.02 MB/sec execute 535 sec latency 9.061 ms 2026-02-17T21:22:21.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 158123 12.97 MB/sec execute 535 sec latency 43.742 ms 2026-02-17T21:22:22.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 63302154 5237.15 MB/sec execute 536 sec latency 4.969 ms 2026-02-17T21:22:22.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 158389 12.97 MB/sec execute 536 sec latency 39.108 ms 2026-02-17T21:22:23.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:23 trial104 ceph-mon[20612]: pgmap v806: 129 pgs: 129 active+clean; 423 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 223 op/s 2026-02-17T21:22:23.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:23 trial153 ceph-mon[25357]: pgmap v806: 129 pgs: 129 active+clean; 423 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 223 op/s 2026-02-17T21:22:23.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 63399073 5237.22 MB/sec execute 537 sec latency 2.710 ms 2026-02-17T21:22:23.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 158673 12.98 MB/sec execute 537 sec latency 43.518 ms 2026-02-17T21:22:24.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 63496437 5237.26 MB/sec execute 538 sec latency 2.808 ms 2026-02-17T21:22:24.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 158979 12.99 MB/sec execute 538 sec latency 45.296 ms 2026-02-17T21:22:25.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:25 trial104 ceph-mon[20612]: pgmap v807: 129 pgs: 129 active+clean; 420 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.1 MiB/s wr, 246 op/s 2026-02-17T21:22:25.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:25 trial153 ceph-mon[25357]: pgmap v807: 129 pgs: 129 active+clean; 420 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.1 MiB/s wr, 246 op/s 2026-02-17T21:22:25.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 63591911 5237.12 MB/sec execute 539 sec latency 19.049 ms 2026-02-17T21:22:25.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 159225 13.01 MB/sec execute 539 sec latency 43.653 ms 2026-02-17T21:22:26.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 63690295 5237.31 MB/sec execute 540 sec latency 3.783 ms 2026-02-17T21:22:26.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 159513 13.03 MB/sec execute 540 sec latency 38.836 ms 2026-02-17T21:22:27.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:27 trial153 ceph-mon[25357]: pgmap v808: 129 pgs: 129 active+clean; 426 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.5 MiB/s wr, 266 op/s 2026-02-17T21:22:27.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:27 trial104 ceph-mon[20612]: pgmap v808: 129 pgs: 129 active+clean; 426 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.5 MiB/s wr, 266 op/s 2026-02-17T21:22:27.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 63787203 5237.46 MB/sec execute 541 sec latency 2.672 ms 2026-02-17T21:22:27.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 159740 13.03 MB/sec execute 541 sec latency 52.858 ms 2026-02-17T21:22:28.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 63884587 5237.53 MB/sec execute 542 sec latency 2.601 ms 2026-02-17T21:22:28.918 INFO:tasks.workunit.client.1.trial153.stdout: 10 159925 13.02 MB/sec execute 542 sec latency 42.739 ms 2026-02-17T21:22:29.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:29 trial104 ceph-mon[20612]: pgmap v809: 129 pgs: 129 active+clean; 433 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 250 op/s 2026-02-17T21:22:29.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:29 trial153 ceph-mon[25357]: pgmap v809: 129 pgs: 129 active+clean; 433 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 250 op/s 2026-02-17T21:22:29.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 63980522 5237.44 MB/sec execute 543 sec latency 2.574 ms 2026-02-17T21:22:29.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 160140 13.02 MB/sec execute 543 sec latency 54.956 ms 2026-02-17T21:22:30.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 64076591 5237.34 MB/sec execute 544 sec latency 3.020 ms 2026-02-17T21:22:30.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 160355 13.01 MB/sec execute 544 sec latency 48.107 ms 2026-02-17T21:22:31.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:31 trial104 ceph-mon[20612]: pgmap v810: 129 pgs: 129 active+clean; 448 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 6.9 MiB/s wr, 301 op/s 2026-02-17T21:22:31.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:31 trial153 ceph-mon[25357]: pgmap v810: 129 pgs: 129 active+clean; 448 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.6 KiB/s rd, 6.9 MiB/s wr, 301 op/s 2026-02-17T21:22:31.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 64171165 5237.16 MB/sec execute 545 sec latency 6.262 ms 2026-02-17T21:22:31.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 160560 13.00 MB/sec execute 545 sec latency 41.857 ms 2026-02-17T21:22:32.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 64266545 5237.15 MB/sec execute 546 sec latency 10.517 ms 2026-02-17T21:22:32.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 160793 13.00 MB/sec execute 546 sec latency 43.833 ms 2026-02-17T21:22:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:33 trial104 ceph-mon[20612]: pgmap v811: 129 pgs: 129 active+clean; 448 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 14 KiB/s rd, 5.7 MiB/s wr, 211 op/s 2026-02-17T21:22:33.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:33 trial153 ceph-mon[25357]: pgmap v811: 129 pgs: 129 active+clean; 448 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 14 KiB/s rd, 5.7 MiB/s wr, 211 op/s 2026-02-17T21:22:33.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 64362421 5237.05 MB/sec execute 547 sec latency 3.633 ms 2026-02-17T21:22:33.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 161036 12.99 MB/sec execute 547 sec latency 45.397 ms 2026-02-17T21:22:34.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:34 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:22:34.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:34 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:22:34.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 64458730 5236.99 MB/sec execute 548 sec latency 4.266 ms 2026-02-17T21:22:34.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 161267 12.98 MB/sec execute 548 sec latency 45.019 ms 2026-02-17T21:22:35.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:35 trial104 ceph-mon[20612]: pgmap v812: 129 pgs: 129 active+clean; 440 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 6.2 MiB/s wr, 222 op/s 2026-02-17T21:22:35.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:35 trial153 ceph-mon[25357]: pgmap v812: 129 pgs: 129 active+clean; 440 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 6.2 MiB/s wr, 222 op/s 2026-02-17T21:22:35.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 64555102 5236.92 MB/sec execute 549 sec latency 6.158 ms 2026-02-17T21:22:35.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 161513 12.98 MB/sec execute 549 sec latency 50.801 ms 2026-02-17T21:22:36.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 64649468 5236.77 MB/sec execute 550 sec latency 19.033 ms 2026-02-17T21:22:36.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 161775 12.98 MB/sec execute 550 sec latency 37.144 ms 2026-02-17T21:22:37.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:37 trial153 ceph-mon[25357]: pgmap v813: 129 pgs: 129 active+clean; 415 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 6.5 MiB/s wr, 259 op/s 2026-02-17T21:22:37.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:37 trial104 ceph-mon[20612]: pgmap v813: 129 pgs: 129 active+clean; 415 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 8.6 KiB/s rd, 6.5 MiB/s wr, 259 op/s 2026-02-17T21:22:37.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 64746212 5236.89 MB/sec execute 551 sec latency 4.283 ms 2026-02-17T21:22:37.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 162052 12.98 MB/sec execute 551 sec latency 38.226 ms 2026-02-17T21:22:38.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 64843560 5236.90 MB/sec execute 552 sec latency 3.035 ms 2026-02-17T21:22:38.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 162325 12.99 MB/sec execute 552 sec latency 39.081 ms 2026-02-17T21:22:39.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:39 trial104 ceph-mon[20612]: pgmap v814: 129 pgs: 129 active+clean; 408 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 244 op/s 2026-02-17T21:22:39.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:39 trial153 ceph-mon[25357]: pgmap v814: 129 pgs: 129 active+clean; 408 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.0 MiB/s wr, 244 op/s 2026-02-17T21:22:39.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 64939862 5236.86 MB/sec execute 553 sec latency 3.232 ms 2026-02-17T21:22:39.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 162609 13.00 MB/sec execute 553 sec latency 42.754 ms 2026-02-17T21:22:40.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 65035929 5236.83 MB/sec execute 554 sec latency 15.121 ms 2026-02-17T21:22:40.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 162842 13.01 MB/sec execute 554 sec latency 49.667 ms 2026-02-17T21:22:41.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:41 trial104 ceph-mon[20612]: pgmap v815: 129 pgs: 129 active+clean; 415 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 6.6 MiB/s wr, 312 op/s 2026-02-17T21:22:41.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:41 trial153 ceph-mon[25357]: pgmap v815: 129 pgs: 129 active+clean; 415 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 6.6 MiB/s wr, 312 op/s 2026-02-17T21:22:41.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 65132078 5236.84 MB/sec execute 555 sec latency 2.898 ms 2026-02-17T21:22:41.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 163134 13.03 MB/sec execute 555 sec latency 42.940 ms 2026-02-17T21:22:42.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 65228597 5236.87 MB/sec execute 556 sec latency 3.608 ms 2026-02-17T21:22:42.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 163340 13.02 MB/sec execute 556 sec latency 43.132 ms 2026-02-17T21:22:43.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:43 trial104 ceph-mon[20612]: pgmap v816: 129 pgs: 129 active+clean; 419 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.8 MiB/s wr, 244 op/s 2026-02-17T21:22:43.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:43 trial153 ceph-mon[25357]: pgmap v816: 129 pgs: 129 active+clean; 419 MiB data, 5.4 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.8 MiB/s wr, 244 op/s 2026-02-17T21:22:43.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 65324833 5236.79 MB/sec execute 557 sec latency 3.999 ms 2026-02-17T21:22:43.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 163533 13.02 MB/sec execute 557 sec latency 47.787 ms 2026-02-17T21:22:44.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 65422412 5236.86 MB/sec execute 558 sec latency 2.938 ms 2026-02-17T21:22:44.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 163763 13.02 MB/sec execute 558 sec latency 47.335 ms 2026-02-17T21:22:45.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:45 trial104 ceph-mon[20612]: pgmap v817: 129 pgs: 129 active+clean; 427 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 5.8 KiB/s rd, 5.9 MiB/s wr, 252 op/s 2026-02-17T21:22:45.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:45 trial153 ceph-mon[25357]: pgmap v817: 129 pgs: 129 active+clean; 427 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 5.8 KiB/s rd, 5.9 MiB/s wr, 252 op/s 2026-02-17T21:22:45.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 65518999 5236.88 MB/sec execute 559 sec latency 3.796 ms 2026-02-17T21:22:45.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 163989 13.01 MB/sec execute 559 sec latency 51.665 ms 2026-02-17T21:22:46.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 65612007 5236.67 MB/sec execute 560 sec latency 19.897 ms 2026-02-17T21:22:46.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 164188 13.00 MB/sec execute 560 sec latency 40.965 ms 2026-02-17T21:22:47.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:47 trial153 ceph-mon[25357]: pgmap v818: 129 pgs: 129 active+clean; 431 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 5.8 KiB/s rd, 6.2 MiB/s wr, 259 op/s 2026-02-17T21:22:47.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:47 trial104 ceph-mon[20612]: pgmap v818: 129 pgs: 129 active+clean; 431 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 5.8 KiB/s rd, 6.2 MiB/s wr, 259 op/s 2026-02-17T21:22:47.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 65706863 5236.48 MB/sec execute 561 sec latency 21.240 ms 2026-02-17T21:22:47.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 164438 13.00 MB/sec execute 561 sec latency 40.082 ms 2026-02-17T21:22:48.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 65802978 5236.40 MB/sec execute 562 sec latency 17.385 ms 2026-02-17T21:22:48.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 164674 12.99 MB/sec execute 562 sec latency 42.254 ms 2026-02-17T21:22:49.382 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:49 trial104 ceph-mon[20612]: pgmap v819: 129 pgs: 129 active+clean; 431 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.0 MiB/s wr, 215 op/s 2026-02-17T21:22:49.382 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:49 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:22:49.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:49 trial153 ceph-mon[25357]: pgmap v819: 129 pgs: 129 active+clean; 431 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 11 KiB/s rd, 6.0 MiB/s wr, 215 op/s 2026-02-17T21:22:49.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:49 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:22:49.894 INFO:tasks.workunit.client.0.trial104.stdout: 10 65899224 5236.31 MB/sec execute 563 sec latency 3.585 ms 2026-02-17T21:22:49.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 164933 12.99 MB/sec execute 563 sec latency 48.951 ms 2026-02-17T21:22:50.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 65996424 5236.39 MB/sec execute 564 sec latency 2.963 ms 2026-02-17T21:22:50.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 165176 12.98 MB/sec execute 564 sec latency 46.579 ms 2026-02-17T21:22:51.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:51 trial104 ceph-mon[20612]: pgmap v820: 129 pgs: 129 active+clean; 424 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 7.1 MiB/s wr, 297 op/s 2026-02-17T21:22:51.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:51 trial153 ceph-mon[25357]: pgmap v820: 129 pgs: 129 active+clean; 424 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 7.9 KiB/s rd, 7.1 MiB/s wr, 297 op/s 2026-02-17T21:22:51.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 66093216 5236.51 MB/sec execute 565 sec latency 2.665 ms 2026-02-17T21:22:51.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 165425 12.98 MB/sec execute 565 sec latency 58.597 ms 2026-02-17T21:22:52.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 66190266 5236.56 MB/sec execute 566 sec latency 2.941 ms 2026-02-17T21:22:52.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 165691 12.98 MB/sec execute 566 sec latency 44.205 ms 2026-02-17T21:22:53.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:53 trial104 ceph-mon[20612]: pgmap v821: 129 pgs: 129 active+clean; 423 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 223 op/s 2026-02-17T21:22:53.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:53 trial153 ceph-mon[25357]: pgmap v821: 129 pgs: 129 active+clean; 423 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 223 op/s 2026-02-17T21:22:53.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 66286983 5236.54 MB/sec execute 567 sec latency 2.474 ms 2026-02-17T21:22:53.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 165992 12.99 MB/sec execute 567 sec latency 43.469 ms 2026-02-17T21:22:54.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 66384077 5236.54 MB/sec execute 568 sec latency 3.809 ms 2026-02-17T21:22:54.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 166247 13.00 MB/sec execute 568 sec latency 39.046 ms 2026-02-17T21:22:55.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:55 trial104 ceph-mon[20612]: pgmap v822: 129 pgs: 129 active+clean; 422 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.0 MiB/s wr, 235 op/s 2026-02-17T21:22:55.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:55 trial153 ceph-mon[25357]: pgmap v822: 129 pgs: 129 active+clean; 422 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 6.0 MiB/s wr, 235 op/s 2026-02-17T21:22:55.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 66481327 5236.66 MB/sec execute 569 sec latency 3.298 ms 2026-02-17T21:22:55.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 166517 13.03 MB/sec execute 569 sec latency 42.963 ms 2026-02-17T21:22:56.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 66576004 5236.56 MB/sec execute 570 sec latency 21.207 ms 2026-02-17T21:22:56.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 166787 13.03 MB/sec execute 570 sec latency 47.037 ms 2026-02-17T21:22:57.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:57 trial153 ceph-mon[25357]: pgmap v823: 129 pgs: 129 active+clean; 432 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.9 MiB/s wr, 286 op/s 2026-02-17T21:22:57.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:57 trial104 ceph-mon[20612]: pgmap v823: 129 pgs: 129 active+clean; 432 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 5.9 MiB/s wr, 286 op/s 2026-02-17T21:22:57.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 66672423 5236.53 MB/sec execute 571 sec latency 5.051 ms 2026-02-17T21:22:57.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 166944 13.02 MB/sec execute 571 sec latency 50.884 ms 2026-02-17T21:22:58.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 66767261 5236.34 MB/sec execute 572 sec latency 2.881 ms 2026-02-17T21:22:58.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 167155 13.02 MB/sec execute 572 sec latency 45.368 ms 2026-02-17T21:22:59.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:22:59 trial104 ceph-mon[20612]: pgmap v824: 129 pgs: 129 active+clean; 436 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 274 op/s 2026-02-17T21:22:59.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:22:59 trial153 ceph-mon[25357]: pgmap v824: 129 pgs: 129 active+clean; 436 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.6 MiB/s wr, 274 op/s 2026-02-17T21:22:59.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 66864677 5236.42 MB/sec execute 573 sec latency 2.579 ms 2026-02-17T21:22:59.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 167379 13.01 MB/sec execute 573 sec latency 51.373 ms 2026-02-17T21:23:00.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 66960074 5236.34 MB/sec execute 574 sec latency 4.518 ms 2026-02-17T21:23:00.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 167592 13.01 MB/sec execute 574 sec latency 40.748 ms 2026-02-17T21:23:01.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:01 trial104 ceph-mon[20612]: pgmap v825: 129 pgs: 129 active+clean; 447 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 6.7 MiB/s wr, 278 op/s 2026-02-17T21:23:01.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:01 trial153 ceph-mon[25357]: pgmap v825: 129 pgs: 129 active+clean; 447 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.9 KiB/s rd, 6.7 MiB/s wr, 278 op/s 2026-02-17T21:23:01.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 67050913 5235.87 MB/sec execute 575 sec latency 29.526 ms 2026-02-17T21:23:01.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 167799 13.00 MB/sec execute 575 sec latency 47.282 ms 2026-02-17T21:23:02.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 67140295 5235.16 MB/sec execute 576 sec latency 34.217 ms 2026-02-17T21:23:02.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 168048 12.99 MB/sec execute 576 sec latency 40.054 ms 2026-02-17T21:23:03.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:03 trial104 ceph-mon[20612]: pgmap v826: 129 pgs: 129 active+clean; 449 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 209 op/s 2026-02-17T21:23:03.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:23:03.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:23:03.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:23:03.405 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:03 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:23:03.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:03 trial153 ceph-mon[25357]: pgmap v826: 129 pgs: 129 active+clean; 449 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 209 op/s 2026-02-17T21:23:03.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2026-02-17T21:23:03.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2026-02-17T21:23:03.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2026-02-17T21:23:03.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:03 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' 2026-02-17T21:23:03.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 67235798 5235.03 MB/sec execute 577 sec latency 5.652 ms 2026-02-17T21:23:03.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 168290 12.98 MB/sec execute 577 sec latency 47.752 ms 2026-02-17T21:23:04.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:04 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:23:04.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:04 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:23:04.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 67330093 5234.82 MB/sec execute 578 sec latency 3.976 ms 2026-02-17T21:23:04.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 168536 12.98 MB/sec execute 578 sec latency 40.004 ms 2026-02-17T21:23:05.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:05 trial104 ceph-mon[20612]: pgmap v827: 129 pgs: 129 active+clean; 436 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.4 MiB/s wr, 225 op/s 2026-02-17T21:23:05.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:05 trial153 ceph-mon[25357]: pgmap v827: 129 pgs: 129 active+clean; 436 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.4 MiB/s wr, 225 op/s 2026-02-17T21:23:05.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 67425163 5234.75 MB/sec execute 579 sec latency 3.033 ms 2026-02-17T21:23:05.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 168782 12.98 MB/sec execute 579 sec latency 47.033 ms 2026-02-17T21:23:06.895 INFO:tasks.workunit.client.0.trial104.stdout: 10 67520905 5234.71 MB/sec execute 580 sec latency 2.653 ms 2026-02-17T21:23:06.919 INFO:tasks.workunit.client.1.trial153.stdout: 10 169046 12.98 MB/sec execute 580 sec latency 42.367 ms 2026-02-17T21:23:07.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:07 trial153 ceph-mon[25357]: pgmap v828: 129 pgs: 129 active+clean; 409 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.4 MiB/s wr, 269 op/s 2026-02-17T21:23:07.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:07 trial104 ceph-mon[20612]: pgmap v828: 129 pgs: 129 active+clean; 409 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 8.1 KiB/s rd, 6.4 MiB/s wr, 269 op/s 2026-02-17T21:23:07.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 67618117 5234.75 MB/sec execute 581 sec latency 4.094 ms 2026-02-17T21:23:07.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 169323 12.99 MB/sec execute 581 sec latency 39.923 ms 2026-02-17T21:23:08.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 67715279 5234.76 MB/sec execute 582 sec latency 4.316 ms 2026-02-17T21:23:08.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 169623 13.00 MB/sec execute 582 sec latency 39.723 ms 2026-02-17T21:23:09.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:09 trial104 ceph-mon[20612]: pgmap v829: 129 pgs: 129 active+clean; 412 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 252 op/s 2026-02-17T21:23:09.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:09 trial153 ceph-mon[25357]: pgmap v829: 129 pgs: 129 active+clean; 412 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.8 MiB/s wr, 252 op/s 2026-02-17T21:23:09.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 67811738 5234.76 MB/sec execute 583 sec latency 4.873 ms 2026-02-17T21:23:09.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 169861 13.01 MB/sec execute 583 sec latency 44.206 ms 2026-02-17T21:23:10.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 67907901 5234.85 MB/sec execute 584 sec latency 3.243 ms 2026-02-17T21:23:10.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 170153 13.03 MB/sec execute 584 sec latency 41.627 ms 2026-02-17T21:23:11.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:11 trial104 ceph-mon[20612]: pgmap v830: 129 pgs: 129 active+clean; 419 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 6.6 MiB/s wr, 294 op/s 2026-02-17T21:23:11.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:11 trial153 ceph-mon[25357]: pgmap v830: 129 pgs: 129 active+clean; 419 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 9.4 KiB/s rd, 6.6 MiB/s wr, 294 op/s 2026-02-17T21:23:11.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 68004145 5234.78 MB/sec execute 585 sec latency 14.445 ms 2026-02-17T21:23:11.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 170383 13.03 MB/sec execute 585 sec latency 49.900 ms 2026-02-17T21:23:12.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 68101695 5234.86 MB/sec execute 586 sec latency 2.444 ms 2026-02-17T21:23:12.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 170559 13.02 MB/sec execute 586 sec latency 55.289 ms 2026-02-17T21:23:13.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:13 trial104 ceph-mon[20612]: pgmap v831: 129 pgs: 129 active+clean; 421 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 258 op/s 2026-02-17T21:23:13.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:13 trial153 ceph-mon[25357]: pgmap v831: 129 pgs: 129 active+clean; 421 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 258 op/s 2026-02-17T21:23:13.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 68198740 5234.86 MB/sec execute 587 sec latency 3.136 ms 2026-02-17T21:23:13.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 170773 13.02 MB/sec execute 587 sec latency 44.335 ms 2026-02-17T21:23:14.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 68295169 5234.86 MB/sec execute 588 sec latency 4.885 ms 2026-02-17T21:23:14.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 170997 13.01 MB/sec execute 588 sec latency 50.365 ms 2026-02-17T21:23:15.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:15 trial104 ceph-mon[20612]: pgmap v832: 129 pgs: 129 active+clean; 427 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 5.7 MiB/s wr, 242 op/s 2026-02-17T21:23:15.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:15 trial153 ceph-mon[25357]: pgmap v832: 129 pgs: 129 active+clean; 427 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 5.7 MiB/s wr, 242 op/s 2026-02-17T21:23:15.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 68391270 5234.94 MB/sec execute 589 sec latency 4.251 ms 2026-02-17T21:23:15.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 171199 13.01 MB/sec execute 589 sec latency 43.923 ms 2026-02-17T21:23:16.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 68487491 5234.89 MB/sec execute 590 sec latency 3.700 ms 2026-02-17T21:23:16.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 171426 13.00 MB/sec execute 590 sec latency 54.966 ms 2026-02-17T21:23:17.273 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:17 trial153 ceph-mon[25357]: pgmap v833: 129 pgs: 129 active+clean; 437 MiB data, 5.7 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 6.5 MiB/s wr, 281 op/s 2026-02-17T21:23:17.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:17 trial104 ceph-mon[20612]: pgmap v833: 129 pgs: 129 active+clean; 437 MiB data, 5.7 GiB used, 5.5 TiB / 5.5 TiB avail; 6.6 KiB/s rd, 6.5 MiB/s wr, 281 op/s 2026-02-17T21:23:17.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 68579364 5234.44 MB/sec execute 591 sec latency 23.678 ms 2026-02-17T21:23:17.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 171668 12.99 MB/sec execute 591 sec latency 45.812 ms 2026-02-17T21:23:18.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 68674625 5234.27 MB/sec execute 592 sec latency 10.258 ms 2026-02-17T21:23:18.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 171910 12.98 MB/sec execute 592 sec latency 42.521 ms 2026-02-17T21:23:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:19 trial104 ceph-mon[20612]: pgmap v834: 129 pgs: 129 active+clean; 434 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 246 op/s 2026-02-17T21:23:19.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:19 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:23:19.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:19 trial153 ceph-mon[25357]: pgmap v834: 129 pgs: 129 active+clean; 434 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 246 op/s 2026-02-17T21:23:19.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:19 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:23:19.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 68772042 5234.41 MB/sec execute 593 sec latency 2.723 ms 2026-02-17T21:23:19.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 172152 12.98 MB/sec execute 593 sec latency 40.100 ms 2026-02-17T21:23:20.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 68868889 5234.53 MB/sec execute 594 sec latency 2.885 ms 2026-02-17T21:23:20.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 172422 12.99 MB/sec execute 594 sec latency 52.881 ms 2026-02-17T21:23:21.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:21 trial104 ceph-mon[20612]: pgmap v835: 129 pgs: 129 active+clean; 423 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 8.4 KiB/s rd, 6.7 MiB/s wr, 264 op/s 2026-02-17T21:23:21.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:21 trial153 ceph-mon[25357]: pgmap v835: 129 pgs: 129 active+clean; 423 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 8.4 KiB/s rd, 6.7 MiB/s wr, 264 op/s 2026-02-17T21:23:21.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 68964355 5234.39 MB/sec execute 595 sec latency 16.769 ms 2026-02-17T21:23:21.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 172689 12.98 MB/sec execute 595 sec latency 39.145 ms 2026-02-17T21:23:22.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 69060928 5234.36 MB/sec execute 596 sec latency 7.116 ms 2026-02-17T21:23:22.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 172960 12.99 MB/sec execute 596 sec latency 37.013 ms 2026-02-17T21:23:23.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:23 trial104 ceph-mon[20612]: pgmap v836: 129 pgs: 129 active+clean; 426 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 237 op/s 2026-02-17T21:23:23.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:23 trial153 ceph-mon[25357]: pgmap v836: 129 pgs: 129 active+clean; 426 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 237 op/s 2026-02-17T21:23:23.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 69158532 5234.45 MB/sec execute 597 sec latency 2.460 ms 2026-02-17T21:23:23.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 173252 13.01 MB/sec execute 597 sec latency 35.974 ms 2026-02-17T21:23:24.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 69255054 5234.51 MB/sec execute 598 sec latency 2.531 ms 2026-02-17T21:23:24.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 173482 13.01 MB/sec execute 598 sec latency 41.894 ms 2026-02-17T21:23:25.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:25 trial104 ceph-mon[20612]: pgmap v837: 129 pgs: 129 active+clean; 427 MiB data, 5.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 6.1 MiB/s wr, 248 op/s 2026-02-17T21:23:25.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:25 trial153 ceph-mon[25357]: pgmap v837: 129 pgs: 129 active+clean; 427 MiB data, 5.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 6.1 MiB/s wr, 248 op/s 2026-02-17T21:23:25.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 69351087 5234.52 MB/sec execute 599 sec latency 4.930 ms 2026-02-17T21:23:25.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 173762 13.03 MB/sec execute 599 sec latency 44.365 ms 2026-02-17T21:23:26.896 INFO:tasks.workunit.client.0.trial104.stdout: 10 cleanup 600 sec 2026-02-17T21:23:26.903 INFO:tasks.workunit.client.0.trial104.stdout: 0 cleanup 600 sec 2026-02-17T21:23:26.903 INFO:tasks.workunit.client.0.trial104.stdout: 2026-02-17T21:23:26.903 INFO:tasks.workunit.client.0.trial104.stdout: Operation Count AvgLat MaxLat 2026-02-17T21:23:26.903 INFO:tasks.workunit.client.0.trial104.stdout: ---------------------------------------- 2026-02-17T21:23:26.903 INFO:tasks.workunit.client.0.trial104.stdout: NTCreateX 100019269 0.013 25.505 2026-02-17T21:23:26.903 INFO:tasks.workunit.client.0.trial104.stdout: Close 73471134 0.001 2.016 2026-02-17T21:23:26.903 INFO:tasks.workunit.client.0.trial104.stdout: Rename 4235321 0.040 17.342 2026-02-17T21:23:26.903 INFO:tasks.workunit.client.0.trial104.stdout: Unlink 20198271 0.033 37.779 2026-02-17T21:23:26.904 INFO:tasks.workunit.client.0.trial104.stdout: Deltree 2522 3.180 10.455 2026-02-17T21:23:26.904 INFO:tasks.workunit.client.0.trial104.stdout: Mkdir 1261 0.002 0.005 2026-02-17T21:23:26.904 INFO:tasks.workunit.client.0.trial104.stdout: Qpathinfo 90657440 0.004 21.622 2026-02-17T21:23:26.904 INFO:tasks.workunit.client.0.trial104.stdout: Qfileinfo 15887093 0.001 2.498 2026-02-17T21:23:26.904 INFO:tasks.workunit.client.0.trial104.stdout: Qfsinfo 16623131 0.002 1.511 2026-02-17T21:23:26.904 INFO:tasks.workunit.client.0.trial104.stdout: Sfileinfo 8147495 0.008 21.241 2026-02-17T21:23:26.904 INFO:tasks.workunit.client.0.trial104.stdout: Find 35050203 0.014 25.360 2026-02-17T21:23:26.904 INFO:tasks.workunit.client.0.trial104.stdout: WriteX 49866434 0.011 26.790 2026-02-17T21:23:26.904 INFO:tasks.workunit.client.0.trial104.stdout: ReadX 156787368 0.002 39.053 2026-02-17T21:23:26.904 INFO:tasks.workunit.client.0.trial104.stdout: LockX 325694 0.002 2.190 2026-02-17T21:23:26.904 INFO:tasks.workunit.client.0.trial104.stdout: UnlockX 325694 0.001 0.574 2026-02-17T21:23:26.904 INFO:tasks.workunit.client.0.trial104.stdout: Flush 7010057 0.193 73.670 2026-02-17T21:23:26.904 INFO:tasks.workunit.client.0.trial104.stdout: 2026-02-17T21:23:26.905 INFO:tasks.workunit.client.0.trial104.stdout:Throughput 5234.52 MB/sec 10 clients 10 procs max_latency=73.672 ms 2026-02-17T21:23:26.905 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T21:23:26.905 DEBUG:teuthology.orchestra.run.trial104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2026-02-17T21:23:26.920 INFO:tasks.workunit.client.1.trial153.stdout: 10 cleanup 600 sec 2026-02-17T21:23:26.975 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2026-02-17T21:23:26.975 DEBUG:teuthology.orchestra.run.trial104:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2026-02-17T21:23:27.320 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:27 trial104 ceph-mon[20612]: pgmap v838: 129 pgs: 129 active+clean; 439 MiB data, 5.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 6.2 MiB/s wr, 290 op/s 2026-02-17T21:23:27.322 DEBUG:teuthology.parallel:result is None 2026-02-17T21:23:27.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:27 trial153 ceph-mon[25357]: pgmap v838: 129 pgs: 129 active+clean; 439 MiB data, 5.7 GiB used, 5.5 TiB / 5.5 TiB avail; 9.3 KiB/s rd, 6.2 MiB/s wr, 290 op/s 2026-02-17T21:23:27.787 INFO:tasks.workunit.client.1.trial153.stdout: 0 cleanup 601 sec 2026-02-17T21:23:27.787 INFO:tasks.workunit.client.1.trial153.stdout: 2026-02-17T21:23:27.787 INFO:tasks.workunit.client.1.trial153.stdout: Operation Count AvgLat MaxLat 2026-02-17T21:23:27.787 INFO:tasks.workunit.client.1.trial153.stdout: ---------------------------------------- 2026-02-17T21:23:27.787 INFO:tasks.workunit.client.1.trial153.stdout: NTCreateX 249973 7.000 54.961 2026-02-17T21:23:27.787 INFO:tasks.workunit.client.1.trial153.stdout: Close 183791 0.143 5.908 2026-02-17T21:23:27.788 INFO:tasks.workunit.client.1.trial153.stdout: Rename 10631 14.642 46.897 2026-02-17T21:23:27.788 INFO:tasks.workunit.client.1.trial153.stdout: Unlink 50295 5.408 37.161 2026-02-17T21:23:27.788 INFO:tasks.workunit.client.1.trial153.stdout: Qpathinfo 227025 3.876 54.638 2026-02-17T21:23:27.788 INFO:tasks.workunit.client.1.trial153.stdout: Qfileinfo 39694 0.298 4.780 2026-02-17T21:23:27.788 INFO:tasks.workunit.client.1.trial153.stdout: Qfsinfo 41562 0.638 7.992 2026-02-17T21:23:27.788 INFO:tasks.workunit.client.1.trial153.stdout: Sfileinfo 20427 2.281 8.077 2026-02-17T21:23:27.788 INFO:tasks.workunit.client.1.trial153.stdout: Find 87753 30.722 79.764 2026-02-17T21:23:27.788 INFO:tasks.workunit.client.1.trial153.stdout: WriteX 123852 0.456 8.149 2026-02-17T21:23:27.788 INFO:tasks.workunit.client.1.trial153.stdout: ReadX 393502 0.005 2.613 2026-02-17T21:23:27.788 INFO:tasks.workunit.client.1.trial153.stdout: LockX 820 1.289 26.264 2026-02-17T21:23:27.788 INFO:tasks.workunit.client.1.trial153.stdout: UnlockX 820 1.217 4.242 2026-02-17T21:23:27.788 INFO:tasks.workunit.client.1.trial153.stdout: Flush 17505 4.151 57.902 2026-02-17T21:23:27.788 INFO:tasks.workunit.client.1.trial153.stdout: 2026-02-17T21:23:27.789 INFO:tasks.workunit.client.1.trial153.stdout:Throughput 13.0276 MB/sec 10 clients 10 procs max_latency=79.770 ms 2026-02-17T21:23:27.789 INFO:teuthology.orchestra.run:Running command with timeout 3600 2026-02-17T21:23:27.789 DEBUG:teuthology.orchestra.run.trial153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2026-02-17T21:23:28.173 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.1... 2026-02-17T21:23:28.173 DEBUG:teuthology.orchestra.run.trial153:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2026-02-17T21:23:28.434 DEBUG:teuthology.parallel:result is None 2026-02-17T21:23:28.434 DEBUG:teuthology.orchestra.run.trial104:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T21:23:28.460 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T21:23:28.461 DEBUG:teuthology.orchestra.run.trial104:> rmdir -- /home/ubuntu/cephtest/mnt.0 2026-02-17T21:23:28.517 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2026-02-17T21:23:28.517 DEBUG:teuthology.orchestra.run.trial153:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2026-02-17T21:23:28.552 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2026-02-17T21:23:28.552 INFO:teuthology.run_tasks:Running task pexec... 2026-02-17T21:23:28.571 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-17T21:23:28.572 DEBUG:teuthology.orchestra.run.trial104:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-17T21:23:28.572 DEBUG:teuthology.orchestra.run.trial153:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-17T21:23:28.575 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial104.front.sepia.ceph.com 2026-02-17T21:23:28.575 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-17T21:23:28.575 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-17T21:23:28.594 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial153.front.sepia.ceph.com 2026-02-17T21:23:28.594 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-17T21:23:28.595 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-17T21:23:28.768 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T21:23:28.769 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T21:23:28.769 INFO:teuthology.orchestra.run.trial104.stdout: Package Architecture Version Repository Size 2026-02-17T21:23:28.769 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T21:23:28.769 INFO:teuthology.orchestra.run.trial104.stdout:Removing: 2026-02-17T21:23:28.770 INFO:teuthology.orchestra.run.trial104.stdout: nvme-cli x86_64 2.13-1.el9 @baseos 6.8 M 2026-02-17T21:23:28.770 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T21:23:28.770 INFO:teuthology.orchestra.run.trial104.stdout:Transaction Summary 2026-02-17T21:23:28.770 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T21:23:28.770 INFO:teuthology.orchestra.run.trial104.stdout:Remove 1 Package 2026-02-17T21:23:28.770 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T21:23:28.770 INFO:teuthology.orchestra.run.trial104.stdout:Freed space: 6.8 M 2026-02-17T21:23:28.770 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction check 2026-02-17T21:23:28.771 INFO:teuthology.orchestra.run.trial104.stdout:Transaction check succeeded. 2026-02-17T21:23:28.772 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction test 2026-02-17T21:23:28.789 INFO:teuthology.orchestra.run.trial104.stdout:Transaction test succeeded. 2026-02-17T21:23:28.789 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction 2026-02-17T21:23:28.833 INFO:teuthology.orchestra.run.trial104.stdout: Preparing : 1/1 2026-02-17T21:23:28.854 INFO:teuthology.orchestra.run.trial104.stdout: Erasing : nvme-cli-2.13-1.el9.x86_64 1/1 2026-02-17T21:23:28.915 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T21:23:28.916 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T21:23:28.916 INFO:teuthology.orchestra.run.trial153.stdout: Package Architecture Version Repository Size 2026-02-17T21:23:28.916 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T21:23:28.916 INFO:teuthology.orchestra.run.trial153.stdout:Removing: 2026-02-17T21:23:28.916 INFO:teuthology.orchestra.run.trial153.stdout: nvme-cli x86_64 2.13-1.el9 @baseos 6.8 M 2026-02-17T21:23:28.916 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T21:23:28.916 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T21:23:28.917 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T21:23:28.917 INFO:teuthology.orchestra.run.trial153.stdout:Remove 1 Package 2026-02-17T21:23:28.917 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T21:23:28.917 INFO:teuthology.orchestra.run.trial153.stdout:Freed space: 6.8 M 2026-02-17T21:23:28.917 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T21:23:28.921 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T21:23:28.921 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T21:23:28.946 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T21:23:28.946 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T21:23:28.955 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 1/1 2026-02-17T21:23:28.997 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 1/1 2026-02-17T21:23:28.997 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T21:23:28.997 INFO:teuthology.orchestra.run.trial104.stdout:Removed: 2026-02-17T21:23:28.998 INFO:teuthology.orchestra.run.trial104.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T21:23:28.998 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T21:23:28.998 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T21:23:28.998 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T21:23:29.019 INFO:teuthology.orchestra.run.trial153.stdout: Erasing : nvme-cli-2.13-1.el9.x86_64 1/1 2026-02-17T21:23:29.356 INFO:teuthology.orchestra.run.trial104.stdout:Last metadata expiration check: 0:27:57 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T21:23:29.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:29 trial104 ceph-mon[20612]: pgmap v839: 129 pgs: 129 active+clean; 442 MiB data, 5.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 237 op/s 2026-02-17T21:23:29.455 INFO:teuthology.orchestra.run.trial104.stdout:Dependencies resolved. 2026-02-17T21:23:29.456 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T21:23:29.456 INFO:teuthology.orchestra.run.trial104.stdout: Package Architecture Version Repository Size 2026-02-17T21:23:29.456 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T21:23:29.456 INFO:teuthology.orchestra.run.trial104.stdout:Installing: 2026-02-17T21:23:29.456 INFO:teuthology.orchestra.run.trial104.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-17T21:23:29.456 INFO:teuthology.orchestra.run.trial104.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-17T21:23:29.457 INFO:teuthology.orchestra.run.trial104.stdout:Upgrading: 2026-02-17T21:23:29.457 INFO:teuthology.orchestra.run.trial104.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-17T21:23:29.457 INFO:teuthology.orchestra.run.trial104.stdout:Installing dependencies: 2026-02-17T21:23:29.457 INFO:teuthology.orchestra.run.trial104.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-17T21:23:29.457 INFO:teuthology.orchestra.run.trial104.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-17T21:23:29.457 INFO:teuthology.orchestra.run.trial104.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-17T21:23:29.457 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T21:23:29.457 INFO:teuthology.orchestra.run.trial104.stdout:Transaction Summary 2026-02-17T21:23:29.457 INFO:teuthology.orchestra.run.trial104.stdout:================================================================================ 2026-02-17T21:23:29.457 INFO:teuthology.orchestra.run.trial104.stdout:Install 5 Packages 2026-02-17T21:23:29.457 INFO:teuthology.orchestra.run.trial104.stdout:Upgrade 1 Package 2026-02-17T21:23:29.457 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T21:23:29.458 INFO:teuthology.orchestra.run.trial104.stdout:Total download size: 2.3 M 2026-02-17T21:23:29.458 INFO:teuthology.orchestra.run.trial104.stdout:Downloading Packages: 2026-02-17T21:23:29.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:29 trial153 ceph-mon[25357]: pgmap v839: 129 pgs: 129 active+clean; 442 MiB data, 5.7 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.3 MiB/s wr, 237 op/s 2026-02-17T21:23:29.865 INFO:teuthology.orchestra.run.trial104.stdout:(1/6): nvmetcli-0.8-3.el9.noarch.rpm 138 kB/s | 44 kB 00:00 2026-02-17T21:23:29.911 INFO:teuthology.orchestra.run.trial104.stdout:(2/6): python3-configshell-1.1.30-1.el9.noarch. 197 kB/s | 72 kB 00:00 2026-02-17T21:23:30.042 INFO:teuthology.orchestra.run.trial104.stdout:(3/6): python3-kmod-0.9-32.el9.x86_64.rpm 476 kB/s | 84 kB 00:00 2026-02-17T21:23:30.172 INFO:teuthology.orchestra.run.trial104.stdout:(4/6): libnvme-1.16.1-2.el9.x86_64.rpm 895 kB/s | 116 kB 00:00 2026-02-17T21:23:30.233 INFO:teuthology.orchestra.run.trial104.stdout:(5/6): nvme-cli-2.16-1.el9.x86_64.rpm 1.7 MB/s | 1.2 MB 00:00 2026-02-17T21:23:30.296 INFO:teuthology.orchestra.run.trial104.stdout:(6/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 2.1 MB/s | 837 kB 00:00 2026-02-17T21:23:30.296 INFO:teuthology.orchestra.run.trial104.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:23:30.296 INFO:teuthology.orchestra.run.trial104.stdout:Total 2.7 MB/s | 2.3 MB 00:00 2026-02-17T21:23:30.351 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction check 2026-02-17T21:23:30.359 INFO:teuthology.orchestra.run.trial104.stdout:Transaction check succeeded. 2026-02-17T21:23:30.359 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction test 2026-02-17T21:23:30.414 INFO:teuthology.orchestra.run.trial104.stdout:Transaction test succeeded. 2026-02-17T21:23:30.414 INFO:teuthology.orchestra.run.trial104.stdout:Running transaction 2026-02-17T21:23:30.489 INFO:teuthology.orchestra.run.trial104.stdout: Preparing : 1/1 2026-02-17T21:23:30.556 INFO:teuthology.orchestra.run.trial104.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/7 2026-02-17T21:23:30.567 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/7 2026-02-17T21:23:30.573 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-02-17T21:23:30.578 INFO:teuthology.orchestra.run.trial104.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/7 2026-02-17T21:23:30.579 INFO:teuthology.orchestra.run.trial104.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/7 2026-02-17T21:23:30.709 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/7 2026-02-17T21:23:30.712 INFO:teuthology.orchestra.run.trial104.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 6/7 2026-02-17T21:23:31.060 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 6/7 2026-02-17T21:23:31.087 INFO:teuthology.orchestra.run.trial104.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 7/7 2026-02-17T21:23:31.172 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: nvme-cli-2.13-1.el9.x86_64 1/1 2026-02-17T21:23:31.215 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : nvme-cli-2.13-1.el9.x86_64 1/1 2026-02-17T21:23:31.216 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T21:23:31.216 INFO:teuthology.orchestra.run.trial153.stdout:Removed: 2026-02-17T21:23:31.216 INFO:teuthology.orchestra.run.trial153.stdout: nvme-cli-2.13-1.el9.x86_64 2026-02-17T21:23:31.216 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T21:23:31.216 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T21:23:31.362 INFO:teuthology.orchestra.run.trial104.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 7/7 2026-02-17T21:23:31.362 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/7 2026-02-17T21:23:31.362 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/7 2026-02-17T21:23:31.362 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-02-17T21:23:31.362 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/7 2026-02-17T21:23:31.363 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 5/7 2026-02-17T21:23:31.363 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 6/7 2026-02-17T21:23:31.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:31 trial104 ceph-mon[20612]: pgmap v840: 129 pgs: 129 active+clean; 329 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.2 MiB/s wr, 276 op/s 2026-02-17T21:23:31.420 INFO:teuthology.orchestra.run.trial104.stdout: Verifying : libnvme-1.13-1.el9.x86_64 7/7 2026-02-17T21:23:31.420 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T21:23:31.420 INFO:teuthology.orchestra.run.trial104.stdout:Upgraded: 2026-02-17T21:23:31.420 INFO:teuthology.orchestra.run.trial104.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-17T21:23:31.420 INFO:teuthology.orchestra.run.trial104.stdout:Installed: 2026-02-17T21:23:31.421 INFO:teuthology.orchestra.run.trial104.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-17T21:23:31.421 INFO:teuthology.orchestra.run.trial104.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-17T21:23:31.421 INFO:teuthology.orchestra.run.trial104.stdout: python3-urwid-2.1.2-4.el9.x86_64 2026-02-17T21:23:31.421 INFO:teuthology.orchestra.run.trial104.stdout: 2026-02-17T21:23:31.421 INFO:teuthology.orchestra.run.trial104.stdout:Complete! 2026-02-17T21:23:31.453 DEBUG:teuthology.parallel:result is None 2026-02-17T21:23:31.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:31 trial153 ceph-mon[25357]: pgmap v840: 129 pgs: 129 active+clean; 329 MiB data, 5.6 GiB used, 5.5 TiB / 5.5 TiB avail; 6.2 KiB/s rd, 6.2 MiB/s wr, 276 op/s 2026-02-17T21:23:31.542 INFO:teuthology.orchestra.run.trial153.stdout:Last metadata expiration check: 0:27:59 ago on Tue 17 Feb 2026 08:55:32 PM UTC. 2026-02-17T21:23:31.626 INFO:teuthology.orchestra.run.trial153.stdout:Dependencies resolved. 2026-02-17T21:23:31.627 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T21:23:31.627 INFO:teuthology.orchestra.run.trial153.stdout: Package Architecture Version Repository Size 2026-02-17T21:23:31.627 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T21:23:31.627 INFO:teuthology.orchestra.run.trial153.stdout:Installing: 2026-02-17T21:23:31.627 INFO:teuthology.orchestra.run.trial153.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-17T21:23:31.628 INFO:teuthology.orchestra.run.trial153.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-17T21:23:31.628 INFO:teuthology.orchestra.run.trial153.stdout:Upgrading: 2026-02-17T21:23:31.628 INFO:teuthology.orchestra.run.trial153.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-17T21:23:31.628 INFO:teuthology.orchestra.run.trial153.stdout:Installing dependencies: 2026-02-17T21:23:31.628 INFO:teuthology.orchestra.run.trial153.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-17T21:23:31.628 INFO:teuthology.orchestra.run.trial153.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-17T21:23:31.628 INFO:teuthology.orchestra.run.trial153.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-17T21:23:31.628 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T21:23:31.628 INFO:teuthology.orchestra.run.trial153.stdout:Transaction Summary 2026-02-17T21:23:31.628 INFO:teuthology.orchestra.run.trial153.stdout:================================================================================ 2026-02-17T21:23:31.628 INFO:teuthology.orchestra.run.trial153.stdout:Install 5 Packages 2026-02-17T21:23:31.629 INFO:teuthology.orchestra.run.trial153.stdout:Upgrade 1 Package 2026-02-17T21:23:31.629 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T21:23:31.629 INFO:teuthology.orchestra.run.trial153.stdout:Total download size: 2.3 M 2026-02-17T21:23:31.629 INFO:teuthology.orchestra.run.trial153.stdout:Downloading Packages: 2026-02-17T21:23:31.803 INFO:teuthology.orchestra.run.trial153.stdout:(1/6): nvmetcli-0.8-3.el9.noarch.rpm 401 kB/s | 44 kB 00:00 2026-02-17T21:23:31.812 INFO:teuthology.orchestra.run.trial153.stdout:(2/6): python3-configshell-1.1.30-1.el9.noarch. 608 kB/s | 72 kB 00:00 2026-02-17T21:23:31.864 INFO:teuthology.orchestra.run.trial153.stdout:(3/6): python3-kmod-0.9-32.el9.x86_64.rpm 1.4 MB/s | 84 kB 00:00 2026-02-17T21:23:31.908 INFO:teuthology.orchestra.run.trial153.stdout:(4/6): libnvme-1.16.1-2.el9.x86_64.rpm 2.6 MB/s | 116 kB 00:00 2026-02-17T21:23:31.910 INFO:teuthology.orchestra.run.trial153.stdout:(5/6): nvme-cli-2.16-1.el9.x86_64.rpm 5.3 MB/s | 1.2 MB 00:00 2026-02-17T21:23:31.932 INFO:teuthology.orchestra.run.trial153.stdout:(6/6): python3-urwid-2.1.2-4.el9.x86_64.rpm 6.8 MB/s | 837 kB 00:00 2026-02-17T21:23:31.932 INFO:teuthology.orchestra.run.trial153.stdout:-------------------------------------------------------------------------------- 2026-02-17T21:23:31.932 INFO:teuthology.orchestra.run.trial153.stdout:Total 7.5 MB/s | 2.3 MB 00:00 2026-02-17T21:23:31.986 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction check 2026-02-17T21:23:31.995 INFO:teuthology.orchestra.run.trial153.stdout:Transaction check succeeded. 2026-02-17T21:23:31.995 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction test 2026-02-17T21:23:32.103 INFO:teuthology.orchestra.run.trial153.stdout:Transaction test succeeded. 2026-02-17T21:23:32.103 INFO:teuthology.orchestra.run.trial153.stdout:Running transaction 2026-02-17T21:23:32.182 INFO:teuthology.orchestra.run.trial153.stdout: Preparing : 1/1 2026-02-17T21:23:32.251 INFO:teuthology.orchestra.run.trial153.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/7 2026-02-17T21:23:32.263 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/7 2026-02-17T21:23:32.269 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-02-17T21:23:32.275 INFO:teuthology.orchestra.run.trial153.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 4/7 2026-02-17T21:23:32.276 INFO:teuthology.orchestra.run.trial153.stdout: Installing : nvmetcli-0.8-3.el9.noarch 5/7 2026-02-17T21:23:32.406 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 5/7 2026-02-17T21:23:32.408 INFO:teuthology.orchestra.run.trial153.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 6/7 2026-02-17T21:23:32.744 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 6/7 2026-02-17T21:23:32.769 INFO:teuthology.orchestra.run.trial153.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 7/7 2026-02-17T21:23:33.022 INFO:teuthology.orchestra.run.trial153.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 7/7 2026-02-17T21:23:33.022 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/7 2026-02-17T21:23:33.022 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/7 2026-02-17T21:23:33.022 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/7 2026-02-17T21:23:33.022 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/7 2026-02-17T21:23:33.022 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 5/7 2026-02-17T21:23:33.022 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 6/7 2026-02-17T21:23:33.084 INFO:teuthology.orchestra.run.trial153.stdout: Verifying : libnvme-1.13-1.el9.x86_64 7/7 2026-02-17T21:23:33.084 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T21:23:33.084 INFO:teuthology.orchestra.run.trial153.stdout:Upgraded: 2026-02-17T21:23:33.084 INFO:teuthology.orchestra.run.trial153.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-17T21:23:33.084 INFO:teuthology.orchestra.run.trial153.stdout:Installed: 2026-02-17T21:23:33.084 INFO:teuthology.orchestra.run.trial153.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-17T21:23:33.084 INFO:teuthology.orchestra.run.trial153.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-17T21:23:33.084 INFO:teuthology.orchestra.run.trial153.stdout: python3-urwid-2.1.2-4.el9.x86_64 2026-02-17T21:23:33.084 INFO:teuthology.orchestra.run.trial153.stdout: 2026-02-17T21:23:33.084 INFO:teuthology.orchestra.run.trial153.stdout:Complete! 2026-02-17T21:23:33.115 DEBUG:teuthology.parallel:result is None 2026-02-17T21:23:33.115 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2026-02-17T21:23:33.130 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2026-02-17T21:23:33.130 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T21:23:33.130 DEBUG:teuthology.orchestra.run.trial153:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-17T21:23:33.151 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T21:23:33.151 DEBUG:teuthology.orchestra.run.trial153:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-17T21:23:33.209 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd blocklist ls 2026-02-17T21:23:33.372 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T21:23:33.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:33 trial104 ceph-mon[20612]: pgmap v841: 129 pgs: 129 active+clean; 307 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 15 KiB/s rd, 5.4 MiB/s wr, 227 op/s 2026-02-17T21:23:33.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.486+0000 7f49ac70e640 1 -- 10.20.193.104:0/3652663793 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f49a41048b0 msgr2=0x7f49a4104d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:33.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.486+0000 7f49ac70e640 1 --2- 10.20.193.104:0/3652663793 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f49a41048b0 0x7f49a4104d10 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f49980099b0 tx=0x7f499802f220 comp rx=0 tx=0).stop 2026-02-17T21:23:33.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.486+0000 7f49ac70e640 1 -- 10.20.193.104:0/3652663793 shutdown_connections 2026-02-17T21:23:33.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.486+0000 7f49ac70e640 1 --2- 10.20.193.104:0/3652663793 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f49a41048b0 0x7f49a4104d10 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:33.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.486+0000 7f49ac70e640 1 --2- 10.20.193.104:0/3652663793 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f49a410a8b0 0x7f49a410ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:33.492 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.486+0000 7f49ac70e640 1 -- 10.20.193.104:0/3652663793 >> 10.20.193.104:0/3652663793 conn(0x7f49a4100590 msgr2=0x7f49a41029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:33.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.486+0000 7f49ac70e640 1 -- 10.20.193.104:0/3652663793 shutdown_connections 2026-02-17T21:23:33.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.486+0000 7f49ac70e640 1 -- 10.20.193.104:0/3652663793 wait complete. 2026-02-17T21:23:33.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f49ac70e640 1 Processor -- start 2026-02-17T21:23:33.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f49ac70e640 1 -- start start 2026-02-17T21:23:33.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f49ac70e640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f49a41048b0 0x7f49a41a2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:33.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f49ac70e640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f49a410a8b0 0x7f49a41a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:33.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f49ac70e640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7f49a4111af0 con 0x7f49a41048b0 2026-02-17T21:23:33.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f49ac70e640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7f49a4111970 con 0x7f49a410a8b0 2026-02-17T21:23:33.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f49aa483640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f49a41048b0 0x7f49a41a2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:33.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f49aa483640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f49a41048b0 0x7f49a41a2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:56796/0 (socket says 10.20.193.104:56796) 2026-02-17T21:23:33.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f49aa483640 1 -- 10.20.193.104:0/3487178300 learned_addr learned my addr 10.20.193.104:0/3487178300 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T21:23:33.493 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f49aa483640 1 -- 10.20.193.104:0/3487178300 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f49a410a8b0 msgr2=0x7f49a41a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:33.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f49aa483640 1 --2- 10.20.193.104:0/3487178300 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f49a410a8b0 0x7f49a41a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:33.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f49aa483640 1 -- 10.20.193.104:0/3487178300 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a419c620 con 0x7f49a41048b0 2026-02-17T21:23:33.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f49aa483640 1 --2- 10.20.193.104:0/3487178300 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f49a41048b0 0x7f49a41a2460 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f499400d900 tx=0x7f499400ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:33.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f498b7fe640 1 -- 10.20.193.104:0/3487178300 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f4994014070 con 0x7f49a41048b0 2026-02-17T21:23:33.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f498b7fe640 1 -- 10.20.193.104:0/3487178300 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7f49940044a0 con 0x7f49a41048b0 2026-02-17T21:23:33.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f49ac70e640 1 -- 10.20.193.104:0/3487178300 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a419c910 con 0x7f49a41048b0 2026-02-17T21:23:33.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f498b7fe640 1 -- 10.20.193.104:0/3487178300 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7f499400be00 con 0x7f49a41048b0 2026-02-17T21:23:33.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.487+0000 7f49ac70e640 1 -- 10.20.193.104:0/3487178300 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a419cea0 con 0x7f49a41048b0 2026-02-17T21:23:33.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.488+0000 7f49ac70e640 1 -- 10.20.193.104:0/3487178300 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49a4105ff0 con 0x7f49a41048b0 2026-02-17T21:23:33.494 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.488+0000 7f498b7fe640 1 -- 10.20.193.104:0/3487178300 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7f49940047c0 con 0x7f49a41048b0 2026-02-17T21:23:33.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.489+0000 7f498b7fe640 1 --2- 10.20.193.104:0/3487178300 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f4980077550 0x7f4980079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:33.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.489+0000 7f498b7fe640 1 -- 10.20.193.104:0/3487178300 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 7336+0+0 (secure 0 0 0) 0x7f499409a2a0 con 0x7f49a41048b0 2026-02-17T21:23:33.495 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.489+0000 7f49a9c82640 1 --2- 10.20.193.104:0/3487178300 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f4980077550 0x7f4980079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:33.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.489+0000 7f49a9c82640 1 --2- 10.20.193.104:0/3487178300 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f4980077550 0x7f4980079a10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4998004870 tx=0x7f4998004800 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:33.496 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.491+0000 7f498b7fe640 1 -- 10.20.193.104:0/3487178300 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7f4994066c00 con 0x7f49a41048b0 2026-02-17T21:23:33.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:33 trial153 ceph-mon[25357]: pgmap v841: 129 pgs: 129 active+clean; 307 MiB data, 5.5 GiB used, 5.5 TiB / 5.5 TiB avail; 15 KiB/s rd, 5.4 MiB/s wr, 227 op/s 2026-02-17T21:23:33.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.579+0000 7f49ac70e640 1 -- 10.20.193.104:0/3487178300 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f49a4104d10 con 0x7f49a41048b0 2026-02-17T21:23:33.583 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.579+0000 7f498b7fe640 1 -- 10.20.193.104:0/3487178300 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v59) ==== 81+0+1021 (secure 0 0 0) 0x7f499406bab0 con 0x7f49a41048b0 2026-02-17T21:23:33.583 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.153:6832/3911303877 2026-02-18T20:58:51.049644+0000 2026-02-17T21:23:33.584 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.153:6833/3911303877 2026-02-18T20:58:51.049644+0000 2026-02-17T21:23:33.584 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/2181220307 2026-02-18T20:57:03.624371+0000 2026-02-17T21:23:33.584 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1441972685 2026-02-18T20:57:03.624371+0000 2026-02-17T21:23:33.584 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1658112270 2026-02-18T20:56:38.012869+0000 2026-02-17T21:23:33.584 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/501037198 2026-02-18T20:56:38.012869+0000 2026-02-17T21:23:33.584 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6801/3247908774 2026-02-18T20:56:38.012869+0000 2026-02-17T21:23:33.584 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/2902766949 2026-02-18T20:56:38.012869+0000 2026-02-17T21:23:33.584 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1424534119 2026-02-18T20:56:47.530062+0000 2026-02-17T21:23:33.584 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/413298199 2026-02-18T20:56:47.530062+0000 2026-02-17T21:23:33.584 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6800/95322277 2026-02-18T20:56:47.530062+0000 2026-02-17T21:23:33.584 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1013639580 2026-02-18T20:57:03.624371+0000 2026-02-17T21:23:33.585 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6801/1034073782 2026-02-18T20:57:03.624371+0000 2026-02-17T21:23:33.585 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6800/3247908774 2026-02-18T20:56:38.012869+0000 2026-02-17T21:23:33.585 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6801/95322277 2026-02-18T20:56:47.530062+0000 2026-02-17T21:23:33.585 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1181662162 2026-02-18T20:56:47.530062+0000 2026-02-17T21:23:33.585 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6800/1034073782 2026-02-18T20:57:03.624371+0000 2026-02-17T21:23:33.586 INFO:teuthology.orchestra.run.trial104.stderr:listed 17 entries 2026-02-17T21:23:33.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.580+0000 7f49ac70e640 1 -- 10.20.193.104:0/3487178300 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f4980077550 msgr2=0x7f4980079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:33.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.580+0000 7f49ac70e640 1 --2- 10.20.193.104:0/3487178300 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f4980077550 0x7f4980079a10 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4998004870 tx=0x7f4998004800 comp rx=0 tx=0).stop 2026-02-17T21:23:33.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.580+0000 7f49ac70e640 1 -- 10.20.193.104:0/3487178300 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f49a41048b0 msgr2=0x7f49a41a2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:33.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.580+0000 7f49ac70e640 1 --2- 10.20.193.104:0/3487178300 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f49a41048b0 0x7f49a41a2460 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f499400d900 tx=0x7f499400ddd0 comp rx=0 tx=0).stop 2026-02-17T21:23:33.586 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.580+0000 7f49ac70e640 1 -- 10.20.193.104:0/3487178300 shutdown_connections 2026-02-17T21:23:33.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.580+0000 7f49ac70e640 1 --2- 10.20.193.104:0/3487178300 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7f4980077550 0x7f4980079a10 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:33.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.580+0000 7f49ac70e640 1 --2- 10.20.193.104:0/3487178300 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7f49a410a8b0 0x7f49a41a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:33.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.580+0000 7f49ac70e640 1 --2- 10.20.193.104:0/3487178300 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7f49a41048b0 0x7f49a41a2460 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:33.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.580+0000 7f49ac70e640 1 -- 10.20.193.104:0/3487178300 >> 10.20.193.104:0/3487178300 conn(0x7f49a4100590 msgr2=0x7f49a4101640 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:33.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.580+0000 7f49ac70e640 1 -- 10.20.193.104:0/3487178300 shutdown_connections 2026-02-17T21:23:33.587 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.580+0000 7f49ac70e640 1 -- 10.20.193.104:0/3487178300 wait complete. 2026-02-17T21:23:33.622 DEBUG:teuthology.orchestra.run.trial153:> set -ex 2026-02-17T21:23:33.622 DEBUG:teuthology.orchestra.run.trial153:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-17T21:23:33.643 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph osd blocklist ls 2026-02-17T21:23:33.798 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T21:23:33.906 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.901+0000 7fc626a42640 1 -- 10.20.193.104:0/1881240443 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc62010a8b0 msgr2=0x7fc62010ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:33.907 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.901+0000 7fc626a42640 1 --2- 10.20.193.104:0/1881240443 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc62010a8b0 0x7fc62010ac90 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc60c0099b0 tx=0x7fc60c02f220 comp rx=0 tx=0).stop 2026-02-17T21:23:33.907 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.901+0000 7fc626a42640 1 -- 10.20.193.104:0/1881240443 shutdown_connections 2026-02-17T21:23:33.907 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.901+0000 7fc626a42640 1 --2- 10.20.193.104:0/1881240443 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc6201048b0 0x7fc620104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:33.907 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.901+0000 7fc626a42640 1 --2- 10.20.193.104:0/1881240443 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc62010a8b0 0x7fc62010ac90 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:33.907 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.901+0000 7fc626a42640 1 -- 10.20.193.104:0/1881240443 >> 10.20.193.104:0/1881240443 conn(0x7fc620100590 msgr2=0x7fc6201029b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:33.907 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.901+0000 7fc626a42640 1 -- 10.20.193.104:0/1881240443 shutdown_connections 2026-02-17T21:23:33.907 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.901+0000 7fc626a42640 1 -- 10.20.193.104:0/1881240443 wait complete. 2026-02-17T21:23:33.907 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.901+0000 7fc626a42640 1 Processor -- start 2026-02-17T21:23:33.907 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.901+0000 7fc626a42640 1 -- start start 2026-02-17T21:23:33.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.902+0000 7fc626a42640 1 --2- >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc6201048b0 0x7fc6201a2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:33.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.902+0000 7fc626a42640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc62010a8b0 0x7fc6201a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:33.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.902+0000 7fc626a42640 1 -- --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_getmap magic: 0 -- 0x7fc620111ad0 con 0x7fc62010a8b0 2026-02-17T21:23:33.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.902+0000 7fc626a42640 1 -- --> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] -- mon_getmap magic: 0 -- 0x7fc620111950 con 0x7fc6201048b0 2026-02-17T21:23:33.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.902+0000 7fc61f7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc62010a8b0 0x7fc6201a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:33.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.902+0000 7fc61f7fe640 1 --2- >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc62010a8b0 0x7fc6201a2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.104:3300/0 says I am v2:10.20.193.104:56804/0 (socket says 10.20.193.104:56804) 2026-02-17T21:23:33.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.902+0000 7fc61f7fe640 1 -- 10.20.193.104:0/872923879 learned_addr learned my addr 10.20.193.104:0/872923879 (peer_addr_for_me v2:10.20.193.104:0/0) 2026-02-17T21:23:33.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.902+0000 7fc61ffff640 1 --2- 10.20.193.104:0/872923879 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc6201048b0 0x7fc6201a2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:33.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.902+0000 7fc61f7fe640 1 -- 10.20.193.104:0/872923879 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc6201048b0 msgr2=0x7fc6201a2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:33.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.902+0000 7fc61f7fe640 1 --2- 10.20.193.104:0/872923879 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc6201048b0 0x7fc6201a2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:33.908 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.902+0000 7fc61f7fe640 1 -- 10.20.193.104:0/872923879 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62019c660 con 0x7fc62010a8b0 2026-02-17T21:23:33.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.902+0000 7fc61f7fe640 1 --2- 10.20.193.104:0/872923879 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc62010a8b0 0x7fc6201a2ad0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc61000d8d0 tx=0x7fc61000dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:33.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.902+0000 7fc61d7fa640 1 -- 10.20.193.104:0/872923879 <== mon.0 v2:10.20.193.104:3300/0 1 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc610014070 con 0x7fc62010a8b0 2026-02-17T21:23:33.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.902+0000 7fc626a42640 1 -- 10.20.193.104:0/872923879 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62019c950 con 0x7fc62010a8b0 2026-02-17T21:23:33.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.902+0000 7fc61d7fa640 1 -- 10.20.193.104:0/872923879 <== mon.0 v2:10.20.193.104:3300/0 2 ==== config(25 keys) ==== 1038+0+0 (secure 0 0 0) 0x7fc6100044a0 con 0x7fc62010a8b0 2026-02-17T21:23:33.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.902+0000 7fc61d7fa640 1 -- 10.20.193.104:0/872923879 <== mon.0 v2:10.20.193.104:3300/0 3 ==== mon_map magic: 0 ==== 351+0+0 (secure 0 0 0) 0x7fc610002dc0 con 0x7fc62010a8b0 2026-02-17T21:23:33.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.902+0000 7fc626a42640 1 -- 10.20.193.104:0/872923879 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc62019ceb0 con 0x7fc62010a8b0 2026-02-17T21:23:33.909 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.903+0000 7fc626a42640 1 -- 10.20.193.104:0/872923879 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc620105ff0 con 0x7fc62010a8b0 2026-02-17T21:23:33.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.903+0000 7fc61d7fa640 1 -- 10.20.193.104:0/872923879 <== mon.0 v2:10.20.193.104:3300/0 4 ==== mgrmap(e 19) ==== 100119+0+0 (secure 0 0 0) 0x7fc61000b840 con 0x7fc62010a8b0 2026-02-17T21:23:33.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.904+0000 7fc61d7fa640 1 --2- 10.20.193.104:0/872923879 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc5f4077550 0x7fc5f4079a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-17T21:23:33.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.904+0000 7fc61ffff640 1 --2- 10.20.193.104:0/872923879 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc5f4077550 0x7fc5f4079a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-17T21:23:33.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.904+0000 7fc61d7fa640 1 -- 10.20.193.104:0/872923879 <== mon.0 v2:10.20.193.104:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 7336+0+0 (secure 0 0 0) 0x7fc61009a230 con 0x7fc62010a8b0 2026-02-17T21:23:33.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.904+0000 7fc61ffff640 1 --2- 10.20.193.104:0/872923879 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc5f4077550 0x7fc5f4079a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009980 tx=0x7fc60c03a040 comp rx=0 tx=0).ready entity=mgr.14203 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-17T21:23:33.910 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.906+0000 7fc61d7fa640 1 -- 10.20.193.104:0/872923879 <== mon.0 v2:10.20.193.104:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+195034 (secure 0 0 0) 0x7fc610066b90 con 0x7fc62010a8b0 2026-02-17T21:23:34.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.996+0000 7fc626a42640 1 -- 10.20.193.104:0/872923879 --> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc620104d10 con 0x7fc62010a8b0 2026-02-17T21:23:34.000 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.996+0000 7fc61d7fa640 1 -- 10.20.193.104:0/872923879 <== mon.0 v2:10.20.193.104:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v59) ==== 81+0+1021 (secure 0 0 0) 0x7fc61006ba40 con 0x7fc62010a8b0 2026-02-17T21:23:34.000 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.153:6832/3911303877 2026-02-18T20:58:51.049644+0000 2026-02-17T21:23:34.000 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.153:6833/3911303877 2026-02-18T20:58:51.049644+0000 2026-02-17T21:23:34.000 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/2181220307 2026-02-18T20:57:03.624371+0000 2026-02-17T21:23:34.001 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1441972685 2026-02-18T20:57:03.624371+0000 2026-02-17T21:23:34.001 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1658112270 2026-02-18T20:56:38.012869+0000 2026-02-17T21:23:34.001 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/501037198 2026-02-18T20:56:38.012869+0000 2026-02-17T21:23:34.001 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6801/3247908774 2026-02-18T20:56:38.012869+0000 2026-02-17T21:23:34.001 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/2902766949 2026-02-18T20:56:38.012869+0000 2026-02-17T21:23:34.001 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1424534119 2026-02-18T20:56:47.530062+0000 2026-02-17T21:23:34.001 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/413298199 2026-02-18T20:56:47.530062+0000 2026-02-17T21:23:34.001 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6800/95322277 2026-02-18T20:56:47.530062+0000 2026-02-17T21:23:34.001 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1013639580 2026-02-18T20:57:03.624371+0000 2026-02-17T21:23:34.001 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6801/1034073782 2026-02-18T20:57:03.624371+0000 2026-02-17T21:23:34.001 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6800/3247908774 2026-02-18T20:56:38.012869+0000 2026-02-17T21:23:34.001 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6801/95322277 2026-02-18T20:56:47.530062+0000 2026-02-17T21:23:34.002 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:0/1181662162 2026-02-18T20:56:47.530062+0000 2026-02-17T21:23:34.002 INFO:teuthology.orchestra.run.trial104.stdout:10.20.193.104:6800/1034073782 2026-02-18T20:57:03.624371+0000 2026-02-17T21:23:34.003 INFO:teuthology.orchestra.run.trial104.stderr:listed 17 entries 2026-02-17T21:23:34.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.998+0000 7fc626a42640 1 -- 10.20.193.104:0/872923879 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc5f4077550 msgr2=0x7fc5f4079a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:34.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.998+0000 7fc626a42640 1 --2- 10.20.193.104:0/872923879 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc5f4077550 0x7fc5f4079a10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc60c009980 tx=0x7fc60c03a040 comp rx=0 tx=0).stop 2026-02-17T21:23:34.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.998+0000 7fc626a42640 1 -- 10.20.193.104:0/872923879 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc62010a8b0 msgr2=0x7fc6201a2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-17T21:23:34.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.998+0000 7fc626a42640 1 --2- 10.20.193.104:0/872923879 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc62010a8b0 0x7fc6201a2ad0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc61000d8d0 tx=0x7fc61000dda0 comp rx=0 tx=0).stop 2026-02-17T21:23:34.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.998+0000 7fc626a42640 1 -- 10.20.193.104:0/872923879 shutdown_connections 2026-02-17T21:23:34.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.998+0000 7fc626a42640 1 --2- 10.20.193.104:0/872923879 >> [v2:10.20.193.104:6800/2484917436,v1:10.20.193.104:6801/2484917436] conn(0x7fc5f4077550 0x7fc5f4079a10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:34.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.998+0000 7fc626a42640 1 --2- 10.20.193.104:0/872923879 >> [v2:10.20.193.104:3300/0,v1:10.20.193.104:6789/0] conn(0x7fc62010a8b0 0x7fc6201a2ad0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:34.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.998+0000 7fc626a42640 1 --2- 10.20.193.104:0/872923879 >> [v2:10.20.193.153:3300/0,v1:10.20.193.153:6789/0] conn(0x7fc6201048b0 0x7fc6201a2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-17T21:23:34.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.998+0000 7fc626a42640 1 -- 10.20.193.104:0/872923879 >> 10.20.193.104:0/872923879 conn(0x7fc620100590 msgr2=0x7fc620102720 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-17T21:23:34.003 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.998+0000 7fc626a42640 1 -- 10.20.193.104:0/872923879 shutdown_connections 2026-02-17T21:23:34.004 INFO:teuthology.orchestra.run.trial104.stderr:2026-02-17T21:23:33.998+0000 7fc626a42640 1 -- 10.20.193.104:0/872923879 wait complete. 2026-02-17T21:23:34.038 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@trial153.front.sepia.ceph.com... 2026-02-17T21:23:34.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T21:23:34.039 DEBUG:teuthology.orchestra.run.trial153:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2026-02-17T21:23:34.066 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.trial153.stderr:ceph-fuse[53145]: fuse finished with error 0 and tester_r 0 2026-02-17T21:23:34.068 INFO:teuthology.orchestra.run:waiting for 300 2026-02-17T21:23:34.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:34 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/3487178300' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-17T21:23:34.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:34 trial104 ceph-mon[20612]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:23:34.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:34 trial104 ceph-mon[20612]: from='client.? 10.20.193.104:0/872923879' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-17T21:23:34.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:34 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/3487178300' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-17T21:23:34.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:34 trial153 ceph-mon[25357]: from='mgr.14203 10.20.193.104:0/616959518' entity='mgr.trial104.irrhmt' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2026-02-17T21:23:34.524 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:34 trial153 ceph-mon[25357]: from='client.? 10.20.193.104:0/872923879' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2026-02-17T21:23:35.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:35 trial104 ceph-mon[20612]: pgmap v842: 129 pgs: 129 active+clean; 228 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 222 op/s 2026-02-17T21:23:35.523 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:35 trial153 ceph-mon[25357]: pgmap v842: 129 pgs: 129 active+clean; 228 MiB data, 5.3 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 5.0 MiB/s wr, 222 op/s 2026-02-17T21:23:36.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:36 trial153 ceph-mon[25357]: pgmap v843: 129 pgs: 129 active+clean; 220 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.2 MiB/s wr, 205 op/s 2026-02-17T21:23:36.654 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:36 trial104 ceph-mon[20612]: pgmap v843: 129 pgs: 129 active+clean; 220 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 4.2 MiB/s wr, 205 op/s 2026-02-17T21:23:39.274 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:38 trial153 ceph-mon[25357]: pgmap v844: 129 pgs: 129 active+clean; 213 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 2.7 MiB/s wr, 144 op/s 2026-02-17T21:23:39.404 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:38 trial104 ceph-mon[20612]: pgmap v844: 129 pgs: 129 active+clean; 213 MiB data, 5.1 GiB used, 5.5 TiB / 5.5 TiB avail; 12 KiB/s rd, 2.7 MiB/s wr, 144 op/s 2026-02-17T21:23:40.169 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@trial153.front.sepia.ceph.com 2026-02-17T21:23:40.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T21:23:40.170 DEBUG:teuthology.orchestra.run.trial153:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2026-02-17T21:23:40.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T21:23:40.191 DEBUG:teuthology.orchestra.run.trial153:> ip netns list 2026-02-17T21:23:40.248 INFO:teuthology.orchestra.run.trial153.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2026-02-17T21:23:40.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T21:23:40.248 DEBUG:teuthology.orchestra.run.trial153:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2026-02-17T21:23:40.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T21:23:40.315 DEBUG:teuthology.orchestra.run.trial153:> sudo ip link delete ceph-brx 2026-02-17T21:23:40.412 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2026-02-17T21:23:40.429 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2026-02-17T21:23:40.429 DEBUG:teuthology.orchestra.run.trial104:> set -ex 2026-02-17T21:23:40.429 DEBUG:teuthology.orchestra.run.trial104:> dd if=/proc/self/mounts of=/dev/stdout 2026-02-17T21:23:40.453 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=65197808k,nr_inodes=16299452,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=26087792k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 efivarfs /sys/firmware/efi/efivars efivarfs rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 /dev/nvme1n1p2 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=37432 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/nvme1n1p1 /boot/efi vfat rw,relatime,fmask=0022,dmask=0022,codepage=437,iocharset=ascii,shortname=mixed,errors=remount-ro 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=13043892k,nr_inodes=3260973,mode=700,uid=1000,gid=1002,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/nvme1n1p2 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/32dacc8ff1b1e3f11629b9b0fd9702e58e26c332edcb7d49bf24d77e3709b319/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/VYFGNDSCMVV5E3P3HEEIDRR4T6:/var/lib/containers/storage/overlay/l/LS2V22UUX7CCOXTABMPU2LODKG,upperdir=/var/lib/containers/storage/overlay/32dacc8ff1b1e3f11629b9b0fd9702e58e26c332edcb7d49bf24d77e3709b319/diff,workdir=/var/lib/containers/storage/overlay/32dacc8ff1b1e3f11629b9b0fd9702e58e26c332edcb7d49bf24d77e3709b319/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/c3f35380742edb55398d0c6bbaaea038d47980494c8b5fc921523d5acf465f23/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/VYFGNDSCMVV5E3P3HEEIDRR4T6:/var/lib/containers/storage/overlay/l/LS2V22UUX7CCOXTABMPU2LODKG,upperdir=/var/lib/containers/storage/overlay/c3f35380742edb55398d0c6bbaaea038d47980494c8b5fc921523d5acf465f23/diff,workdir=/var/lib/containers/storage/overlay/c3f35380742edb55398d0c6bbaaea038d47980494c8b5fc921523d5acf465f23/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=13043892k,nr_inodes=3260973,mode=700,inode64 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/8d141a51328cd48fdb246930459838c1ca0cae66d66a08696103b01b7d87750e/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/VYFGNDSCMVV5E3P3HEEIDRR4T6:/var/lib/containers/storage/overlay/l/LS2V22UUX7CCOXTABMPU2LODKG,upperdir=/var/lib/containers/storage/overlay/8d141a51328cd48fdb246930459838c1ca0cae66d66a08696103b01b7d87750e/diff,workdir=/var/lib/containers/storage/overlay/8d141a51328cd48fdb246930459838c1ca0cae66d66a08696103b01b7d87750e/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/3a483834ad9e37d2c386f506fdba564dc86dec3b34a33301271ffc76188c93cc/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/VYFGNDSCMVV5E3P3HEEIDRR4T6:/var/lib/containers/storage/overlay/l/LS2V22UUX7CCOXTABMPU2LODKG,upperdir=/var/lib/containers/storage/overlay/3a483834ad9e37d2c386f506fdba564dc86dec3b34a33301271ffc76188c93cc/diff,workdir=/var/lib/containers/storage/overlay/3a483834ad9e37d2c386f506fdba564dc86dec3b34a33301271ffc76188c93cc/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/8c42e967ae9a3ee4652b2fa7e2d1cfc45007ef832cc53bd7b15fafd3ffcf293b/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/O6NSN27PK2J2L74W4BELBL25CG:/var/lib/containers/storage/overlay/l/RW5PWMVN5ISJDI74MKJXZ5Z7WW:/var/lib/containers/storage/overlay/l/QIVY6CKLOPAVB3FTNWSXSJGOR6,upperdir=/var/lib/containers/storage/overlay/8c42e967ae9a3ee4652b2fa7e2d1cfc45007ef832cc53bd7b15fafd3ffcf293b/diff,workdir=/var/lib/containers/storage/overlay/8c42e967ae9a3ee4652b2fa7e2d1cfc45007ef832cc53bd7b15fafd3ffcf293b/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/9081f17405dbb9cd341f5e74c00d99430ccf8a90a3822fb886e9822d51ff25e7/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/KF7CBFGRQMQ4AAV6JS7GNSF4HF:/var/lib/containers/storage/overlay/l/55NSE77NUBQLOPMVMLAMK6BDRZ:/var/lib/containers/storage/overlay/l/6Z23GM7SWWCSN754DBVMRB26MS:/var/lib/containers/storage/overlay/l/ZZCLJE3OA5K5WSWRDYGSEKZSJV:/var/lib/containers/storage/overlay/l/BTQYYTFIVZNJFUZCKQYQL3WB5V:/var/lib/containers/storage/overlay/l/XFVL6YWB5YEQJ4DJE5E6PMN5PA,upperdir=/var/lib/containers/storage/overlay/9081f17405dbb9cd341f5e74c00d99430ccf8a90a3822fb886e9822d51ff25e7/diff,workdir=/var/lib/containers/storage/overlay/9081f17405dbb9cd341f5e74c00d99430ccf8a90a3822fb886e9822d51ff25e7/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/144f546a6985580c2cc15c876304789ed0decf297c2e068cb75b113e8e588dc4/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/ZWP33K6XZNZA4EEKKRTJ2GBP7F:/var/lib/containers/storage/overlay/l/TUBOJ2RNXV3UYOI6LWT5EAEL7U:/var/lib/containers/storage/overlay/l/OPFRV54ONZ7DUIMRBAT2ENYVXP:/var/lib/containers/storage/overlay/l/62QTNDRPQ3IJP5UFZW4F7DP75E:/var/lib/containers/storage/overlay/l/BUYB3OI3HLEIOFPSATHGQLAFQA:/var/lib/containers/storage/overlay/l/2R6WHU6ZF2ZL2T3BJXBJVIVPQC:/var/lib/containers/storage/overlay/l/AHNKEJMTQ2IP6QIQW23HL6EPPJ:/var/lib/containers/storage/overlay/l/UMSKVJ3AQXYKH6UOUY6WHQNL3W:/var/lib/containers/storage/overlay/l/KOG47KSZI6SM2MQLCXH3CAMEVH:/var/lib/containers/storage/overlay/l/R4BTVAVUR6HC6I54MX4G5YQEQD,upperdir=/var/lib/containers/storage/overlay/144f546a6985580c2cc15c876304789ed0decf297c2e068cb75b113e8e588dc4/diff,workdir=/var/lib/containers/storage/overlay/144f546a6985580c2cc15c876304789ed0decf297c2e068cb75b113e8e588dc4/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/417b31db64f9c2b6cd5a11fb1ab89b050051c11d071ebe75ed1e940c396dc310/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/XTUOZMPSFPWSMAP5PEVALKHDAS:/var/lib/containers/storage/overlay/l/UZ4UJDOQZ6BLYJWF4L67QTIMRR:/var/lib/containers/storage/overlay/l/7EUGJOHHQCXBLAT64IPOHHVP6A:/var/lib/containers/storage/overlay/l/J3UDC47RIXP6E2LQ2X6JMFVRUS:/var/lib/containers/storage/overlay/l/RRJXI5ULW6JQH3Y6ZIHRH4XX3I:/var/lib/containers/storage/overlay/l/O2OW7ZFTS5NYWQUZZPLV35N3V5:/var/lib/containers/storage/overlay/l/FYLGVNGRS3AY7X3DSJ67QVRSJF:/var/lib/containers/storage/overlay/l/Z56CLSF5VUC3LDSMELUCAIXOP5:/var/lib/containers/storage/overlay/l/NOOVTMAMXUKT7QPOJVY6AS3RPJ:/var/lib/containers/storage/overlay/l/VV4E54OOZNTS6HNFNBVDU25EOZ:/var/lib/containers/storage/overlay/l/OYWSGPZ6EVCS4VJ3FG6RSEIGB7:/var/lib/containers/storage/overlay/l/OP3LJYNEIMC2AFILFDKJPPETFM,upperdir=/var/lib/containers/storage/overlay/417b31db64f9c2b6cd5a11fb1ab89b050051c11d071ebe75ed1e940c396dc310/diff,workdir=/var/lib/containers/storage/overlay/417b31db64f9c2b6cd5a11fb1ab89b050051c11d071ebe75ed1e940c396dc310/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/c109abf4500e69158f7858d0ff15c2132cd4a1ad26b7ce0c25e4c11c7f40db22/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/VYFGNDSCMVV5E3P3HEEIDRR4T6:/var/lib/containers/storage/overlay/l/LS2V22UUX7CCOXTABMPU2LODKG,upperdir=/var/lib/containers/storage/overlay/c109abf4500e69158f7858d0ff15c2132cd4a1ad26b7ce0c25e4c11c7f40db22/diff,workdir=/var/lib/containers/storage/overlay/c109abf4500e69158f7858d0ff15c2132cd4a1ad26b7ce0c25e4c11c7f40db22/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/1bae539107a5266ce84b07ee64557b8e2cf1ea69a42086ead17959824de904b1/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/VYFGNDSCMVV5E3P3HEEIDRR4T6:/var/lib/containers/storage/overlay/l/LS2V22UUX7CCOXTABMPU2LODKG,upperdir=/var/lib/containers/storage/overlay/1bae539107a5266ce84b07ee64557b8e2cf1ea69a42086ead17959824de904b1/diff,workdir=/var/lib/containers/storage/overlay/1bae539107a5266ce84b07ee64557b8e2cf1ea69a42086ead17959824de904b1/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/2001c86622aedda3163f38ad139bafd9a66aeff5a2c2983f83029f67cb5fe32a/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/VYFGNDSCMVV5E3P3HEEIDRR4T6:/var/lib/containers/storage/overlay/l/LS2V22UUX7CCOXTABMPU2LODKG,upperdir=/var/lib/containers/storage/overlay/2001c86622aedda3163f38ad139bafd9a66aeff5a2c2983f83029f67cb5fe32a/diff,workdir=/var/lib/containers/storage/overlay/2001c86622aedda3163f38ad139bafd9a66aeff5a2c2983f83029f67cb5fe32a/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/b0db91605f25e7338e39c1819a00beb5a570807e2d004e82ab33eed40c11193c/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/VYFGNDSCMVV5E3P3HEEIDRR4T6:/var/lib/containers/storage/overlay/l/LS2V22UUX7CCOXTABMPU2LODKG,upperdir=/var/lib/containers/storage/overlay/b0db91605f25e7338e39c1819a00beb5a570807e2d004e82ab33eed40c11193c/diff,workdir=/var/lib/containers/storage/overlay/b0db91605f25e7338e39c1819a00beb5a570807e2d004e82ab33eed40c11193c/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/57ab8cb498ddc711d645c41ae8242f36604c4f716740b019a7eb481fe83aaf6a/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/VYFGNDSCMVV5E3P3HEEIDRR4T6:/var/lib/containers/storage/overlay/l/LS2V22UUX7CCOXTABMPU2LODKG,upperdir=/var/lib/containers/storage/overlay/57ab8cb498ddc711d645c41ae8242f36604c4f716740b019a7eb481fe83aaf6a/diff,workdir=/var/lib/containers/storage/overlay/57ab8cb498ddc711d645c41ae8242f36604c4f716740b019a7eb481fe83aaf6a/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/3d851619b6aa949ab93fdea3d6f968a54344060bdf5163e4ac2dd9ea6681f0cb/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/VYFGNDSCMVV5E3P3HEEIDRR4T6:/var/lib/containers/storage/overlay/l/LS2V22UUX7CCOXTABMPU2LODKG,upperdir=/var/lib/containers/storage/overlay/3d851619b6aa949ab93fdea3d6f968a54344060bdf5163e4ac2dd9ea6681f0cb/diff,workdir=/var/lib/containers/storage/overlay/3d851619b6aa949ab93fdea3d6f968a54344060bdf5163e4ac2dd9ea6681f0cb/work,redirect_dir=on,uuid=on,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=26087792k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2026-02-17T21:23:40.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T21:23:40.454 DEBUG:teuthology.orchestra.run.trial104:> ip netns list 2026-02-17T21:23:40.510 INFO:teuthology.orchestra.run.trial104.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2026-02-17T21:23:40.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T21:23:40.511 DEBUG:teuthology.orchestra.run.trial104:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2026-02-17T21:23:40.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2026-02-17T21:23:40.577 DEBUG:teuthology.orchestra.run.trial104:> sudo ip link delete ceph-brx 2026-02-17T21:23:40.676 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-17T21:23:40.692 INFO:tasks.cephadm:Teardown begin 2026-02-17T21:23:40.692 DEBUG:teuthology.orchestra.run.trial104:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-17T21:23:40.718 DEBUG:teuthology.orchestra.run.trial153:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-17T21:23:40.746 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-17T21:23:40.746 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-17T21:23:40.914 INFO:teuthology.orchestra.run.trial104.stderr:Inferring config /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/mon.trial104/config 2026-02-17T21:23:40.933 INFO:teuthology.orchestra.run.trial104.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-17T21:23:40.949 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-17T21:23:40.949 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-17T21:23:40.950 DEBUG:teuthology.orchestra.run.trial104:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-17T21:23:40.966 DEBUG:teuthology.orchestra.run.trial153:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-17T21:23:40.983 INFO:tasks.cephadm:Stopping all daemons... 2026-02-17T21:23:40.983 INFO:tasks.cephadm.mon.trial104:Stopping mon.trial104... 2026-02-17T21:23:40.983 DEBUG:teuthology.orchestra.run.trial104:> sudo systemctl stop ceph-19072504-0c43-11f1-93a3-d404e6e7d460@mon.trial104 2026-02-17T21:23:41.023 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:40 trial153 ceph-mon[25357]: pgmap v845: 129 pgs: 129 active+clean; 205 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 2.1 MiB/s wr, 133 op/s 2026-02-17T21:23:41.161 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:40 trial104 ceph-mon[20612]: pgmap v845: 129 pgs: 129 active+clean; 205 MiB data, 5.0 GiB used, 5.5 TiB / 5.5 TiB avail; 9.7 KiB/s rd, 2.1 MiB/s wr, 133 op/s 2026-02-17T21:23:41.161 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:41 trial104 systemd[1]: Stopping Ceph mon.trial104 for 19072504-0c43-11f1-93a3-d404e6e7d460... 2026-02-17T21:23:41.161 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:41 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial104[20608]: 2026-02-17T21:23:41.109+0000 7fe8eb0f0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.trial104 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T21:23:41.161 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:41 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial104[20608]: 2026-02-17T21:23:41.109+0000 7fe8eb0f0640 -1 mon.trial104@0(leader) e2 *** Got Signal Terminated *** 2026-02-17T21:23:41.161 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:41 trial104 podman[78547]: 2026-02-17 21:23:41.131400636 +0000 UTC m=+0.034551255 container died 23121052e3237832733ba590e6f1cb30649b6804b3c21640872430b063a02f06 (image=quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial104, ceph=True, OSD_FLAVOR=default, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.schema-version=1.0, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-17T21:23:41.161 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:41 trial104 podman[78547]: 2026-02-17 21:23:41.140456845 +0000 UTC m=+0.043607464 container remove 23121052e3237832733ba590e6f1cb30649b6804b3c21640872430b063a02f06 (image=quay.ceph.io/ceph-ci/ceph:76b494d6529326129dc43abf3fffd48fbf35c395, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial104, io.buildah.version=1.41.3, org.label-schema.build-date=20260216, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, CEPH_REF=wip-jcollin-testing-20260217.024944-squid) 2026-02-17T21:23:41.161 INFO:journalctl@ceph.mon.trial104.trial104.stdout:Feb 17 21:23:41 trial104 bash[78547]: ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial104 2026-02-17T21:23:41.217 DEBUG:teuthology.orchestra.run.trial104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@mon.trial104.service' 2026-02-17T21:23:41.257 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T21:23:41.257 INFO:tasks.cephadm.mon.trial104:Stopped mon.trial104 2026-02-17T21:23:41.257 INFO:tasks.cephadm.mon.trial153:Stopping mon.trial153... 2026-02-17T21:23:41.258 DEBUG:teuthology.orchestra.run.trial153:> sudo systemctl stop ceph-19072504-0c43-11f1-93a3-d404e6e7d460@mon.trial153 2026-02-17T21:23:41.550 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:41 trial153 systemd[1]: Stopping Ceph mon.trial153 for 19072504-0c43-11f1-93a3-d404e6e7d460... 2026-02-17T21:23:41.551 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:41 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial153[25351]: 2026-02-17T21:23:41.356+0000 7f08ae34c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.trial153 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T21:23:41.551 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:41 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial153[25351]: 2026-02-17T21:23:41.356+0000 7f08ae34c640 -1 mon.trial153@1(peon) e2 *** Got Signal Terminated *** 2026-02-17T21:23:41.551 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:41 trial153 podman[61186]: 2026-02-17 21:23:41.478722814 +0000 UTC m=+0.133968801 container died 00137817b84e78b168be426ea9407bf7c509a9b597c2ad65c63f68739b7dbf23 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial153, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, OSD_FLAVOR=default, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216) 2026-02-17T21:23:41.551 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:41 trial153 podman[61186]: 2026-02-17 21:23:41.489104265 +0000 UTC m=+0.144350252 container remove 00137817b84e78b168be426ea9407bf7c509a9b597c2ad65c63f68739b7dbf23 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial153, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.build-date=20260216, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-17T21:23:41.551 INFO:journalctl@ceph.mon.trial153.trial153.stdout:Feb 17 21:23:41 trial153 bash[61186]: ceph-19072504-0c43-11f1-93a3-d404e6e7d460-mon-trial153 2026-02-17T21:23:41.563 DEBUG:teuthology.orchestra.run.trial153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@mon.trial153.service' 2026-02-17T21:23:41.601 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T21:23:41.602 INFO:tasks.cephadm.mon.trial153:Stopped mon.trial153 2026-02-17T21:23:41.602 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-17T21:23:41.602 DEBUG:teuthology.orchestra.run.trial104:> sudo systemctl stop ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.0 2026-02-17T21:23:41.904 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 21:23:41 trial104 systemd[1]: Stopping Ceph osd.0 for 19072504-0c43-11f1-93a3-d404e6e7d460... 2026-02-17T21:23:41.904 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 21:23:41 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-0[38871]: 2026-02-17T21:23:41.696+0000 7f86e3cc8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T21:23:41.905 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 21:23:41 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-0[38871]: 2026-02-17T21:23:41.696+0000 7f86e3cc8640 -1 osd.0 59 *** Got signal Terminated *** 2026-02-17T21:23:41.905 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 21:23:41 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-0[38871]: 2026-02-17T21:23:41.696+0000 7f86e3cc8640 -1 osd.0 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-17T21:23:47.405 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 21:23:47 trial104 podman[78721]: 2026-02-17 21:23:47.141837649 +0000 UTC m=+5.456382212 container died aee2a5cd9a0681a886767004cacb661ee7f4e9dd213ca86102aa7950d598cb28 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-0, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.opencontainers.image.authors=Ceph Release Team , ceph=True, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, OSD_FLAVOR=default) 2026-02-17T21:23:47.405 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 21:23:47 trial104 podman[78721]: 2026-02-17 21:23:47.151524498 +0000 UTC m=+5.466069051 container remove aee2a5cd9a0681a886767004cacb661ee7f4e9dd213ca86102aa7950d598cb28 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default) 2026-02-17T21:23:47.405 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 21:23:47 trial104 bash[78721]: ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-0 2026-02-17T21:23:47.406 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 21:23:47 trial104 podman[78859]: 2026-02-17 21:23:47.28733391 +0000 UTC m=+0.016221763 container create b153986750d058d5111355155cbe7b161c54b71b0e626f2ff133aa2df59de290 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-0-deactivate, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-17T21:23:47.406 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 21:23:47 trial104 podman[78859]: 2026-02-17 21:23:47.314140046 +0000 UTC m=+0.043027899 container init b153986750d058d5111355155cbe7b161c54b71b0e626f2ff133aa2df59de290 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.authors=Ceph Release Team , ceph=True, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.license=GPLv2) 2026-02-17T21:23:47.406 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 21:23:47 trial104 podman[78859]: 2026-02-17 21:23:47.316465189 +0000 UTC m=+0.045353052 container start b153986750d058d5111355155cbe7b161c54b71b0e626f2ff133aa2df59de290 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS) 2026-02-17T21:23:47.406 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 21:23:47 trial104 podman[78859]: 2026-02-17 21:23:47.316999661 +0000 UTC m=+0.045887514 container attach b153986750d058d5111355155cbe7b161c54b71b0e626f2ff133aa2df59de290 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-0-deactivate, OSD_FLAVOR=default, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-17T21:23:47.406 INFO:journalctl@ceph.osd.0.trial104.stdout:Feb 17 21:23:47 trial104 podman[78859]: 2026-02-17 21:23:47.281081802 +0000 UTC m=+0.009969655 image pull 84fe6a74d1a3b04fa5507f6b41ae53d9c56c792c6c3b180af58806b7da32b8a7 quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf 2026-02-17T21:23:47.495 DEBUG:teuthology.orchestra.run.trial104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.0.service' 2026-02-17T21:23:47.532 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T21:23:47.533 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-17T21:23:47.533 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-17T21:23:47.533 DEBUG:teuthology.orchestra.run.trial104:> sudo systemctl stop ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.1 2026-02-17T21:23:47.904 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 21:23:47 trial104 systemd[1]: Stopping Ceph osd.1 for 19072504-0c43-11f1-93a3-d404e6e7d460... 2026-02-17T21:23:47.904 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 21:23:47 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-1[45355]: 2026-02-17T21:23:47.671+0000 7fb6119ca640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T21:23:47.905 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 21:23:47 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-1[45355]: 2026-02-17T21:23:47.671+0000 7fb6119ca640 -1 osd.1 59 *** Got signal Terminated *** 2026-02-17T21:23:47.905 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 21:23:47 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-1[45355]: 2026-02-17T21:23:47.671+0000 7fb6119ca640 -1 osd.1 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-17T21:23:53.551 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 21:23:53 trial104 podman[78990]: 2026-02-17 21:23:53.246057128 +0000 UTC m=+5.587652540 container died 1136bf055ba707be08a4bff8b8a24fa6bab6c310ce1fb7bf5026efe998449ed9 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-1, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, CEPH_REF=wip-jcollin-testing-20260217.024944-squid) 2026-02-17T21:23:53.552 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 21:23:53 trial104 podman[78990]: 2026-02-17 21:23:53.255770407 +0000 UTC m=+5.597365829 container remove 1136bf055ba707be08a4bff8b8a24fa6bab6c310ce1fb7bf5026efe998449ed9 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-1, org.label-schema.build-date=20260216, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395) 2026-02-17T21:23:53.552 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 21:23:53 trial104 bash[78990]: ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-1 2026-02-17T21:23:53.552 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 21:23:53 trial104 podman[79123]: 2026-02-17 21:23:53.38653471 +0000 UTC m=+0.016800507 container create 46f797df32d0c97c5a8a664931828b8d9293e447ac9b97fee0ed70569abf875a (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-1-deactivate, ceph=True, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, OSD_FLAVOR=default, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-17T21:23:53.552 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 21:23:53 trial104 podman[79123]: 2026-02-17 21:23:53.420985717 +0000 UTC m=+0.051251514 container init 46f797df32d0c97c5a8a664931828b8d9293e447ac9b97fee0ed70569abf875a (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-1-deactivate, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default) 2026-02-17T21:23:53.552 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 21:23:53 trial104 podman[79123]: 2026-02-17 21:23:53.423414804 +0000 UTC m=+0.053680601 container start 46f797df32d0c97c5a8a664931828b8d9293e447ac9b97fee0ed70569abf875a (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, ceph=True) 2026-02-17T21:23:53.552 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 21:23:53 trial104 podman[79123]: 2026-02-17 21:23:53.423934598 +0000 UTC m=+0.054200395 container attach 46f797df32d0c97c5a8a664931828b8d9293e447ac9b97fee0ed70569abf875a (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-1-deactivate, OSD_FLAVOR=default, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.label-schema.vendor=CentOS, io.buildah.version=1.41.3, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-17T21:23:53.552 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 21:23:53 trial104 podman[79123]: 2026-02-17 21:23:53.379530587 +0000 UTC m=+0.009796394 image pull 84fe6a74d1a3b04fa5507f6b41ae53d9c56c792c6c3b180af58806b7da32b8a7 quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf 2026-02-17T21:23:53.552 INFO:journalctl@ceph.osd.1.trial104.stdout:Feb 17 21:23:53 trial104 podman[79123]: 2026-02-17 21:23:53.549111826 +0000 UTC m=+0.179377623 container died 46f797df32d0c97c5a8a664931828b8d9293e447ac9b97fee0ed70569abf875a (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-1-deactivate, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, ceph=True, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default) 2026-02-17T21:23:53.584 DEBUG:teuthology.orchestra.run.trial104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.1.service' 2026-02-17T21:23:53.622 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T21:23:53.623 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-17T21:23:53.623 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-17T21:23:53.623 DEBUG:teuthology.orchestra.run.trial104:> sudo systemctl stop ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.2 2026-02-17T21:23:53.904 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 21:23:53 trial104 systemd[1]: Stopping Ceph osd.2 for 19072504-0c43-11f1-93a3-d404e6e7d460... 2026-02-17T21:23:53.904 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 21:23:53 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-2[51726]: 2026-02-17T21:23:53.755+0000 7f9e11a98640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T21:23:53.904 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 21:23:53 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-2[51726]: 2026-02-17T21:23:53.755+0000 7f9e11a98640 -1 osd.2 59 *** Got signal Terminated *** 2026-02-17T21:23:53.905 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 21:23:53 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-2[51726]: 2026-02-17T21:23:53.755+0000 7f9e11a98640 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-17T21:23:59.555 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 21:23:59 trial104 podman[79255]: 2026-02-17 21:23:59.239305345 +0000 UTC m=+5.497034352 container died 3689807877aeceb396635b003990f0480f6315294e08c33ccc0246eabd8dae07 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-2, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, ceph=True, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-jcollin-testing-20260217.024944-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-17T21:23:59.555 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 21:23:59 trial104 podman[79255]: 2026-02-17 21:23:59.249408717 +0000 UTC m=+5.507137734 container remove 3689807877aeceb396635b003990f0480f6315294e08c33ccc0246eabd8dae07 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-2, OSD_FLAVOR=default, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, io.buildah.version=1.41.3, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0) 2026-02-17T21:23:59.555 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 21:23:59 trial104 bash[79255]: ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-2 2026-02-17T21:23:59.555 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 21:23:59 trial104 podman[79391]: 2026-02-17 21:23:59.393056489 +0000 UTC m=+0.016182640 container create 9f2d25183c2c9340797de418f0584ffaa893ce211334e084cadbf82dec5c04ff (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-2-deactivate, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216) 2026-02-17T21:23:59.555 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 21:23:59 trial104 podman[79391]: 2026-02-17 21:23:59.423747261 +0000 UTC m=+0.046873342 container init 9f2d25183c2c9340797de418f0584ffaa893ce211334e084cadbf82dec5c04ff (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-2-deactivate, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216) 2026-02-17T21:23:59.555 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 21:23:59 trial104 podman[79391]: 2026-02-17 21:23:59.426110064 +0000 UTC m=+0.049236145 container start 9f2d25183c2c9340797de418f0584ffaa893ce211334e084cadbf82dec5c04ff (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-2-deactivate, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, io.buildah.version=1.41.3, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.schema-version=1.0) 2026-02-17T21:23:59.556 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 21:23:59 trial104 podman[79391]: 2026-02-17 21:23:59.426532388 +0000 UTC m=+0.049658479 container attach 9f2d25183c2c9340797de418f0584ffaa893ce211334e084cadbf82dec5c04ff (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-2-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-17T21:23:59.556 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 21:23:59 trial104 podman[79391]: 2026-02-17 21:23:59.387326069 +0000 UTC m=+0.010452150 image pull 84fe6a74d1a3b04fa5507f6b41ae53d9c56c792c6c3b180af58806b7da32b8a7 quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf 2026-02-17T21:23:59.556 INFO:journalctl@ceph.osd.2.trial104.stdout:Feb 17 21:23:59 trial104 podman[79391]: 2026-02-17 21:23:59.552445481 +0000 UTC m=+0.175571562 container died 9f2d25183c2c9340797de418f0584ffaa893ce211334e084cadbf82dec5c04ff (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-2-deactivate, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, ceph=True, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3) 2026-02-17T21:23:59.587 DEBUG:teuthology.orchestra.run.trial104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.2.service' 2026-02-17T21:23:59.624 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T21:23:59.625 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-17T21:23:59.625 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-17T21:23:59.625 DEBUG:teuthology.orchestra.run.trial104:> sudo systemctl stop ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.3 2026-02-17T21:23:59.904 INFO:journalctl@ceph.osd.3.trial104.stdout:Feb 17 21:23:59 trial104 systemd[1]: Stopping Ceph osd.3 for 19072504-0c43-11f1-93a3-d404e6e7d460... 2026-02-17T21:23:59.904 INFO:journalctl@ceph.osd.3.trial104.stdout:Feb 17 21:23:59 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-3[57388]: 2026-02-17T21:23:59.757+0000 7f71c08ff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T21:23:59.904 INFO:journalctl@ceph.osd.3.trial104.stdout:Feb 17 21:23:59 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-3[57388]: 2026-02-17T21:23:59.757+0000 7f71c08ff640 -1 osd.3 59 *** Got signal Terminated *** 2026-02-17T21:23:59.905 INFO:journalctl@ceph.osd.3.trial104.stdout:Feb 17 21:23:59 trial104 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-3[57388]: 2026-02-17T21:23:59.757+0000 7f71c08ff640 -1 osd.3 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-17T21:24:05.559 INFO:journalctl@ceph.osd.3.trial104.stdout:Feb 17 21:24:05 trial104 podman[79526]: 2026-02-17 21:24:05.252382457 +0000 UTC m=+5.506740370 container died 51bbbd869a436a7e944f311983a4d02f3c644273d066709693da66a74acce776 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS) 2026-02-17T21:24:05.559 INFO:journalctl@ceph.osd.3.trial104.stdout:Feb 17 21:24:05 trial104 podman[79526]: 2026-02-17 21:24:05.261700372 +0000 UTC m=+5.516058285 container remove 51bbbd869a436a7e944f311983a4d02f3c644273d066709693da66a74acce776 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-3, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, FROM_IMAGE=quay.io/centos/centos:stream9, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, io.buildah.version=1.41.3, org.label-schema.vendor=CentOS) 2026-02-17T21:24:05.559 INFO:journalctl@ceph.osd.3.trial104.stdout:Feb 17 21:24:05 trial104 bash[79526]: ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-3 2026-02-17T21:24:05.559 INFO:journalctl@ceph.osd.3.trial104.stdout:Feb 17 21:24:05 trial104 podman[79657]: 2026-02-17 21:24:05.387256593 +0000 UTC m=+0.016503896 container create 4d7ecac845dafa6036f69c38502c7b16f15ce0fc72ca5028702a4d90aa6069c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-3-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3) 2026-02-17T21:24:05.559 INFO:journalctl@ceph.osd.3.trial104.stdout:Feb 17 21:24:05 trial104 podman[79657]: 2026-02-17 21:24:05.425500117 +0000 UTC m=+0.054747420 container init 4d7ecac845dafa6036f69c38502c7b16f15ce0fc72ca5028702a4d90aa6069c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-3-deactivate, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, org.label-schema.build-date=20260216, ceph=True) 2026-02-17T21:24:05.559 INFO:journalctl@ceph.osd.3.trial104.stdout:Feb 17 21:24:05 trial104 podman[79657]: 2026-02-17 21:24:05.428420194 +0000 UTC m=+0.057667497 container start 4d7ecac845dafa6036f69c38502c7b16f15ce0fc72ca5028702a4d90aa6069c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-3-deactivate, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.label-schema.build-date=20260216, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-17T21:24:05.559 INFO:journalctl@ceph.osd.3.trial104.stdout:Feb 17 21:24:05 trial104 podman[79657]: 2026-02-17 21:24:05.428855571 +0000 UTC m=+0.058102874 container attach 4d7ecac845dafa6036f69c38502c7b16f15ce0fc72ca5028702a4d90aa6069c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-3-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, io.buildah.version=1.41.3, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216) 2026-02-17T21:24:05.560 INFO:journalctl@ceph.osd.3.trial104.stdout:Feb 17 21:24:05 trial104 podman[79657]: 2026-02-17 21:24:05.380737961 +0000 UTC m=+0.009985264 image pull 84fe6a74d1a3b04fa5507f6b41ae53d9c56c792c6c3b180af58806b7da32b8a7 quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf 2026-02-17T21:24:05.560 INFO:journalctl@ceph.osd.3.trial104.stdout:Feb 17 21:24:05 trial104 podman[79657]: 2026-02-17 21:24:05.556411622 +0000 UTC m=+0.185658925 container died 4d7ecac845dafa6036f69c38502c7b16f15ce0fc72ca5028702a4d90aa6069c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-3-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2026-02-17T21:24:05.587 DEBUG:teuthology.orchestra.run.trial104:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.3.service' 2026-02-17T21:24:05.623 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T21:24:05.624 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-17T21:24:05.624 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-17T21:24:05.624 DEBUG:teuthology.orchestra.run.trial153:> sudo systemctl stop ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.4 2026-02-17T21:24:06.024 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 21:24:05 trial153 systemd[1]: Stopping Ceph osd.4 for 19072504-0c43-11f1-93a3-d404e6e7d460... 2026-02-17T21:24:06.024 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 21:24:05 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-4[31240]: 2026-02-17T21:24:05.724+0000 7f803d1a5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T21:24:06.024 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 21:24:05 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-4[31240]: 2026-02-17T21:24:05.724+0000 7f803d1a5640 -1 osd.4 59 *** Got signal Terminated *** 2026-02-17T21:24:06.024 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 21:24:05 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-4[31240]: 2026-02-17T21:24:05.724+0000 7f803d1a5640 -1 osd.4 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-17T21:24:08.524 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 21:24:08 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-4[31240]: 2026-02-17T21:24:08.203+0000 7f80397be640 -1 osd.4 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:42.215391+0000 front 2026-02-17T21:23:42.215481+0000 (oldest deadline 2026-02-17T21:24:07.515462+0000) 2026-02-17T21:24:08.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:08 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:08.219+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:09.524 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 21:24:09 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-4[31240]: 2026-02-17T21:24:09.232+0000 7f80397be640 -1 osd.4 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:42.215391+0000 front 2026-02-17T21:23:42.215481+0000 (oldest deadline 2026-02-17T21:24:07.515462+0000) 2026-02-17T21:24:09.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:09 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:09.229+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:10.498 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:10 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:10.267+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:10.499 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 21:24:10 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-4[31240]: 2026-02-17T21:24:10.209+0000 7f80397be640 -1 osd.4 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:42.215391+0000 front 2026-02-17T21:23:42.215481+0000 (oldest deadline 2026-02-17T21:24:07.515462+0000) 2026-02-17T21:24:10.773 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:10 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:10.496+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:44.401331+0000 front 2026-02-17T21:23:44.401306+0000 (oldest deadline 2026-02-17T21:24:10.301263+0000) 2026-02-17T21:24:11.524 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:11 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:11.458+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:44.401331+0000 front 2026-02-17T21:23:44.401306+0000 (oldest deadline 2026-02-17T21:24:10.301263+0000) 2026-02-17T21:24:11.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:11 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:11.273+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:11.525 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 21:24:11 trial153 podman[61344]: 2026-02-17 21:24:11.219101112 +0000 UTC m=+5.507117518 container died ae779a7086dcbff5dd73a216819989b343d509494f4c2f2a7c777fbd3455c9e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-4, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, io.buildah.version=1.41.3, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.schema-version=1.0, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-17T21:24:11.525 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 21:24:11 trial153 podman[61344]: 2026-02-17 21:24:11.229575076 +0000 UTC m=+5.517591482 container remove ae779a7086dcbff5dd73a216819989b343d509494f4c2f2a7c777fbd3455c9e6 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-4, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-17T21:24:11.525 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 21:24:11 trial153 bash[61344]: ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-4 2026-02-17T21:24:11.525 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 21:24:11 trial153 podman[61477]: 2026-02-17 21:24:11.367063644 +0000 UTC m=+0.014964824 container create 1f5d64e321df61264ae1e90f069ec87f305e4d1bd02c236ab6f1c035a5d2608b (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, ceph=True) 2026-02-17T21:24:11.525 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 21:24:11 trial153 podman[61477]: 2026-02-17 21:24:11.397130756 +0000 UTC m=+0.045031935 container init 1f5d64e321df61264ae1e90f069ec87f305e4d1bd02c236ab6f1c035a5d2608b (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-4-deactivate, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-17T21:24:11.525 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 21:24:11 trial153 podman[61477]: 2026-02-17 21:24:11.400464335 +0000 UTC m=+0.048365504 container start 1f5d64e321df61264ae1e90f069ec87f305e4d1bd02c236ab6f1c035a5d2608b (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-4-deactivate, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9, OSD_FLAVOR=default, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395) 2026-02-17T21:24:11.525 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 21:24:11 trial153 podman[61477]: 2026-02-17 21:24:11.400892969 +0000 UTC m=+0.048794148 container attach 1f5d64e321df61264ae1e90f069ec87f305e4d1bd02c236ab6f1c035a5d2608b (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-4-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, ceph=True, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395) 2026-02-17T21:24:11.526 INFO:journalctl@ceph.osd.4.trial153.stdout:Feb 17 21:24:11 trial153 podman[61477]: 2026-02-17 21:24:11.360811765 +0000 UTC m=+0.008712954 image pull 84fe6a74d1a3b04fa5507f6b41ae53d9c56c792c6c3b180af58806b7da32b8a7 quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf 2026-02-17T21:24:11.572 DEBUG:teuthology.orchestra.run.trial153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.4.service' 2026-02-17T21:24:11.611 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T21:24:11.611 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-17T21:24:11.612 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-17T21:24:11.612 DEBUG:teuthology.orchestra.run.trial153:> sudo systemctl stop ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.5 2026-02-17T21:24:11.893 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:11 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5[36590]: 2026-02-17T21:24:11.631+0000 7f1a4c1e9640 -1 osd.5 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.963033+0000 front 2026-02-17T21:23:45.962926+0000 (oldest deadline 2026-02-17T21:24:10.662934+0000) 2026-02-17T21:24:11.893 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:11 trial153 systemd[1]: Stopping Ceph osd.5 for 19072504-0c43-11f1-93a3-d404e6e7d460... 2026-02-17T21:24:11.894 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:11 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5[36590]: 2026-02-17T21:24:11.757+0000 7f1a53bd8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T21:24:11.894 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:11 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5[36590]: 2026-02-17T21:24:11.757+0000 7f1a53bd8640 -1 osd.5 59 *** Got signal Terminated *** 2026-02-17T21:24:11.894 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:11 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5[36590]: 2026-02-17T21:24:11.757+0000 7f1a53bd8640 -1 osd.5 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-17T21:24:12.679 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:12 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:12.419+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:44.401331+0000 front 2026-02-17T21:23:44.401306+0000 (oldest deadline 2026-02-17T21:24:10.301263+0000) 2026-02-17T21:24:12.680 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:12 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:12.295+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:13.023 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:12 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5[36590]: 2026-02-17T21:24:12.677+0000 7f1a4c1e9640 -1 osd.5 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.963033+0000 front 2026-02-17T21:23:45.962926+0000 (oldest deadline 2026-02-17T21:24:10.662934+0000) 2026-02-17T21:24:13.523 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:13 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:13.407+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:44.401331+0000 front 2026-02-17T21:23:44.401306+0000 (oldest deadline 2026-02-17T21:24:10.301263+0000) 2026-02-17T21:24:13.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:13 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:13.250+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:14.023 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:13 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5[36590]: 2026-02-17T21:24:13.649+0000 7f1a4c1e9640 -1 osd.5 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.963033+0000 front 2026-02-17T21:23:45.962926+0000 (oldest deadline 2026-02-17T21:24:10.662934+0000) 2026-02-17T21:24:14.662 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:14 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:14.392+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:44.401331+0000 front 2026-02-17T21:23:44.401306+0000 (oldest deadline 2026-02-17T21:24:10.301263+0000) 2026-02-17T21:24:14.662 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:14 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:14.294+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:14.662 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:14 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:14.294+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:48.689534+0000 front 2026-02-17T21:23:48.689410+0000 (oldest deadline 2026-02-17T21:24:13.389476+0000) 2026-02-17T21:24:15.023 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:14 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5[36590]: 2026-02-17T21:24:14.660+0000 7f1a4c1e9640 -1 osd.5 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.963033+0000 front 2026-02-17T21:23:45.962926+0000 (oldest deadline 2026-02-17T21:24:10.662934+0000) 2026-02-17T21:24:15.696 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:15 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:15.397+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:44.401331+0000 front 2026-02-17T21:23:44.401306+0000 (oldest deadline 2026-02-17T21:24:10.301263+0000) 2026-02-17T21:24:15.697 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:15 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:15.273+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:15.697 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:15 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:15.273+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:48.689534+0000 front 2026-02-17T21:23:48.689410+0000 (oldest deadline 2026-02-17T21:24:13.389476+0000) 2026-02-17T21:24:16.023 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:15 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5[36590]: 2026-02-17T21:24:15.694+0000 7f1a4c1e9640 -1 osd.5 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.963033+0000 front 2026-02-17T21:23:45.962926+0000 (oldest deadline 2026-02-17T21:24:10.662934+0000) 2026-02-17T21:24:16.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:16 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:16.247+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:16.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:16 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:16.247+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:48.689534+0000 front 2026-02-17T21:23:48.689410+0000 (oldest deadline 2026-02-17T21:24:13.389476+0000) 2026-02-17T21:24:16.524 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:16 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:16.443+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:44.401331+0000 front 2026-02-17T21:23:44.401306+0000 (oldest deadline 2026-02-17T21:24:10.301263+0000) 2026-02-17T21:24:16.524 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:16 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:16.443+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:51.401766+0000 front 2026-02-17T21:23:51.401798+0000 (oldest deadline 2026-02-17T21:24:15.501731+0000) 2026-02-17T21:24:17.023 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:16 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5[36590]: 2026-02-17T21:24:16.743+0000 7f1a4c1e9640 -1 osd.5 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.963033+0000 front 2026-02-17T21:23:45.962926+0000 (oldest deadline 2026-02-17T21:24:10.662934+0000) 2026-02-17T21:24:17.485 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:17 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:17.397+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:44.401331+0000 front 2026-02-17T21:23:44.401306+0000 (oldest deadline 2026-02-17T21:24:10.301263+0000) 2026-02-17T21:24:17.485 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:17 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:17.397+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:51.401766+0000 front 2026-02-17T21:23:51.401798+0000 (oldest deadline 2026-02-17T21:24:15.501731+0000) 2026-02-17T21:24:17.486 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:17 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:17.215+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:17.486 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:17 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:17.215+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:48.689534+0000 front 2026-02-17T21:23:48.689410+0000 (oldest deadline 2026-02-17T21:24:13.389476+0000) 2026-02-17T21:24:17.486 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:17 trial153 podman[61617]: 2026-02-17 21:24:17.181311238 +0000 UTC m=+5.437017680 container died a6f71a58c5baf991392d59aa2ed0897cfbc46425b0c02fe4235957a0452c13ff (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.build-date=20260216, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.vendor=CentOS, FROM_IMAGE=quay.io/centos/centos:stream9, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, org.label-schema.schema-version=1.0) 2026-02-17T21:24:17.487 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:17 trial153 podman[61617]: 2026-02-17 21:24:17.191782336 +0000 UTC m=+5.447488778 container remove a6f71a58c5baf991392d59aa2ed0897cfbc46425b0c02fe4235957a0452c13ff (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, OSD_FLAVOR=default, io.buildah.version=1.41.3) 2026-02-17T21:24:17.487 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:17 trial153 bash[61617]: ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5 2026-02-17T21:24:17.487 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:17 trial153 podman[61748]: 2026-02-17 21:24:17.315301308 +0000 UTC m=+0.015998070 container create 3d55100ec59c88d3754af22ffb090e76f3502ae2a71f4589f4df2208f7257b35 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5-deactivate, io.buildah.version=1.41.3, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, ceph=True, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0) 2026-02-17T21:24:17.487 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:17 trial153 podman[61748]: 2026-02-17 21:24:17.353582228 +0000 UTC m=+0.054278940 container init 3d55100ec59c88d3754af22ffb090e76f3502ae2a71f4589f4df2208f7257b35 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.label-schema.license=GPLv2, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.vendor=CentOS, org.label-schema.build-date=20260216, org.label-schema.schema-version=1.0) 2026-02-17T21:24:17.487 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:17 trial153 podman[61748]: 2026-02-17 21:24:17.356150402 +0000 UTC m=+0.056847114 container start 3d55100ec59c88d3754af22ffb090e76f3502ae2a71f4589f4df2208f7257b35 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5-deactivate, OSD_FLAVOR=default, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, ceph=True, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216) 2026-02-17T21:24:17.487 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:17 trial153 podman[61748]: 2026-02-17 21:24:17.35672019 +0000 UTC m=+0.057416902 container attach 3d55100ec59c88d3754af22ffb090e76f3502ae2a71f4589f4df2208f7257b35 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5-deactivate, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.license=GPLv2, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, io.buildah.version=1.41.3) 2026-02-17T21:24:17.487 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:17 trial153 podman[61748]: 2026-02-17 21:24:17.309065439 +0000 UTC m=+0.009762151 image pull 84fe6a74d1a3b04fa5507f6b41ae53d9c56c792c6c3b180af58806b7da32b8a7 quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf 2026-02-17T21:24:17.487 INFO:journalctl@ceph.osd.5.trial153.stdout:Feb 17 21:24:17 trial153 podman[61748]: 2026-02-17 21:24:17.483858286 +0000 UTC m=+0.184554988 container died 3d55100ec59c88d3754af22ffb090e76f3502ae2a71f4589f4df2208f7257b35 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-5-deactivate, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-17T21:24:17.523 DEBUG:teuthology.orchestra.run.trial153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.5.service' 2026-02-17T21:24:17.560 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T21:24:17.561 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-17T21:24:17.561 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-02-17T21:24:17.561 DEBUG:teuthology.orchestra.run.trial153:> sudo systemctl stop ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.6 2026-02-17T21:24:17.774 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:17 trial153 systemd[1]: Stopping Ceph osd.6 for 19072504-0c43-11f1-93a3-d404e6e7d460... 2026-02-17T21:24:17.774 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:17 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:17.690+0000 7fe9b38c1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T21:24:17.774 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:17 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:17.690+0000 7fe9b38c1640 -1 osd.6 59 *** Got signal Terminated *** 2026-02-17T21:24:17.774 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:17 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:17.690+0000 7fe9b38c1640 -1 osd.6 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-17T21:24:18.524 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:18 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:18.410+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:44.401331+0000 front 2026-02-17T21:23:44.401306+0000 (oldest deadline 2026-02-17T21:24:10.301263+0000) 2026-02-17T21:24:18.524 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:18 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:18.410+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:51.401766+0000 front 2026-02-17T21:23:51.401798+0000 (oldest deadline 2026-02-17T21:24:15.501731+0000) 2026-02-17T21:24:18.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:18 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:18.168+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:18.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:18 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:18.168+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:48.689534+0000 front 2026-02-17T21:23:48.689410+0000 (oldest deadline 2026-02-17T21:24:13.389476+0000) 2026-02-17T21:24:19.523 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:19 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:19.213+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:19.523 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:19 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:19.213+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:48.689534+0000 front 2026-02-17T21:23:48.689410+0000 (oldest deadline 2026-02-17T21:24:13.389476+0000) 2026-02-17T21:24:19.523 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:19 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:19.460+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:44.401331+0000 front 2026-02-17T21:23:44.401306+0000 (oldest deadline 2026-02-17T21:24:10.301263+0000) 2026-02-17T21:24:19.524 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:19 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:19.460+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:51.401766+0000 front 2026-02-17T21:23:51.401798+0000 (oldest deadline 2026-02-17T21:24:15.501731+0000) 2026-02-17T21:24:20.456 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:20 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:20.181+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:20.456 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:20 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:20.181+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:48.689534+0000 front 2026-02-17T21:23:48.689410+0000 (oldest deadline 2026-02-17T21:24:13.389476+0000) 2026-02-17T21:24:20.773 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:20 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:20.454+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:44.401331+0000 front 2026-02-17T21:23:44.401306+0000 (oldest deadline 2026-02-17T21:24:10.301263+0000) 2026-02-17T21:24:20.773 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:20 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:20.454+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:51.401766+0000 front 2026-02-17T21:23:51.401798+0000 (oldest deadline 2026-02-17T21:24:15.501731+0000) 2026-02-17T21:24:21.434 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:21 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:21.180+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:21.435 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:21 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:21.180+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:48.689534+0000 front 2026-02-17T21:23:48.689410+0000 (oldest deadline 2026-02-17T21:24:13.389476+0000) 2026-02-17T21:24:21.774 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:21 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:21.432+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:44.401331+0000 front 2026-02-17T21:23:44.401306+0000 (oldest deadline 2026-02-17T21:24:10.301263+0000) 2026-02-17T21:24:21.774 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:21 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:21.432+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:51.401766+0000 front 2026-02-17T21:23:51.401798+0000 (oldest deadline 2026-02-17T21:24:15.501731+0000) 2026-02-17T21:24:22.524 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:22 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:22.410+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:44.401331+0000 front 2026-02-17T21:23:44.401306+0000 (oldest deadline 2026-02-17T21:24:10.301263+0000) 2026-02-17T21:24:22.524 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:22 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6[42180]: 2026-02-17T21:24:22.410+0000 7fe9afeda640 -1 osd.6 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:51.401766+0000 front 2026-02-17T21:23:51.401798+0000 (oldest deadline 2026-02-17T21:24:15.501731+0000) 2026-02-17T21:24:22.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:22 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:22.185+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:22.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:22 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:22.185+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:48.689534+0000 front 2026-02-17T21:23:48.689410+0000 (oldest deadline 2026-02-17T21:24:13.389476+0000) 2026-02-17T21:24:23.510 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:23 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:23.209+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:23.510 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:23 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:23.209+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:48.689534+0000 front 2026-02-17T21:23:48.689410+0000 (oldest deadline 2026-02-17T21:24:13.389476+0000) 2026-02-17T21:24:23.511 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:23 trial153 podman[61885]: 2026-02-17 21:24:23.214935566 +0000 UTC m=+5.536637876 container died 6118052e59daa27619e10dfa1243a173b88c468928691c183cd7f28555ceda95 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.build-date=20260216, ceph=True, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395) 2026-02-17T21:24:23.511 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:23 trial153 podman[61885]: 2026-02-17 21:24:23.224220732 +0000 UTC m=+5.545923042 container remove 6118052e59daa27619e10dfa1243a173b88c468928691c183cd7f28555ceda95 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, OSD_FLAVOR=default, io.buildah.version=1.41.3, FROM_IMAGE=quay.io/centos/centos:stream9) 2026-02-17T21:24:23.511 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:23 trial153 bash[61885]: ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6 2026-02-17T21:24:23.511 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:23 trial153 podman[62028]: 2026-02-17 21:24:23.350711574 +0000 UTC m=+0.016030060 container create 8c39eec47b4f3bac8d8126d2be80f7d568988b031898c246113985ed0bd03819 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6-deactivate, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, org.label-schema.license=GPLv2, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395) 2026-02-17T21:24:23.511 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:23 trial153 podman[62028]: 2026-02-17 21:24:23.383870212 +0000 UTC m=+0.049188698 container init 8c39eec47b4f3bac8d8126d2be80f7d568988b031898c246113985ed0bd03819 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6-deactivate, OSD_FLAVOR=default, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, io.buildah.version=1.41.3, org.label-schema.license=GPLv2, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, CEPH_REF=wip-jcollin-testing-20260217.024944-squid) 2026-02-17T21:24:23.511 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:23 trial153 podman[62028]: 2026-02-17 21:24:23.386417947 +0000 UTC m=+0.051736434 container start 8c39eec47b4f3bac8d8126d2be80f7d568988b031898c246113985ed0bd03819 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6-deactivate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-17T21:24:23.511 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:23 trial153 podman[62028]: 2026-02-17 21:24:23.386948893 +0000 UTC m=+0.052267379 container attach 8c39eec47b4f3bac8d8126d2be80f7d568988b031898c246113985ed0bd03819 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6-deactivate, OSD_FLAVOR=default, org.label-schema.vendor=CentOS, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20260216, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_REF=wip-jcollin-testing-20260217.024944-squid) 2026-02-17T21:24:23.511 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:23 trial153 podman[62028]: 2026-02-17 21:24:23.344022135 +0000 UTC m=+0.009340621 image pull 84fe6a74d1a3b04fa5507f6b41ae53d9c56c792c6c3b180af58806b7da32b8a7 quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf 2026-02-17T21:24:23.512 INFO:journalctl@ceph.osd.6.trial153.stdout:Feb 17 21:24:23 trial153 podman[62028]: 2026-02-17 21:24:23.508672389 +0000 UTC m=+0.173990875 container died 8c39eec47b4f3bac8d8126d2be80f7d568988b031898c246113985ed0bd03819 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-6-deactivate, io.buildah.version=1.41.3, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.label-schema.schema-version=1.0, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.label-schema.build-date=20260216, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-17T21:24:23.551 DEBUG:teuthology.orchestra.run.trial153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.6.service' 2026-02-17T21:24:23.589 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T21:24:23.589 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-02-17T21:24:23.589 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-02-17T21:24:23.590 DEBUG:teuthology.orchestra.run.trial153:> sudo systemctl stop ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.7 2026-02-17T21:24:23.774 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:23 trial153 systemd[1]: Stopping Ceph osd.7 for 19072504-0c43-11f1-93a3-d404e6e7d460... 2026-02-17T21:24:23.774 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:23 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:23.719+0000 7f606c90f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-17T21:24:23.774 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:23 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:23.719+0000 7f606c90f640 -1 osd.7 59 *** Got signal Terminated *** 2026-02-17T21:24:23.774 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:23 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:23.719+0000 7f606c90f640 -1 osd.7 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-17T21:24:24.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:24 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:24.245+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:24.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:24 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:24.245+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:48.689534+0000 front 2026-02-17T21:23:48.689410+0000 (oldest deadline 2026-02-17T21:24:13.389476+0000) 2026-02-17T21:24:25.523 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:25 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:25.231+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:25.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:25 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:25.231+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:48.689534+0000 front 2026-02-17T21:23:48.689410+0000 (oldest deadline 2026-02-17T21:24:13.389476+0000) 2026-02-17T21:24:25.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:25 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:25.231+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6822 osd.2 since back 2026-02-17T21:23:58.690059+0000 front 2026-02-17T21:23:58.690051+0000 (oldest deadline 2026-02-17T21:24:24.589996+0000) 2026-02-17T21:24:26.773 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:26 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:26.279+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:26.773 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:26 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:26.279+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:48.689534+0000 front 2026-02-17T21:23:48.689410+0000 (oldest deadline 2026-02-17T21:24:13.389476+0000) 2026-02-17T21:24:26.773 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:26 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:26.279+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6822 osd.2 since back 2026-02-17T21:23:58.690059+0000 front 2026-02-17T21:23:58.690051+0000 (oldest deadline 2026-02-17T21:24:24.589996+0000) 2026-02-17T21:24:27.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:27 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:27.269+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:27.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:27 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:27.269+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:48.689534+0000 front 2026-02-17T21:23:48.689410+0000 (oldest deadline 2026-02-17T21:24:13.389476+0000) 2026-02-17T21:24:27.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:27 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:27.269+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6822 osd.2 since back 2026-02-17T21:23:58.690059+0000 front 2026-02-17T21:23:58.690051+0000 (oldest deadline 2026-02-17T21:24:24.589996+0000) 2026-02-17T21:24:27.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:27 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:27.269+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6830 osd.3 since back 2026-02-17T21:24:04.590248+0000 front 2026-02-17T21:24:04.590266+0000 (oldest deadline 2026-02-17T21:24:26.890297+0000) 2026-02-17T21:24:28.523 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:28 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:28.237+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6806 osd.0 since back 2026-02-17T21:23:45.888821+0000 front 2026-02-17T21:23:45.888811+0000 (oldest deadline 2026-02-17T21:24:07.588901+0000) 2026-02-17T21:24:28.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:28 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:28.237+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6814 osd.1 since back 2026-02-17T21:23:48.689534+0000 front 2026-02-17T21:23:48.689410+0000 (oldest deadline 2026-02-17T21:24:13.389476+0000) 2026-02-17T21:24:28.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:28 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:28.237+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6822 osd.2 since back 2026-02-17T21:23:58.690059+0000 front 2026-02-17T21:23:58.690051+0000 (oldest deadline 2026-02-17T21:24:24.589996+0000) 2026-02-17T21:24:28.524 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:28 trial153 ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7[47688]: 2026-02-17T21:24:28.237+0000 7f6068f28640 -1 osd.7 59 heartbeat_check: no reply from 10.20.193.104:6830 osd.3 since back 2026-02-17T21:24:04.590248+0000 front 2026-02-17T21:24:04.590266+0000 (oldest deadline 2026-02-17T21:24:26.890297+0000) 2026-02-17T21:24:29.606 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:29 trial153 podman[62164]: 2026-02-17 21:24:29.314405316 +0000 UTC m=+5.607395606 container died 344ed0c8bb53521aec560c10524bc8fcffed3cf87cd62a5a546b5fdd488dd1df (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7, io.buildah.version=1.41.3, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-17T21:24:29.606 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:29 trial153 podman[62164]: 2026-02-17 21:24:29.323145489 +0000 UTC m=+5.616135789 container remove 344ed0c8bb53521aec560c10524bc8fcffed3cf87cd62a5a546b5fdd488dd1df (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7, org.label-schema.license=GPLv2, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.schema-version=1.0, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, io.buildah.version=1.41.3, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.vendor=CentOS, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.build-date=20260216, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395) 2026-02-17T21:24:29.607 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:29 trial153 bash[62164]: ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7 2026-02-17T21:24:29.607 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:29 trial153 podman[62294]: 2026-02-17 21:24:29.44890947 +0000 UTC m=+0.015104095 container create 80421a1bd60cb755e74711235790f73a4286d6239675c24b09855863a3724143 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7-deactivate, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, ceph=True, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.41.3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.vendor=CentOS, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-17T21:24:29.607 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:29 trial153 podman[62294]: 2026-02-17 21:24:29.476746762 +0000 UTC m=+0.042941327 container init 80421a1bd60cb755e74711235790f73a4286d6239675c24b09855863a3724143 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, OSD_FLAVOR=default, FROM_IMAGE=quay.io/centos/centos:stream9, org.opencontainers.image.authors=Ceph Release Team , org.label-schema.license=GPLv2, org.label-schema.build-date=20260216, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.41.3, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-17T21:24:29.607 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:29 trial153 podman[62294]: 2026-02-17 21:24:29.479430593 +0000 UTC m=+0.045625148 container start 80421a1bd60cb755e74711235790f73a4286d6239675c24b09855863a3724143 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, io.buildah.version=1.41.3, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216) 2026-02-17T21:24:29.607 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:29 trial153 podman[62294]: 2026-02-17 21:24:29.479887149 +0000 UTC m=+0.046081714 container attach 80421a1bd60cb755e74711235790f73a4286d6239675c24b09855863a3724143 (image=quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf, name=ceph-19072504-0c43-11f1-93a3-d404e6e7d460-osd-7-deactivate, org.label-schema.schema-version=1.0, FROM_IMAGE=quay.io/centos/centos:stream9, org.label-schema.build-date=20260216, OSD_FLAVOR=default, ceph=True, org.label-schema.vendor=CentOS, CEPH_REF=wip-jcollin-testing-20260217.024944-squid, org.label-schema.license=GPLv2, CEPH_SHA1=76b494d6529326129dc43abf3fffd48fbf35c395, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.label-schema.name=CentOS Stream 9 Base Image, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.41.3) 2026-02-17T21:24:29.607 INFO:journalctl@ceph.osd.7.trial153.stdout:Feb 17 21:24:29 trial153 podman[62294]: 2026-02-17 21:24:29.442271426 +0000 UTC m=+0.008465981 image pull 84fe6a74d1a3b04fa5507f6b41ae53d9c56c792c6c3b180af58806b7da32b8a7 quay.ceph.io/ceph-ci/ceph@sha256:c29b0f4c7b65a74c0ea0b412abaafe69d1a8462fdd15bdd8d4092170eeee08bf 2026-02-17T21:24:29.644 DEBUG:teuthology.orchestra.run.trial153:> sudo pkill -f 'journalctl -f -n 0 -u ceph-19072504-0c43-11f1-93a3-d404e6e7d460@osd.7.service' 2026-02-17T21:24:29.680 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-17T21:24:29.681 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-02-17T21:24:29.681 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 --force --keep-logs 2026-02-17T21:24:29.798 INFO:teuthology.orchestra.run.trial104.stdout:Deleting cluster with fsid: 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T21:24:41.057 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 --force --keep-logs 2026-02-17T21:24:41.174 INFO:teuthology.orchestra.run.trial153.stdout:Deleting cluster with fsid: 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T21:24:49.670 DEBUG:teuthology.orchestra.run.trial104:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-17T21:24:49.700 DEBUG:teuthology.orchestra.run.trial153:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-17T21:24:49.731 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-17T21:24:49.736 DEBUG:teuthology.misc:Transferring archived files from trial104:/var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:27:21-fs-wip-jcollin-testing-20260217.024944-squid-distro-default-trial/52913/remote/trial104/crash 2026-02-17T21:24:49.738 DEBUG:teuthology.orchestra.run.trial104:> sudo tar c -f - -C /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/crash -- . 2026-02-17T21:24:49.770 INFO:teuthology.orchestra.run.trial104.stderr:tar: /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-17T21:24:49.770 INFO:teuthology.orchestra.run.trial104.stderr:tar: Error is not recoverable: exiting now 2026-02-17T21:24:49.774 DEBUG:teuthology.misc:Transferring archived files from trial153:/var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:27:21-fs-wip-jcollin-testing-20260217.024944-squid-distro-default-trial/52913/remote/trial153/crash 2026-02-17T21:24:49.777 DEBUG:teuthology.orchestra.run.trial153:> sudo tar c -f - -C /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/crash -- . 2026-02-17T21:24:49.804 INFO:teuthology.orchestra.run.trial153.stderr:tar: /var/lib/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-17T21:24:49.804 INFO:teuthology.orchestra.run.trial153.stderr:tar: Error is not recoverable: exiting now 2026-02-17T21:24:49.805 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-17T21:24:49.806 DEBUG:teuthology.orchestra.run.trial104:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v 'is offline because no MDS' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v MGR_MODULE_ERROR | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'pg .* is stuck inactive' | egrep -v 'pg .* is .*degraded' | egrep -v 'pg .* is stuck peering' | head -n 1 2026-02-17T21:24:49.842 INFO:teuthology.orchestra.run.trial104.stdout:2026-02-17T20:57:59.794519+0000 osd.3 (osd.3) 3 : cluster [WRN] OSD bench result of 129443.426060 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.3. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T21:24:49.843 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2026-02-17T21:24:49.843 DEBUG:teuthology.orchestra.run.trial104:> sudo egrep '\[SEC\]' /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v 'is offline because no MDS' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v MGR_MODULE_ERROR | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'pg .* is stuck inactive' | egrep -v 'pg .* is .*degraded' | egrep -v 'pg .* is stuck peering' | head -n 1 2026-02-17T21:24:49.910 DEBUG:teuthology.orchestra.run.trial104:> sudo egrep '\[ERR\]' /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v 'is offline because no MDS' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v MGR_MODULE_ERROR | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'pg .* is stuck inactive' | egrep -v 'pg .* is .*degraded' | egrep -v 'pg .* is stuck peering' | head -n 1 2026-02-17T21:24:49.976 DEBUG:teuthology.orchestra.run.trial104:> sudo egrep '\[WRN\]' /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v 'is offline because no MDS' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v MGR_MODULE_ERROR | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'pg .* is stuck inactive' | egrep -v 'pg .* is .*degraded' | egrep -v 'pg .* is stuck peering' | head -n 1 2026-02-17T21:24:50.042 INFO:teuthology.orchestra.run.trial104.stdout:2026-02-17T20:57:59.794519+0000 osd.3 (osd.3) 3 : cluster [WRN] OSD bench result of 129443.426060 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.3. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2026-02-17T21:24:50.042 INFO:tasks.cephadm:Compressing logs... 2026-02-17T21:24:50.043 DEBUG:teuthology.orchestra.run.trial104:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:24:50.085 DEBUG:teuthology.orchestra.run.trial153:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:24:50.105 INFO:teuthology.orchestra.run.trial104.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-17T21:24:50.105 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-17T21:24:50.106 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2026-02-17T21:24:50.109 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.2.log 2026-02-17T21:24:50.109 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.0.log 2026-02-17T21:24:50.109 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-client.ceph-exporter.trial104.log 2026-02-17T21:24:50.110 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.2.log: 88.2% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2026-02-17T21:24:50.110 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.3.log/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.0.log: 2026-02-17T21:24:50.110 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-client.ceph-exporter.trial104.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mgr.trial104.irrhmt.log 2026-02-17T21:24:50.110 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.cephadm.log 2026-02-17T21:24:50.110 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mgr.trial104.irrhmt.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mon.trial104.log 2026-02-17T21:24:50.110 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mds.foo.trial104.gnmuyp.log 2026-02-17T21:24:50.110 INFO:teuthology.orchestra.run.trial104.stderr: 84.3% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.cephadm.log.gz 2026-02-17T21:24:50.110 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mon.trial104.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.audit.log 2026-02-17T21:24:50.110 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mds.foo.trial104.gnmuyp.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-volume.log 2026-02-17T21:24:50.110 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.1.log 2026-02-17T21:24:50.110 INFO:teuthology.orchestra.run.trial104.stderr: 94.5% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-client.ceph-exporter.trial104.log.gz 2026-02-17T21:24:50.111 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mds.bar.trial104.jdjykv.log 2026-02-17T21:24:50.111 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.log 2026-02-17T21:24:50.112 INFO:teuthology.orchestra.run.trial104.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mds.bar.trial104.jdjykv.log: /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.log: 91.9% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.audit.log.gz 2026-02-17T21:24:50.112 INFO:teuthology.orchestra.run.trial104.stderr: 88.1% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.log.gz 2026-02-17T21:24:50.112 INFO:teuthology.orchestra.run.trial104.stderr: 94.9% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mds.bar.trial104.jdjykv.log.gz 2026-02-17T21:24:50.116 INFO:teuthology.orchestra.run.trial153.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2026-02-17T21:24:50.116 INFO:teuthology.orchestra.run.trial153.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-17T21:24:50.116 INFO:teuthology.orchestra.run.trial153.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2026-02-17T21:24:50.116 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mgr.trial153.ivmqog.log 2026-02-17T21:24:50.117 INFO:teuthology.orchestra.run.trial153.stderr:gzip/var/log/ceph/ceph-client.1.log: -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mds.bar.trial153.cedikz.log 2026-02-17T21:24:50.117 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mgr.trial153.ivmqog.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mon.trial153.log 2026-02-17T21:24:50.117 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mds.bar.trial153.cedikz.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.5.log 2026-02-17T21:24:50.117 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mon.trial153.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.7.log 2026-02-17T21:24:50.117 INFO:teuthology.orchestra.run.trial153.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-17T21:24:50.117 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.cephadm.log 2026-02-17T21:24:50.117 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.4.log 2026-02-17T21:24:50.117 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.audit.log 2026-02-17T21:24:50.117 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.4.log: 84.0% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.cephadm.log.gz 2026-02-17T21:24:50.117 INFO:teuthology.orchestra.run.trial153.stderr:gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-volume.log 2026-02-17T21:24:50.117 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.6.log 2026-02-17T21:24:50.117 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mds.foo.trial153.jtthho.log 2026-02-17T21:24:50.118 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.log 2026-02-17T21:24:50.118 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mds.foo.trial153.jtthho.log: gzip -5 --verbose -- /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-client.ceph-exporter.trial153.log 2026-02-17T21:24:50.118 INFO:teuthology.orchestra.run.trial153.stderr:/var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.log: /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-client.ceph-exporter.trial153.log: 68.4% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-client.ceph-exporter.trial153.log.gz 2026-02-17T21:24:50.118 INFO:teuthology.orchestra.run.trial153.stderr: 92.1% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.audit.log.gz 2026-02-17T21:24:50.118 INFO:teuthology.orchestra.run.trial153.stderr: 93.4% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mgr.trial153.ivmqog.log.gz 2026-02-17T21:24:50.118 INFO:teuthology.orchestra.run.trial153.stderr: 88.1% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph.log.gz 2026-02-17T21:24:50.118 INFO:teuthology.orchestra.run.trial104.stderr: 94.8% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-volume.log.gz 2026-02-17T21:24:50.119 INFO:teuthology.orchestra.run.trial153.stderr: 92.6% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mds.foo.trial153.jtthho.log.gz 2026-02-17T21:24:50.119 INFO:teuthology.orchestra.run.trial104.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-17T21:24:50.119 INFO:teuthology.orchestra.run.trial153.stderr: 94.8% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-volume.log.gz 2026-02-17T21:24:50.135 INFO:teuthology.orchestra.run.trial104.stderr: 94.6% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mds.foo.trial104.gnmuyp.log.gz 2026-02-17T21:24:50.238 INFO:teuthology.orchestra.run.trial104.stderr: 90.7% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mgr.trial104.irrhmt.log.gz 2026-02-17T21:24:50.555 INFO:teuthology.orchestra.run.trial104.stderr: 90.3% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mon.trial104.log.gz 2026-02-17T21:24:50.871 INFO:teuthology.orchestra.run.trial153.stderr: 93.3% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mon.trial153.log.gz 2026-02-17T21:24:57.115 INFO:teuthology.orchestra.run.trial153.stderr: 94.1% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.6.log.gz 2026-02-17T21:24:57.804 INFO:teuthology.orchestra.run.trial104.stderr: 93.9% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.2.log.gz 2026-02-17T21:24:58.916 INFO:teuthology.orchestra.run.trial153.stderr: 93.8% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.7.log.gz 2026-02-17T21:24:59.366 INFO:teuthology.orchestra.run.trial153.stderr: 93.8% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.5.log.gz 2026-02-17T21:24:59.410 INFO:teuthology.orchestra.run.trial104.stderr: 94.0% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.0.log.gz 2026-02-17T21:25:00.999 INFO:teuthology.orchestra.run.trial104.stderr: 94.0% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.1.log.gz 2026-02-17T21:25:01.116 INFO:teuthology.orchestra.run.trial104.stderr: 94.2% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.3.log.gz 2026-02-17T21:25:01.117 INFO:teuthology.orchestra.run.trial104.stderr: 2026-02-17T21:25:01.117 INFO:teuthology.orchestra.run.trial104.stderr:real 0m11.020s 2026-02-17T21:25:01.117 INFO:teuthology.orchestra.run.trial104.stderr:user 0m37.088s 2026-02-17T21:25:01.117 INFO:teuthology.orchestra.run.trial104.stderr:sys 0m2.379s 2026-02-17T21:25:04.758 INFO:teuthology.orchestra.run.trial153.stderr: 94.1% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-osd.4.log.gz 2026-02-17T21:35:00.308 INFO:teuthology.orchestra.run.trial153.stderr: 94.6% -- replaced with /var/log/ceph/19072504-0c43-11f1-93a3-d404e6e7d460/ceph-mds.bar.trial153.cedikz.log.gz 2026-02-17T21:36:01.870 INFO:teuthology.orchestra.run.trial153.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2026-02-17T21:36:01.873 INFO:teuthology.orchestra.run.trial153.stderr: 2026-02-17T21:36:01.873 INFO:teuthology.orchestra.run.trial153.stderr:real 11m11.772s 2026-02-17T21:36:01.873 INFO:teuthology.orchestra.run.trial153.stderr:user 20m14.379s 2026-02-17T21:36:01.873 INFO:teuthology.orchestra.run.trial153.stderr:sys 1m39.149s 2026-02-17T21:36:01.873 INFO:tasks.cephadm:Archiving logs... 2026-02-17T21:36:01.874 DEBUG:teuthology.misc:Transferring archived files from trial104:/var/log/ceph to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:27:21-fs-wip-jcollin-testing-20260217.024944-squid-distro-default-trial/52913/remote/trial104/log 2026-02-17T21:36:01.875 DEBUG:teuthology.orchestra.run.trial104:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T21:36:04.620 DEBUG:teuthology.misc:Transferring archived files from trial153:/var/log/ceph to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:27:21-fs-wip-jcollin-testing-20260217.024944-squid-distro-default-trial/52913/remote/trial153/log 2026-02-17T21:36:04.621 DEBUG:teuthology.orchestra.run.trial153:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-17T21:37:30.301 INFO:tasks.cephadm:Removing cluster... 2026-02-17T21:37:30.302 DEBUG:teuthology.orchestra.run.trial104:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 --force 2026-02-17T21:37:30.429 INFO:teuthology.orchestra.run.trial104.stdout:Deleting cluster with fsid: 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T21:37:30.699 DEBUG:teuthology.orchestra.run.trial153:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 19072504-0c43-11f1-93a3-d404e6e7d460 --force 2026-02-17T21:37:30.841 INFO:teuthology.orchestra.run.trial153.stdout:Deleting cluster with fsid: 19072504-0c43-11f1-93a3-d404e6e7d460 2026-02-17T21:37:31.739 INFO:tasks.cephadm:Removing cephadm ... 2026-02-17T21:37:31.739 DEBUG:teuthology.orchestra.run.trial104:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-17T21:37:31.758 DEBUG:teuthology.orchestra.run.trial153:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-17T21:37:31.775 INFO:tasks.cephadm:Teardown complete 2026-02-17T21:37:31.775 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-17T21:37:31.786 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-17T21:37:31.786 DEBUG:teuthology.orchestra.run.trial104:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T21:37:31.800 DEBUG:teuthology.orchestra.run.trial153:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-17T21:37:32.005 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-17T21:37:32.016 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-17T21:37:32.016 DEBUG:teuthology.orchestra.run.trial104:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T21:37:32.018 DEBUG:teuthology.orchestra.run.trial153:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-17T21:37:32.032 INFO:teuthology.orchestra.run.trial104.stderr:bash: line 1: ntpq: command not found 2026-02-17T21:37:32.035 INFO:teuthology.orchestra.run.trial153.stderr:bash: line 1: ntpq: command not found 2026-02-17T21:37:32.058 INFO:teuthology.orchestra.run.trial104.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T21:37:32.058 INFO:teuthology.orchestra.run.trial104.stdout:=============================================================================== 2026-02-17T21:37:32.058 INFO:teuthology.orchestra.run.trial104.stdout:^- mailhost.netads.com 2 7 367 63 -689us[ -538us] +/- 45ms 2026-02-17T21:37:32.058 INFO:teuthology.orchestra.run.trial104.stdout:^+ jane.qotw.net 2 7 377 6 +585us[ +585us] +/- 24ms 2026-02-17T21:37:32.058 INFO:teuthology.orchestra.run.trial104.stdout:^- 172-234-37-140.ip.linode> 2 6 377 9 +13ms[ +13ms] +/- 94ms 2026-02-17T21:37:32.058 INFO:teuthology.orchestra.run.trial104.stdout:^* blotch.image1tech.net 2 7 377 10 -250us[ -67us] +/- 22ms 2026-02-17T21:37:32.059 INFO:teuthology.orchestra.run.trial153.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-17T21:37:32.059 INFO:teuthology.orchestra.run.trial153.stdout:=============================================================================== 2026-02-17T21:37:32.059 INFO:teuthology.orchestra.run.trial153.stdout:^+ mailhost.netads.com 2 8 377 255 -531us[ -370us] +/- 42ms 2026-02-17T21:37:32.059 INFO:teuthology.orchestra.run.trial153.stdout:^+ jane.qotw.net 2 7 377 75 +849us[ +849us] +/- 26ms 2026-02-17T21:37:32.059 INFO:teuthology.orchestra.run.trial153.stdout:^- 172-234-37-140.ip.linode> 2 8 377 72 +14ms[ +14ms] +/- 96ms 2026-02-17T21:37:32.059 INFO:teuthology.orchestra.run.trial153.stdout:^* blotch.image1tech.net 2 8 377 139 +279us[ +476us] +/- 22ms 2026-02-17T21:37:32.059 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-17T21:37:32.070 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-17T21:37:32.070 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-17T21:37:32.085 DEBUG:teuthology.orchestra.run.trial104:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T21:37:32.146 DEBUG:teuthology.orchestra.run.trial153:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-17T21:37:32.194 DEBUG:teuthology.orchestra.run.trial104:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T21:37:32.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:37:32.221 DEBUG:teuthology.orchestra.run.trial153:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-17T21:37:32.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:37:32.247 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-17T21:37:32.267 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-17T21:37:32.285 INFO:teuthology.task.internal:Duration was 2608.470457 seconds 2026-02-17T21:37:32.285 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-17T21:37:32.301 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-17T21:37:32.302 DEBUG:teuthology.orchestra.run.trial104:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T21:37:32.305 DEBUG:teuthology.orchestra.run.trial153:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-17T21:37:32.340 INFO:teuthology.orchestra.run.trial104.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T21:37:32.342 INFO:teuthology.orchestra.run.trial153.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-17T21:37:32.557 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-17T21:37:32.557 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial104.front.sepia.ceph.com 2026-02-17T21:37:32.558 DEBUG:teuthology.orchestra.run.trial104:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T21:37:32.578 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial153.front.sepia.ceph.com 2026-02-17T21:37:32.578 DEBUG:teuthology.orchestra.run.trial153:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-17T21:37:32.615 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-17T21:37:32.615 DEBUG:teuthology.orchestra.run.trial104:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:37:32.621 DEBUG:teuthology.orchestra.run.trial153:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:37:32.796 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-17T21:37:32.796 DEBUG:teuthology.orchestra.run.trial104:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:37:32.798 DEBUG:teuthology.orchestra.run.trial153:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-17T21:37:32.819 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:37:32.820 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:37:32.820 INFO:teuthology.orchestra.run.trial104.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T21:37:32.820 INFO:teuthology.orchestra.run.trial104.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:37:32.820 INFO:teuthology.orchestra.run.trial104.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T21:37:32.823 INFO:teuthology.orchestra.run.trial153.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-17T21:37:32.824 INFO:teuthology.orchestra.run.trial153.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-17T21:37:32.824 INFO:teuthology.orchestra.run.trial153.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-17T21:37:32.824 INFO:teuthology.orchestra.run.trial153.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-17T21:37:32.824 INFO:teuthology.orchestra.run.trial153.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-17T21:37:32.837 INFO:teuthology.orchestra.run.trial153.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.8% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T21:37:32.848 INFO:teuthology.orchestra.run.trial104.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-17T21:37:32.850 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-17T21:37:32.868 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-17T21:37:32.868 DEBUG:teuthology.orchestra.run.trial104:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T21:37:32.916 DEBUG:teuthology.orchestra.run.trial153:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-17T21:37:32.942 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-17T21:37:32.960 DEBUG:teuthology.orchestra.run.trial104:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:37:32.963 DEBUG:teuthology.orchestra.run.trial153:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:37:32.982 INFO:teuthology.orchestra.run.trial104.stdout:kernel.core_pattern = core 2026-02-17T21:37:33.005 INFO:teuthology.orchestra.run.trial153.stdout:kernel.core_pattern = core 2026-02-17T21:37:33.017 DEBUG:teuthology.orchestra.run.trial104:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:37:33.063 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:37:33.063 DEBUG:teuthology.orchestra.run.trial153:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-17T21:37:33.078 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-17T21:37:33.079 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-17T21:37:33.096 INFO:teuthology.task.internal:Transferring archived files... 2026-02-17T21:37:33.097 DEBUG:teuthology.misc:Transferring archived files from trial104:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:27:21-fs-wip-jcollin-testing-20260217.024944-squid-distro-default-trial/52913/remote/trial104 2026-02-17T21:37:33.097 DEBUG:teuthology.orchestra.run.trial104:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T21:37:33.143 DEBUG:teuthology.misc:Transferring archived files from trial153:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/jcollin-2026-02-17_12:27:21-fs-wip-jcollin-testing-20260217.024944-squid-distro-default-trial/52913/remote/trial153 2026-02-17T21:37:33.143 DEBUG:teuthology.orchestra.run.trial153:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-17T21:37:33.179 INFO:teuthology.task.internal:Removing archive directory... 2026-02-17T21:37:33.179 DEBUG:teuthology.orchestra.run.trial104:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T21:37:33.182 DEBUG:teuthology.orchestra.run.trial153:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-17T21:37:33.227 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-17T21:37:33.246 INFO:teuthology.task.internal:Not uploading archives. 2026-02-17T21:37:33.247 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-17T21:37:33.265 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-17T21:37:33.265 DEBUG:teuthology.orchestra.run.trial104:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T21:37:33.268 DEBUG:teuthology.orchestra.run.trial153:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-17T21:37:33.283 INFO:teuthology.orchestra.run.trial104.stdout: 791912 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 21:37 /home/ubuntu/cephtest 2026-02-17T21:37:33.285 INFO:teuthology.orchestra.run.trial153.stdout: 791912 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 21:37 /home/ubuntu/cephtest 2026-02-17T21:37:33.286 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-17T21:37:33.305 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-17T21:37:33.347 INFO:teuthology.run:Summary data: description: fs/cephadm/multivolume/{0-start 1-mount 2-workload/dbench conf/{client mds mgr mon osd} distro/single-container-host overrides/{ignorelist_health pg_health}} duration: 2608.470456838608 failure_reason: '"2026-02-17T20:57:59.794519+0000 osd.3 (osd.3) 3 : cluster [WRN] OSD bench result of 129443.426060 IOPS is not within the threshold limit range of 1000.000000 IOPS and 80000.000000 IOPS for osd.3. IOPS capacity is unchanged at 21500.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_jcollin@soko04.front.sepia.ceph.com success: false 2026-02-17T21:37:33.347 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-17T21:37:33.455 INFO:teuthology.run:FAIL